[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:42:37 dist-test-slave-tk9z krb5kdc[18444](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:42:37 dist-test-slave-tk9z krb5kdc[18444](info): set up 2 sockets
Aug 12 17:42:37 dist-test-slave-tk9z krb5kdc[18444](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260812 17:42:39.427538 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.591s user 0.004s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:42:39 dist-test-slave-tk9z krb5kdc[18444](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556559, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:42:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:42:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.255.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
I20260812 17:42:39.566787 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:38133
--webserver_interface=127.17.255.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:36055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:38133
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:42:39.731554 18464 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:42:39.731875 18464 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:42:39.731942 18464 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:42:39.736591 18464 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:42:39.736668 18464 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:42:39.736689 18464 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:42:39.736708 18464 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:42:39.736725 18464 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:42:39.743041 18464 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:36055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:38133
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:38133
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18464
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:42:39.744647 18464 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:42:39.746048 18464 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:42:39.790685 18472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:42:39.791009 18474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:42:39.791553 18481 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:42:39.792256 18464 server_base.cc:1034] running on GCE node
I20260812 17:42:39.793063 18464 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:42:39.794581 18464 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:42:39.795804 18464 hybrid_clock.cc:648] HybridClock initialized: now 1786556559795792 us; error 72 us; skew 500 ppm
Aug 12 17:42:39 dist-test-slave-tk9z krb5kdc[18444](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556559, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:42:39.799243 18464 init.cc:377] Logged in from keytab as kudu/127.17.255.62@KRBTEST.COM (short username kudu)
I20260812 17:42:39.800781 18464 webserver.cc:460] Webserver started at http://127.17.255.62:44621/ using document root <none> and password file <none>
I20260812 17:42:39.801488 18464 fs_manager.cc:359] Metadata directory not provided
I20260812 17:42:39.801589 18464 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:42:39.801888 18464 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:42:39.804703 18464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "e47b0cadaf0e42dbb51c8092d949637f"
format_stamp: "Formatted at 2026-08-12 17:42:39 on dist-test-slave-tk9z"
server_key: "56c08ff9c6c78db8e0a178e2de4ae59f"
server_key_iv: "c9189ba8a9c3288afd85566cce0265c3"
server_key_version: "encryptionkey@0"
I20260812 17:42:39.805850 18464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "e47b0cadaf0e42dbb51c8092d949637f"
format_stamp: "Formatted at 2026-08-12 17:42:39 on dist-test-slave-tk9z"
server_key: "56c08ff9c6c78db8e0a178e2de4ae59f"
server_key_iv: "c9189ba8a9c3288afd85566cce0265c3"
server_key_version: "encryptionkey@0"
I20260812 17:42:39.810644 18464 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.003s
I20260812 17:42:39.814296 18491 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:39.815773 18464 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 17:42:39.816048 18464 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "e47b0cadaf0e42dbb51c8092d949637f"
format_stamp: "Formatted at 2026-08-12 17:42:39 on dist-test-slave-tk9z"
server_key: "56c08ff9c6c78db8e0a178e2de4ae59f"
server_key_iv: "c9189ba8a9c3288afd85566cce0265c3"
server_key_version: "encryptionkey@0"
I20260812 17:42:39.816215 18464 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:42:39.841214 18464 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:42:39.844933 18464 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:42:39.845202 18464 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:42:39.857575 18464 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:38133
I20260812 17:42:39.857642 18587 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:38133 every 8 connection(s)
I20260812 17:42:39.859090 18464 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:42:39.864502 18590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:42:39.869148 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 18464
I20260812 17:42:39.869297 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:42:39.870885 18428 external_mini_cluster.cc:1428] Setting key 7ceaa5d3eceda792ca8b52c8f460cfb5
I20260812 17:42:39.873569 18590 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e47b0cadaf0e42dbb51c8092d949637f: Bootstrap starting.
I20260812 17:42:39.878118 18590 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e47b0cadaf0e42dbb51c8092d949637f: Neither blocks nor log segments found. Creating new log.
I20260812 17:42:39.879089 18590 log.cc:824] T 00000000000000000000000000000000 P e47b0cadaf0e42dbb51c8092d949637f: Log is configured to *not* fsync() on all Append() calls
I20260812 17:42:39.881567 18590 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e47b0cadaf0e42dbb51c8092d949637f: No bootstrap required, opened a new log
I20260812 17:42:39.890307 18590 raft_consensus.cc:348] T 00000000000000000000000000000000 P e47b0cadaf0e42dbb51c8092d949637f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e47b0cadaf0e42dbb51c8092d949637f" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 38133 } }
I20260812 17:42:39.890885 18590 raft_consensus.cc:374] T 00000000000000000000000000000000 P e47b0cadaf0e42dbb51c8092d949637f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
Aug 12 17:42:39 dist-test-slave-tk9z krb5kdc[18444](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556559, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:42:39.891021 18590 raft_consensus.cc:729] T 00000000000000000000000000000000 P e47b0cadaf0e42dbb51c8092d949637f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47b0cadaf0e42dbb51c8092d949637f, State: Initialized, Role: FOLLOWER
I20260812 17:42:39.892096 18590 consensus_queue.cc:260] T 00000000000000000000000000000000 P e47b0cadaf0e42dbb51c8092d949637f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e47b0cadaf0e42dbb51c8092d949637f" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 38133 } }
I20260812 17:42:39.892376 18590 raft_consensus.cc:388] T 00000000000000000000000000000000 P e47b0cadaf0e42dbb51c8092d949637f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:42:39.892514 18590 raft_consensus.cc:482] T 00000000000000000000000000000000 P e47b0cadaf0e42dbb51c8092d949637f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:42:39.892656 18590 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e47b0cadaf0e42dbb51c8092d949637f [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:42:39.893991 18590 raft_consensus.cc:504] T 00000000000000000000000000000000 P e47b0cadaf0e42dbb51c8092d949637f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e47b0cadaf0e42dbb51c8092d949637f" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 38133 } }
I20260812 17:42:39.894726 18590 leader_election.cc:302] T 00000000000000000000000000000000 P e47b0cadaf0e42dbb51c8092d949637f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e47b0cadaf0e42dbb51c8092d949637f; no voters:
I20260812 17:42:39.895236 18590 leader_election.cc:288] T 00000000000000000000000000000000 P e47b0cadaf0e42dbb51c8092d949637f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:42:39.895429 18595 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e47b0cadaf0e42dbb51c8092d949637f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:42:39.895720 18595 raft_consensus.cc:686] T 00000000000000000000000000000000 P e47b0cadaf0e42dbb51c8092d949637f [term 1 LEADER]: Becoming Leader. State: Replica: e47b0cadaf0e42dbb51c8092d949637f, State: Running, Role: LEADER
I20260812 17:42:39.896246 18595 consensus_queue.cc:237] T 00000000000000000000000000000000 P e47b0cadaf0e42dbb51c8092d949637f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e47b0cadaf0e42dbb51c8092d949637f" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 38133 } }
I20260812 17:42:39.896850 18590 sys_catalog.cc:564] T 00000000000000000000000000000000 P e47b0cadaf0e42dbb51c8092d949637f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:42:39.898411 18595 sys_catalog.cc:455] T 00000000000000000000000000000000 P e47b0cadaf0e42dbb51c8092d949637f [sys.catalog]: SysCatalogTable state changed. Reason: New leader e47b0cadaf0e42dbb51c8092d949637f. Latest consensus state: current_term: 1 leader_uuid: "e47b0cadaf0e42dbb51c8092d949637f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e47b0cadaf0e42dbb51c8092d949637f" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 38133 } } }
I20260812 17:42:39.898543 18595 sys_catalog.cc:458] T 00000000000000000000000000000000 P e47b0cadaf0e42dbb51c8092d949637f [sys.catalog]: This master's current role is: LEADER
I20260812 17:42:39.899173 18608 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:42:39.900163 18592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:39.875269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58952 (local address 127.17.255.62:38133)
0812 17:42:39.875915 (+ 646us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:39.875933 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:39.877030 (+ 1097us) server_negotiation.cc:407] Connection header received
0812 17:42:39.880674 (+ 3644us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:39.880693 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:39.881022 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:39.881366 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:42:39.883935 (+ 2569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:39.885284 (+ 1349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:39.886779 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:39.887324 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:39.887527 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:39.892404 (+ 4877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:42:39.892410 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:42:39.892425 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:42:39.892522 (+ 97us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:42:39.894608 (+ 2086us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:39.895418 (+ 810us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:39.895426 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:39.895432 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:39.895609 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:39.896174 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:39.896177 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:39.896178 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:39.896949 (+ 771us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:42:39.898099 (+ 1150us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:39.898325 (+ 226us) server_negotiation.cc:299] Negotiation successful
0812 17:42:39.898837 (+ 512us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":465,"thread_start_us":270,"threads_started":1}
I20260812 17:42:39.903306 18598 sys_catalog.cc:455] T 00000000000000000000000000000000 P e47b0cadaf0e42dbb51c8092d949637f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e47b0cadaf0e42dbb51c8092d949637f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e47b0cadaf0e42dbb51c8092d949637f" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 38133 } } }
I20260812 17:42:39.903445 18598 sys_catalog.cc:458] T 00000000000000000000000000000000 P e47b0cadaf0e42dbb51c8092d949637f [sys.catalog]: This master's current role is: LEADER
I20260812 17:42:39.906039 18608 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:42:39.914284 18608 catalog_manager.cc:1347] Generated new cluster ID: 74e75906b8f848bda9c94049985ea830
I20260812 17:42:39.914418 18608 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:42:39.927093 18608 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:42:39.928563 18608 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:42:39.935813 18608 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e47b0cadaf0e42dbb51c8092d949637f: Generated new TSK 0
I20260812 17:42:39.937063 18608 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.255.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab.
Entry for principal kudu/127.17.255.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab.
I20260812 17:42:39.973872 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.1:0
--local_ip_for_outbound_sockets=127.17.255.1
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:38133
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:36055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:42:40.110462 18631 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:42:40.110920 18631 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:42:40.111053 18631 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:42:40.116472 18631 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:42:40.116566 18631 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:42:40.116662 18631 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.1
I20260812 17:42:40.124812 18631 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:36055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:38133
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18631
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.1
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:42:40.126101 18631 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:42:40.127840 18631 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:42:40.143430 18640 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:42:40.143402 18643 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:42:40.143776 18631 server_base.cc:1034] running on GCE node
W20260812 17:42:40.143442 18646 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:42:40.144258 18631 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:42:40.144976 18631 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:42:40.146152 18631 hybrid_clock.cc:648] HybridClock initialized: now 1786556560146121 us; error 43 us; skew 500 ppm
Aug 12 17:42:40 dist-test-slave-tk9z krb5kdc[18444](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556560, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:42:40.149842 18631 init.cc:377] Logged in from keytab as kudu/127.17.255.1@KRBTEST.COM (short username kudu)
I20260812 17:42:40.151129 18631 webserver.cc:460] Webserver started at http://127.17.255.1:43891/ using document root <none> and password file <none>
I20260812 17:42:40.151762 18631 fs_manager.cc:359] Metadata directory not provided
I20260812 17:42:40.151855 18631 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:42:40.152099 18631 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:42:40.154523 18631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-0/data/instance:
uuid: "15b5e6759634482883afb39bcc828480"
format_stamp: "Formatted at 2026-08-12 17:42:40 on dist-test-slave-tk9z"
server_key: "0cecb997994ee6ad73ffb83a69b132cc"
server_key_iv: "465f2c00d9ccf421b219bbce1e8d6d25"
server_key_version: "encryptionkey@0"
I20260812 17:42:40.155205 18631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance:
uuid: "15b5e6759634482883afb39bcc828480"
format_stamp: "Formatted at 2026-08-12 17:42:40 on dist-test-slave-tk9z"
server_key: "0cecb997994ee6ad73ffb83a69b132cc"
server_key_iv: "465f2c00d9ccf421b219bbce1e8d6d25"
server_key_version: "encryptionkey@0"
I20260812 17:42:40.159965 18631 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260812 17:42:40.163173 18660 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:40.164912 18631 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 17:42:40.165088 18631 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-0/wal
uuid: "15b5e6759634482883afb39bcc828480"
format_stamp: "Formatted at 2026-08-12 17:42:40 on dist-test-slave-tk9z"
server_key: "0cecb997994ee6ad73ffb83a69b132cc"
server_key_iv: "465f2c00d9ccf421b219bbce1e8d6d25"
server_key_version: "encryptionkey@0"
I20260812 17:42:40.165300 18631 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:42:40.181862 18631 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:42:40.185773 18631 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:42:40.185990 18631 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:42:40.186774 18631 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:42:40.188015 18631 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:42:40.188072 18631 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:40.188117 18631 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:42:40.188133 18631 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:40.206436 18631 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.1:45877
I20260812 17:42:40.206513 18868 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.1:45877 every 8 connection(s)
I20260812 17:42:40.207559 18631 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
I20260812 17:42:40.213637 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 18631
I20260812 17:42:40.213776 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance
I20260812 17:42:40.214072 18428 external_mini_cluster.cc:1428] Setting key 26c693bdb364cc8759d59210439b18e6
Aug 12 17:42:40 dist-test-slave-tk9z krb5kdc[18444](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556560, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:42:40.227274 18592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:40.210206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:37495 (local address 127.17.255.62:38133)
0812 17:42:40.210453 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:40.210457 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:40.211804 (+ 1347us) server_negotiation.cc:407] Connection header received
0812 17:42:40.212799 (+ 995us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:40.212802 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:40.212863 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:40.212983 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:42:40.214632 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:40.215349 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:40.217510 (+ 2161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:40.217912 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:40.218031 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:40.221838 (+ 3807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:42:40.221844 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:42:40.221849 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:42:40.221888 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:42:40.224190 (+ 2302us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:40.224981 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:40.224989 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:40.224993 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:40.225108 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:40.225618 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:40.225624 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:40.225626 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:40.225939 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:42:40.226069 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:40.226878 (+ 809us) server_negotiation.cc:299] Negotiation successful
0812 17:42:40.227063 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
WARNING: no policy specified for kudu/127.17.255.2@KRBTEST.COM; defaulting to no policy
I20260812 17:42:40.228354 18871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:40.210671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:38133 (local address 127.17.255.1:37495)
0812 17:42:40.211606 (+ 935us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:40.211667 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:40.212564 (+ 897us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:40.213193 (+ 629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:40.213201 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:40.213665 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:42:40.214453 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:40.214473 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:40.215503 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:40.215507 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:40.217349 (+ 1842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:40.217368 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:40.218256 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:40.218261 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:40.218526 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:40.219337 (+ 811us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:42:40.219355 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:42:40.221576 (+ 2221us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:42:40.224368 (+ 2792us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:40.224375 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:40.224397 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:40.224827 (+ 430us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:40.225233 (+ 406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:40.225237 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:40.225239 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:40.225476 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:40.226085 (+ 609us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:42:40.226093 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:42:40.226513 (+ 420us) client_negotiation.cc:769] Sending connection context
0812 17:42:40.226752 (+ 239us) client_negotiation.cc:240] Negotiation successful
0812 17:42:40.227161 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":623,"thread_start_us":151,"threads_started":1}
I20260812 17:42:40.230132 18869 heartbeater.cc:347] Connected to a master server at 127.17.255.62:38133
I20260812 17:42:40.230540 18869 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.2@KRBTEST.COM" created.
I20260812 17:42:40.231285 18869 heartbeater.cc:511] Master 127.17.255.62:38133 requested a full tablet report, sending...
I20260812 17:42:40.234058 18519 ts_manager.cc:194] Registered new tserver with Master: 15b5e6759634482883afb39bcc828480 (127.17.255.1:45877)
I20260812 17:42:40.236042 18519 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.1@KRBTEST.COM'} at 127.17.255.1:37495
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab.
Entry for principal kudu/127.17.255.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab.
I20260812 17:42:40.250870 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.2:0
--local_ip_for_outbound_sockets=127.17.255.2
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:38133
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:36055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:42:40.383149 18879 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:42:40.383515 18879 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:42:40.383605 18879 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:42:40.388134 18879 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:42:40.388238 18879 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:42:40.388321 18879 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.2
I20260812 17:42:40.394508 18879 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:36055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:38133
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18879
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.2
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:42:40.395769 18879 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:42:40.396886 18879 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:42:40.408259 18885 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:42:40.408252 18891 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:42:40.408329 18879 server_base.cc:1034] running on GCE node
W20260812 17:42:40.408293 18887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:42:40.409144 18879 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:42:40.409847 18879 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:42:40.411032 18879 hybrid_clock.cc:648] HybridClock initialized: now 1786556560410994 us; error 53 us; skew 500 ppm
Aug 12 17:42:40 dist-test-slave-tk9z krb5kdc[18444](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556560, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:42:40.414101 18879 init.cc:377] Logged in from keytab as kudu/127.17.255.2@KRBTEST.COM (short username kudu)
I20260812 17:42:40.415278 18879 webserver.cc:460] Webserver started at http://127.17.255.2:34171/ using document root <none> and password file <none>
I20260812 17:42:40.415900 18879 fs_manager.cc:359] Metadata directory not provided
I20260812 17:42:40.415993 18879 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:42:40.416230 18879 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:42:40.418424 18879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-1/data/instance:
uuid: "29b757c3fecd407d938c8219c9fdb6ad"
format_stamp: "Formatted at 2026-08-12 17:42:40 on dist-test-slave-tk9z"
server_key: "77575406041596f0db92b4afe1f5ea49"
server_key_iv: "72e8b2ca33cd369559b1336e360b02c2"
server_key_version: "encryptionkey@0"
I20260812 17:42:40.419171 18879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance:
uuid: "29b757c3fecd407d938c8219c9fdb6ad"
format_stamp: "Formatted at 2026-08-12 17:42:40 on dist-test-slave-tk9z"
server_key: "77575406041596f0db92b4afe1f5ea49"
server_key_iv: "72e8b2ca33cd369559b1336e360b02c2"
server_key_version: "encryptionkey@0"
I20260812 17:42:40.423405 18879 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260812 17:42:40.426594 18901 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:40.428267 18879 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 17:42:40.428529 18879 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-1/wal
uuid: "29b757c3fecd407d938c8219c9fdb6ad"
format_stamp: "Formatted at 2026-08-12 17:42:40 on dist-test-slave-tk9z"
server_key: "77575406041596f0db92b4afe1f5ea49"
server_key_iv: "72e8b2ca33cd369559b1336e360b02c2"
server_key_version: "encryptionkey@0"
I20260812 17:42:40.428691 18879 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:42:40.443149 18879 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:42:40.446617 18879 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:42:40.446784 18879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:42:40.447360 18879 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:42:40.448316 18879 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:42:40.448365 18879 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:40.448406 18879 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:42:40.448422 18879 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:40.461263 18879 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.2:39153
I20260812 17:42:40.461300 19090 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.2:39153 every 8 connection(s)
I20260812 17:42:40.462302 18879 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
I20260812 17:42:40.469744 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 18879
I20260812 17:42:40.469868 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance
I20260812 17:42:40.470141 18428 external_mini_cluster.cc:1428] Setting key 5d7d7e2c2e3fbcdaf1b89e85cbdfc063
Aug 12 17:42:40 dist-test-slave-tk9z krb5kdc[18444](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556560, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:42:40.479768 18592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:40.464532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:54763 (local address 127.17.255.62:38133)
0812 17:42:40.464684 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:40.464688 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:40.465877 (+ 1189us) server_negotiation.cc:407] Connection header received
0812 17:42:40.466912 (+ 1035us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:40.466916 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:40.466974 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:40.467060 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:42:40.468303 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:40.468884 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:40.470997 (+ 2113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:40.471309 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:40.471443 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:40.474902 (+ 3459us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:42:40.474907 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:42:40.474910 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:42:40.474952 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:42:40.476962 (+ 2010us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:40.477635 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:40.477642 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:40.477647 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:40.477787 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:40.478201 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:40.478206 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:40.478210 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:40.478561 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:42:40.478687 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:40.479300 (+ 613us) server_negotiation.cc:299] Negotiation successful
0812 17:42:40.479481 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 17:42:40.480564 19097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:40.464950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:38133 (local address 127.17.255.2:54763)
0812 17:42:40.465725 (+ 775us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:40.465770 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:40.466699 (+ 929us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:40.467239 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:40.467246 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:40.467624 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:42:40.468136 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:40.468150 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:40.469049 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:40.469052 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:40.470828 (+ 1776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:40.470840 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:40.471504 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:40.471508 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:40.471683 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:40.472500 (+ 817us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:42:40.472519 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:42:40.474656 (+ 2137us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:42:40.477122 (+ 2466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:40.477130 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:40.477147 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:40.477494 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:40.477903 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:40.477905 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:40.477907 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:40.478073 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:40.478684 (+ 611us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:42:40.478691 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:42:40.478994 (+ 303us) client_negotiation.cc:769] Sending connection context
0812 17:42:40.479172 (+ 178us) client_negotiation.cc:240] Negotiation successful
0812 17:42:40.479492 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":177,"threads_started":1}
I20260812 17:42:40.481949 19091 heartbeater.cc:347] Connected to a master server at 127.17.255.62:38133
I20260812 17:42:40.482267 19091 heartbeater.cc:464] Registering TS with master...
I20260812 17:42:40.483071 19091 heartbeater.cc:511] Master 127.17.255.62:38133 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.17.255.3@KRBTEST.COM; defaulting to no policy
I20260812 17:42:40.484449 18519 ts_manager.cc:194] Registered new tserver with Master: 29b757c3fecd407d938c8219c9fdb6ad (127.17.255.2:39153)
I20260812 17:42:40.485128 18519 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.2@KRBTEST.COM'} at 127.17.255.2:54763
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab.
Entry for principal kudu/127.17.255.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab.
I20260812 17:42:40.507023 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.3:0
--local_ip_for_outbound_sockets=127.17.255.3
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:38133
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:36055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:42:40.632215 19102 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:42:40.632531 19102 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:42:40.632623 19102 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:42:40.636766 19102 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:42:40.636829 19102 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:42:40.636889 19102 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.3
I20260812 17:42:40.642359 19102 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:36055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:38133
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19102
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.3
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:42:40.643543 19102 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:42:40.644626 19102 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:42:40.654848 19108 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:42:40.654842 19112 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:42:40.655103 19102 server_base.cc:1034] running on GCE node
W20260812 17:42:40.654911 19114 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:42:40.655731 19102 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:42:40.656527 19102 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:42:40.657732 19102 hybrid_clock.cc:648] HybridClock initialized: now 1786556560657697 us; error 48 us; skew 500 ppm
Aug 12 17:42:40 dist-test-slave-tk9z krb5kdc[18444](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556560, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:42:40.661075 19102 init.cc:377] Logged in from keytab as kudu/127.17.255.3@KRBTEST.COM (short username kudu)
I20260812 17:42:40.662124 19102 webserver.cc:460] Webserver started at http://127.17.255.3:45019/ using document root <none> and password file <none>
I20260812 17:42:40.662796 19102 fs_manager.cc:359] Metadata directory not provided
I20260812 17:42:40.662863 19102 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:42:40.663115 19102 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:42:40.665390 19102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-2/data/instance:
uuid: "ea4cf7d350b84c2898f2cd3ba0aa54bc"
format_stamp: "Formatted at 2026-08-12 17:42:40 on dist-test-slave-tk9z"
server_key: "70b9b2b030936bb9df4a01693deb1921"
server_key_iv: "953f22a0c93f6886c1c4e63cb2781734"
server_key_version: "encryptionkey@0"
I20260812 17:42:40.666059 19102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance:
uuid: "ea4cf7d350b84c2898f2cd3ba0aa54bc"
format_stamp: "Formatted at 2026-08-12 17:42:40 on dist-test-slave-tk9z"
server_key: "70b9b2b030936bb9df4a01693deb1921"
server_key_iv: "953f22a0c93f6886c1c4e63cb2781734"
server_key_version: "encryptionkey@0"
I20260812 17:42:40.670091 19102 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260812 17:42:40.672691 19129 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:40.674151 19102 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 17:42:40.674288 19102 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-2/wal
uuid: "ea4cf7d350b84c2898f2cd3ba0aa54bc"
format_stamp: "Formatted at 2026-08-12 17:42:40 on dist-test-slave-tk9z"
server_key: "70b9b2b030936bb9df4a01693deb1921"
server_key_iv: "953f22a0c93f6886c1c4e63cb2781734"
server_key_version: "encryptionkey@0"
I20260812 17:42:40.674436 19102 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:42:40.689652 19102 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:42:40.693457 19102 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:42:40.693701 19102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:42:40.694479 19102 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:42:40.695473 19102 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:42:40.695550 19102 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:40.695627 19102 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:42:40.695672 19102 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:40.709661 19102 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.3:46235
I20260812 17:42:40.709684 19339 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.3:46235 every 8 connection(s)
I20260812 17:42:40.710862 19102 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
I20260812 17:42:40.715529 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 19102
I20260812 17:42:40.715668 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance
I20260812 17:42:40.715929 18428 external_mini_cluster.cc:1428] Setting key 5a93989a1ab94193f5602b4317c1330b
Aug 12 17:42:40 dist-test-slave-tk9z krb5kdc[18444](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556560, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:42:40.725639 18592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:40.712899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:42745 (local address 127.17.255.62:38133)
0812 17:42:40.713069 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:40.713074 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:40.714234 (+ 1160us) server_negotiation.cc:407] Connection header received
0812 17:42:40.715207 (+ 973us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:40.715209 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:40.715297 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:40.715394 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:42:40.716910 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:40.717604 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:40.719001 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:40.719218 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:40.719297 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:40.722324 (+ 3027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:42:40.722327 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:42:40.722329 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:42:40.722354 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:42:40.723698 (+ 1344us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:40.724199 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:40.724201 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:40.724203 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:40.724281 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:40.724623 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:40.724626 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:40.724627 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:40.724825 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:42:40.724900 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:40.725407 (+ 507us) server_negotiation.cc:299] Negotiation successful
0812 17:42:40.725512 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 17:42:40.726696 19344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:40.713347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:38133 (local address 127.17.255.3:42745)
0812 17:42:40.714083 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:40.714127 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:40.715013 (+ 886us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:40.715577 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:40.715584 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:40.716090 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:42:40.716734 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:40.716760 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:40.717743 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:40.717746 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:40.718845 (+ 1099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:40.718856 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:40.719406 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:40.719409 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:40.719579 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:40.720385 (+ 806us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:42:40.720404 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:42:40.722152 (+ 1748us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:42:40.723807 (+ 1655us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:40.723812 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:40.723827 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:40.724107 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:40.724388 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:40.724390 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:40.724391 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:40.724542 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:40.724922 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:42:40.724927 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:42:40.725192 (+ 265us) client_negotiation.cc:769] Sending connection context
0812 17:42:40.725386 (+ 194us) client_negotiation.cc:240] Negotiation successful
0812 17:42:40.725672 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":522,"thread_start_us":125,"threads_started":1}
I20260812 17:42:40.727957 19341 heartbeater.cc:347] Connected to a master server at 127.17.255.62:38133
I20260812 17:42:40.728202 19341 heartbeater.cc:464] Registering TS with master...
I20260812 17:42:40.728700 19341 heartbeater.cc:511] Master 127.17.255.62:38133 requested a full tablet report, sending...
I20260812 17:42:40.729768 18519 ts_manager.cc:194] Registered new tserver with Master: ea4cf7d350b84c2898f2cd3ba0aa54bc (127.17.255.3:46235)
I20260812 17:42:40.730517 18519 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.3@KRBTEST.COM'} at 127.17.255.3:42745
I20260812 17:42:40.730883 18428 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 17:42:40 dist-test-slave-tk9z krb5kdc[18444](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556560, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 17:42:40 dist-test-slave-tk9z krb5kdc[18444](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556560, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.255.1@KRBTEST.COM
I20260812 17:42:40.762084 19349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:40.750792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48206 (local address 127.17.255.1:45877)
0812 17:42:40.751181 (+ 389us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:40.751188 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:40.751217 (+ 29us) server_negotiation.cc:407] Connection header received
0812 17:42:40.751311 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:40.751317 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:40.751528 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:40.751738 (+ 210us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:42:40.752563 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:40.753527 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:40.754548 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:40.755042 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:40.755182 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:40.758105 (+ 2923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:42:40.758119 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:42:40.758139 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:42:40.758175 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:42:40.760020 (+ 1845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:40.760572 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:40.760579 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:40.760581 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:40.760678 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:40.760983 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:40.760987 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:40.760989 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:40.761285 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:42:40.761553 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:40.761727 (+ 174us) server_negotiation.cc:299] Negotiation successful
0812 17:42:40.761898 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":146,"threads_started":1}
W20260812 17:42:40.763310 18721 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48206
Aug 12 17:42:40 dist-test-slave-tk9z krb5kdc[18444](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556560, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 17:42:40 dist-test-slave-tk9z krb5kdc[18444](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556560, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.255.1@KRBTEST.COM
I20260812 17:42:40.792624 19349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:40.783534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48216 (local address 127.17.255.1:45877)
0812 17:42:40.783708 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:40.783712 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:40.783766 (+ 54us) server_negotiation.cc:407] Connection header received
0812 17:42:40.783910 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:40.783913 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:40.783959 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:40.784033 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:42:40.784793 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:40.785398 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:40.786221 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:40.786638 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:40.786736 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:40.789241 (+ 2505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:42:40.789244 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:42:40.789246 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:42:40.789279 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:42:40.790729 (+ 1450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:40.791113 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:40.791116 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:40.791117 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:40.791196 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:40.791649 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:40.791652 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:40.791654 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:40.791871 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:42:40.791992 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:40.792272 (+ 280us) server_negotiation.cc:299] Negotiation successful
0812 17:42:40.792435 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 17:42:40.793960 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 18631
I20260812 17:42:40.808954 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 18879
I20260812 17:42:40.837952 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 19102
I20260812 17:42:40.853369 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 18464
2026-08-12T17:42:40Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (3067 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:42:40 dist-test-slave-tk9z krb5kdc[19359](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:42:40 dist-test-slave-tk9z krb5kdc[19359](info): set up 2 sockets
Aug 12 17:42:40 dist-test-slave-tk9z krb5kdc[19359](info): commencing operation
krb5kdc: starting...
W20260812 17:42:42.187352 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.301s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:42:42 dist-test-slave-tk9z krb5kdc[19359](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556562, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:42:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:42:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.255.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
I20260812 17:42:42.330050 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:40129
--webserver_interface=127.17.255.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:36023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:40129
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:42:42.454092 19384 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:42:42.454496 19384 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:42:42.454587 19384 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:42:42.459254 19384 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:42:42.459319 19384 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:42:42.459340 19384 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:42:42.459357 19384 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:42:42.459373 19384 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:42:42.464970 19384 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:36023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:40129
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:40129
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19384
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:42:42.466149 19384 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:42:42.467303 19384 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:42:42.476516 19391 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:42:42.478544 19394 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:42:42.478626 19384 server_base.cc:1034] running on GCE node
W20260812 17:42:42.478757 19392 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:42:42.479456 19384 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:42:42.480816 19384 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:42:42.482033 19384 hybrid_clock.cc:648] HybridClock initialized: now 1786556562482017 us; error 27 us; skew 500 ppm
Aug 12 17:42:42 dist-test-slave-tk9z krb5kdc[19359](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556562, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:42:42.485216 19384 init.cc:377] Logged in from keytab as kudu/127.17.255.62@KRBTEST.COM (short username kudu)
I20260812 17:42:42.486261 19384 webserver.cc:460] Webserver started at http://127.17.255.62:35209/ using document root <none> and password file <none>
I20260812 17:42:42.487171 19384 fs_manager.cc:359] Metadata directory not provided
I20260812 17:42:42.487300 19384 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:42:42.487576 19384 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:42:42.489737 19384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "d0df75d942834506aa72dd3369c25b22"
format_stamp: "Formatted at 2026-08-12 17:42:42 on dist-test-slave-tk9z"
server_key: "3b3142f5e0cc30b6f71e57b4af5786aa"
server_key_iv: "3dd4620397934f1ecc43e1ef6a185a8e"
server_key_version: "encryptionkey@0"
I20260812 17:42:42.490322 19384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "d0df75d942834506aa72dd3369c25b22"
format_stamp: "Formatted at 2026-08-12 17:42:42 on dist-test-slave-tk9z"
server_key: "3b3142f5e0cc30b6f71e57b4af5786aa"
server_key_iv: "3dd4620397934f1ecc43e1ef6a185a8e"
server_key_version: "encryptionkey@0"
I20260812 17:42:42.494411 19384 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 17:42:42.496987 19405 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:42.498277 19384 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 17:42:42.498456 19384 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "d0df75d942834506aa72dd3369c25b22"
format_stamp: "Formatted at 2026-08-12 17:42:42 on dist-test-slave-tk9z"
server_key: "3b3142f5e0cc30b6f71e57b4af5786aa"
server_key_iv: "3dd4620397934f1ecc43e1ef6a185a8e"
server_key_version: "encryptionkey@0"
I20260812 17:42:42.498565 19384 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:42:42.511103 19384 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:42:42.514590 19384 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:42:42.514804 19384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:42:42.523213 19384 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:40129
I20260812 17:42:42.523286 19507 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:40129 every 8 connection(s)
I20260812 17:42:42.524430 19384 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:42:42.527647 19508 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:42:42.528156 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 19384
I20260812 17:42:42.528302 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:42:42.528622 18428 external_mini_cluster.cc:1428] Setting key 111b68dfcae61a9cdd347d9e857dac80
I20260812 17:42:42.536115 19508 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0df75d942834506aa72dd3369c25b22: Bootstrap starting.
Aug 12 17:42:42 dist-test-slave-tk9z krb5kdc[19359](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556562, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:42:42.539508 19508 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d0df75d942834506aa72dd3369c25b22: Neither blocks nor log segments found. Creating new log.
I20260812 17:42:42.540447 19508 log.cc:824] T 00000000000000000000000000000000 P d0df75d942834506aa72dd3369c25b22: Log is configured to *not* fsync() on all Append() calls
I20260812 17:42:42.543129 19508 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0df75d942834506aa72dd3369c25b22: No bootstrap required, opened a new log
I20260812 17:42:42.545269 19517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:42.530170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54592 (local address 127.17.255.62:40129)
0812 17:42:42.530705 (+ 535us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:42.530722 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:42.530762 (+ 40us) server_negotiation.cc:407] Connection header received
0812 17:42:42.531453 (+ 691us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:42.531473 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:42.531839 (+ 366us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:42.532146 (+ 307us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:42:42.533256 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:42.534513 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:42.535838 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:42.536522 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:42.536683 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:42.539944 (+ 3261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:42:42.539950 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:42:42.539967 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:42:42.540000 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:42:42.541960 (+ 1960us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:42.542608 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:42.542614 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:42.542619 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:42.542745 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:42.543071 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:42.543073 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:42.543074 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:42.543562 (+ 488us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:42:42.543732 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:42.544080 (+ 348us) server_negotiation.cc:299] Negotiation successful
0812 17:42:42.544428 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":206,"threads_started":1}
I20260812 17:42:42.549881 19508 raft_consensus.cc:348] T 00000000000000000000000000000000 P d0df75d942834506aa72dd3369c25b22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0df75d942834506aa72dd3369c25b22" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40129 } }
I20260812 17:42:42.550230 19508 raft_consensus.cc:374] T 00000000000000000000000000000000 P d0df75d942834506aa72dd3369c25b22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:42:42.550338 19508 raft_consensus.cc:729] T 00000000000000000000000000000000 P d0df75d942834506aa72dd3369c25b22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0df75d942834506aa72dd3369c25b22, State: Initialized, Role: FOLLOWER
I20260812 17:42:42.550872 19508 consensus_queue.cc:260] T 00000000000000000000000000000000 P d0df75d942834506aa72dd3369c25b22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0df75d942834506aa72dd3369c25b22" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40129 } }
I20260812 17:42:42.551034 19508 raft_consensus.cc:388] T 00000000000000000000000000000000 P d0df75d942834506aa72dd3369c25b22 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:42:42.551106 19508 raft_consensus.cc:482] T 00000000000000000000000000000000 P d0df75d942834506aa72dd3369c25b22 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:42:42.551225 19508 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d0df75d942834506aa72dd3369c25b22 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:42:42.552356 19508 raft_consensus.cc:504] T 00000000000000000000000000000000 P d0df75d942834506aa72dd3369c25b22 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0df75d942834506aa72dd3369c25b22" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40129 } }
I20260812 17:42:42.552744 19508 leader_election.cc:302] T 00000000000000000000000000000000 P d0df75d942834506aa72dd3369c25b22 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d0df75d942834506aa72dd3369c25b22; no voters:
I20260812 17:42:42.553105 19508 leader_election.cc:288] T 00000000000000000000000000000000 P d0df75d942834506aa72dd3369c25b22 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:42:42.553277 19519 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d0df75d942834506aa72dd3369c25b22 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:42:42.553524 19519 raft_consensus.cc:686] T 00000000000000000000000000000000 P d0df75d942834506aa72dd3369c25b22 [term 1 LEADER]: Becoming Leader. State: Replica: d0df75d942834506aa72dd3369c25b22, State: Running, Role: LEADER
I20260812 17:42:42.553917 19519 consensus_queue.cc:237] T 00000000000000000000000000000000 P d0df75d942834506aa72dd3369c25b22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0df75d942834506aa72dd3369c25b22" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40129 } }
I20260812 17:42:42.554697 19508 sys_catalog.cc:564] T 00000000000000000000000000000000 P d0df75d942834506aa72dd3369c25b22 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:42:42.555935 19525 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0df75d942834506aa72dd3369c25b22 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d0df75d942834506aa72dd3369c25b22" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0df75d942834506aa72dd3369c25b22" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40129 } } }
I20260812 17:42:42.555946 19527 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0df75d942834506aa72dd3369c25b22 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d0df75d942834506aa72dd3369c25b22. Latest consensus state: current_term: 1 leader_uuid: "d0df75d942834506aa72dd3369c25b22" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0df75d942834506aa72dd3369c25b22" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40129 } } }
I20260812 17:42:42.556097 19527 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0df75d942834506aa72dd3369c25b22 [sys.catalog]: This master's current role is: LEADER
I20260812 17:42:42.556097 19525 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0df75d942834506aa72dd3369c25b22 [sys.catalog]: This master's current role is: LEADER
I20260812 17:42:42.556565 19541 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:42:42.560066 19541 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:42:42.566321 19541 catalog_manager.cc:1347] Generated new cluster ID: 848d2ec3c4154681930e9fe2c736e1ec
I20260812 17:42:42.566466 19541 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:42:42.580049 19541 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:42:42.581547 19541 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:42:42.593187 19541 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d0df75d942834506aa72dd3369c25b22: Generated new TSK 0
I20260812 17:42:42.594198 19541 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.255.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab.
Entry for principal kudu/127.17.255.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab.
I20260812 17:42:42.629566 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.1:0
--local_ip_for_outbound_sockets=127.17.255.1
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:40129
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:36023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:42:42.755587 19562 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:42:42.755944 19562 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:42:42.756032 19562 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:42:42.760330 19562 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:42:42.760432 19562 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:42:42.760529 19562 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.1
I20260812 17:42:42.766139 19562 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:36023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:40129
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19562
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.1
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:42:42.767449 19562 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:42:42.768787 19562 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:42:42.779498 19573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:42:42.779506 19570 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:42:42.779506 19571 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:42:42.779794 19562 server_base.cc:1034] running on GCE node
I20260812 17:42:42.780346 19562 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:42:42.781147 19562 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:42:42.782405 19562 hybrid_clock.cc:648] HybridClock initialized: now 1786556562782358 us; error 44 us; skew 500 ppm
Aug 12 17:42:42 dist-test-slave-tk9z krb5kdc[19359](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556562, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:42:42.785581 19562 init.cc:377] Logged in from keytab as kudu/127.17.255.1@KRBTEST.COM (short username kudu)
I20260812 17:42:42.786724 19562 webserver.cc:460] Webserver started at http://127.17.255.1:39805/ using document root <none> and password file <none>
I20260812 17:42:42.787364 19562 fs_manager.cc:359] Metadata directory not provided
I20260812 17:42:42.787459 19562 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:42:42.787719 19562 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:42:42.790112 19562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-0/data/instance:
uuid: "05302300e6ab46fcbee217a0010c1b1d"
format_stamp: "Formatted at 2026-08-12 17:42:42 on dist-test-slave-tk9z"
server_key: "d0ab053a31c7b586aa146f148261e05d"
server_key_iv: "5a608e8f394593de5a1907e0997555ad"
server_key_version: "encryptionkey@0"
I20260812 17:42:42.790828 19562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance:
uuid: "05302300e6ab46fcbee217a0010c1b1d"
format_stamp: "Formatted at 2026-08-12 17:42:42 on dist-test-slave-tk9z"
server_key: "d0ab053a31c7b586aa146f148261e05d"
server_key_iv: "5a608e8f394593de5a1907e0997555ad"
server_key_version: "encryptionkey@0"
I20260812 17:42:42.795086 19562 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 17:42:42.797945 19586 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:42.799381 19562 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:42:42.799538 19562 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-0/wal
uuid: "05302300e6ab46fcbee217a0010c1b1d"
format_stamp: "Formatted at 2026-08-12 17:42:42 on dist-test-slave-tk9z"
server_key: "d0ab053a31c7b586aa146f148261e05d"
server_key_iv: "5a608e8f394593de5a1907e0997555ad"
server_key_version: "encryptionkey@0"
I20260812 17:42:42.799669 19562 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:42:42.812803 19562 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:42:42.816426 19562 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:42:42.816650 19562 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:42:42.817304 19562 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:42:42.818267 19562 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:42:42.818346 19562 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:42.818439 19562 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:42:42.818485 19562 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:42.831101 19562 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.1:43243
I20260812 17:42:42.831127 19783 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.1:43243 every 8 connection(s)
I20260812 17:42:42.832130 19562 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
I20260812 17:42:42.838014 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 19562
I20260812 17:42:42.838116 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance
I20260812 17:42:42.838442 18428 external_mini_cluster.cc:1428] Setting key fa812f101bed9fac803e453ea84bca77
Aug 12 17:42:42 dist-test-slave-tk9z krb5kdc[19359](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556562, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:42:42.848420 19517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:42.834203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:54385 (local address 127.17.255.62:40129)
0812 17:42:42.834456 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:42.834465 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:42.835442 (+ 977us) server_negotiation.cc:407] Connection header received
0812 17:42:42.836690 (+ 1248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:42.836694 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:42.836755 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:42.836861 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:42:42.838252 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:42.838924 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:42.840304 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:42.840549 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:42.840653 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:42.843661 (+ 3008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:42:42.843668 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:42:42.843674 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:42:42.843709 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:42:42.845686 (+ 1977us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:42.846340 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:42.846348 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:42.846352 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:42.846501 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:42.846945 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:42.846952 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:42.846956 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:42.847248 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:42:42.847362 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:42.848004 (+ 642us) server_negotiation.cc:299] Negotiation successful
0812 17:42:42.848170 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 17:42:42.849236 19788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:42.834652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40129 (local address 127.17.255.1:54385)
0812 17:42:42.835245 (+ 593us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:42.835302 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:42.836462 (+ 1160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:42.837070 (+ 608us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:42.837077 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:42.837467 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:42:42.838064 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:42.838103 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:42.839052 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:42.839056 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:42.840175 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:42.840186 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:42.840715 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:42.840719 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:42.840915 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:42.841661 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:42:42.841699 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:42:42.843464 (+ 1765us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:42:42.845858 (+ 2394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:42.845865 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:42.845881 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:42.846214 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:42.846665 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:42.846668 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:42.846669 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:42.846833 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:42.847372 (+ 539us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:42:42.847378 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:42:42.847728 (+ 350us) client_negotiation.cc:769] Sending connection context
0812 17:42:42.847912 (+ 184us) client_negotiation.cc:240] Negotiation successful
0812 17:42:42.848235 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":184,"threads_started":1}
WARNING: no policy specified for kudu/127.17.255.2@KRBTEST.COM; defaulting to no policy
I20260812 17:42:42.850801 19785 heartbeater.cc:347] Connected to a master server at 127.17.255.62:40129
I20260812 17:42:42.851111 19785 heartbeater.cc:464] Registering TS with master...
I20260812 17:42:42.851686 19785 heartbeater.cc:511] Master 127.17.255.62:40129 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.2@KRBTEST.COM" created.
I20260812 17:42:42.853590 19441 ts_manager.cc:194] Registered new tserver with Master: 05302300e6ab46fcbee217a0010c1b1d (127.17.255.1:43243)
I20260812 17:42:42.854938 19441 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.1@KRBTEST.COM'} at 127.17.255.1:54385
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab.
Entry for principal kudu/127.17.255.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab.
I20260812 17:42:42.871934 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.2:0
--local_ip_for_outbound_sockets=127.17.255.2
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:40129
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:36023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:42:43.004704 19793 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:42:43.005033 19793 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:42:43.005125 19793 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:42:43.009414 19793 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:42:43.009493 19793 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:42:43.009585 19793 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.2
I20260812 17:42:43.015719 19793 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:36023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:40129
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19793
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.2
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:42:43.017072 19793 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:42:43.018242 19793 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:42:43.028815 19801 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:42:43.028954 19803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:42:43.028972 19800 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:42:43.029712 19793 server_base.cc:1034] running on GCE node
I20260812 17:42:43.030320 19793 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:42:43.031157 19793 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:42:43.032341 19793 hybrid_clock.cc:648] HybridClock initialized: now 1786556563032319 us; error 37 us; skew 500 ppm
Aug 12 17:42:43 dist-test-slave-tk9z krb5kdc[19359](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556563, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:42:43.040536 19793 init.cc:377] Logged in from keytab as kudu/127.17.255.2@KRBTEST.COM (short username kudu)
I20260812 17:42:43.041675 19793 webserver.cc:460] Webserver started at http://127.17.255.2:43159/ using document root <none> and password file <none>
I20260812 17:42:43.042320 19793 fs_manager.cc:359] Metadata directory not provided
I20260812 17:42:43.042459 19793 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:42:43.042723 19793 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:42:43.045125 19793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-1/data/instance:
uuid: "b6f7e867776242eebc5efc755d82af37"
format_stamp: "Formatted at 2026-08-12 17:42:43 on dist-test-slave-tk9z"
server_key: "8b9552ee54826396707074cb7bb99a81"
server_key_iv: "de3654a223f957059b162852b468bdee"
server_key_version: "encryptionkey@0"
I20260812 17:42:43.045840 19793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance:
uuid: "b6f7e867776242eebc5efc755d82af37"
format_stamp: "Formatted at 2026-08-12 17:42:43 on dist-test-slave-tk9z"
server_key: "8b9552ee54826396707074cb7bb99a81"
server_key_iv: "de3654a223f957059b162852b468bdee"
server_key_version: "encryptionkey@0"
I20260812 17:42:43.050139 19793 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260812 17:42:43.053030 19817 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:43.054455 19793 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:42:43.054626 19793 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-1/wal
uuid: "b6f7e867776242eebc5efc755d82af37"
format_stamp: "Formatted at 2026-08-12 17:42:43 on dist-test-slave-tk9z"
server_key: "8b9552ee54826396707074cb7bb99a81"
server_key_iv: "de3654a223f957059b162852b468bdee"
server_key_version: "encryptionkey@0"
I20260812 17:42:43.054747 19793 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:42:43.070775 19793 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:42:43.074478 19793 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:42:43.074658 19793 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:42:43.075296 19793 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:42:43.076361 19793 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:42:43.076442 19793 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:43.076540 19793 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:42:43.076583 19793 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:43.090152 19793 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.2:35379
I20260812 17:42:43.090178 20025 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.2:35379 every 8 connection(s)
I20260812 17:42:43.091357 19793 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
I20260812 17:42:43.100629 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 19793
I20260812 17:42:43.100796 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance
I20260812 17:42:43.101118 18428 external_mini_cluster.cc:1428] Setting key a1bf78c47ea849bc5a5a5ee15193b0ab
Aug 12 17:42:43 dist-test-slave-tk9z krb5kdc[19359](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556563, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:42:43.107283 19517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:43.093686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:46629 (local address 127.17.255.62:40129)
0812 17:42:43.093827 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:43.093831 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:43.094891 (+ 1060us) server_negotiation.cc:407] Connection header received
0812 17:42:43.096039 (+ 1148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:43.096046 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:43.096109 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:43.096207 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:42:43.097482 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:43.098035 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:43.099296 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:43.099527 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:43.099629 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:43.102710 (+ 3081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:42:43.102716 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:42:43.102719 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:42:43.102748 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:42:43.104376 (+ 1628us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:43.105082 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:43.105088 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:43.105094 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:43.105213 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:43.105622 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:43.105627 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:43.105632 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:43.105933 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:42:43.106054 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:43.106801 (+ 747us) server_negotiation.cc:299] Negotiation successful
0812 17:42:43.107055 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 17:42:43.107676 20032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:43.094137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40129 (local address 127.17.255.2:46629)
0812 17:42:43.094706 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:43.094753 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:43.095795 (+ 1042us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:43.096405 (+ 610us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:43.096412 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:43.096810 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:42:43.097331 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:43.097347 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:43.098166 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:43.098169 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:43.099151 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:43.099162 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:43.099689 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:43.099693 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:43.099868 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:43.100538 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:42:43.100564 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:42:43.102524 (+ 1960us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:42:43.104511 (+ 1987us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:43.104522 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:43.104545 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:43.104953 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:43.105338 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:43.105341 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:43.105342 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:43.105507 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:43.106047 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:42:43.106053 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:42:43.106313 (+ 260us) client_negotiation.cc:769] Sending connection context
0812 17:42:43.106556 (+ 243us) client_negotiation.cc:240] Negotiation successful
0812 17:42:43.106849 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":181,"threads_started":1}
I20260812 17:42:43.109127 20028 heartbeater.cc:347] Connected to a master server at 127.17.255.62:40129
I20260812 17:42:43.109416 20028 heartbeater.cc:464] Registering TS with master...
I20260812 17:42:43.109966 20028 heartbeater.cc:511] Master 127.17.255.62:40129 requested a full tablet report, sending...
I20260812 17:42:43.111238 19441 ts_manager.cc:194] Registered new tserver with Master: b6f7e867776242eebc5efc755d82af37 (127.17.255.2:35379)
I20260812 17:42:43.111845 19441 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.2@KRBTEST.COM'} at 127.17.255.2:46629
WARNING: no policy specified for kudu/127.17.255.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab.
Entry for principal kudu/127.17.255.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab.
I20260812 17:42:43.135433 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.3:0
--local_ip_for_outbound_sockets=127.17.255.3
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:40129
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:36023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:42:43.281682 20039 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:42:43.281998 20039 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:42:43.282050 20039 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:42:43.286878 20039 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:42:43.286953 20039 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:42:43.287021 20039 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.3
I20260812 17:42:43.293104 20039 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:36023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:40129
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20039
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.3
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:42:43.294407 20039 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:42:43.295538 20039 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:42:43.307283 20051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:42:43.307281 20055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:42:43.307278 20053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:42:43.307796 20039 server_base.cc:1034] running on GCE node
I20260812 17:42:43.308298 20039 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:42:43.309048 20039 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:42:43.310273 20039 hybrid_clock.cc:648] HybridClock initialized: now 1786556563310256 us; error 57 us; skew 500 ppm
Aug 12 17:42:43 dist-test-slave-tk9z krb5kdc[19359](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556563, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:42:43.313572 20039 init.cc:377] Logged in from keytab as kudu/127.17.255.3@KRBTEST.COM (short username kudu)
I20260812 17:42:43.314816 20039 webserver.cc:460] Webserver started at http://127.17.255.3:44061/ using document root <none> and password file <none>
I20260812 17:42:43.315487 20039 fs_manager.cc:359] Metadata directory not provided
I20260812 17:42:43.315557 20039 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:42:43.315754 20039 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:42:43.318228 20039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-2/data/instance:
uuid: "01e529e1ea19421aa348269cfcd9c3d1"
format_stamp: "Formatted at 2026-08-12 17:42:43 on dist-test-slave-tk9z"
server_key: "9ec53fca8100a99fd02a7aec0b3e077e"
server_key_iv: "eb3e80ae5add3609b8915097f051411d"
server_key_version: "encryptionkey@0"
I20260812 17:42:43.318967 20039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance:
uuid: "01e529e1ea19421aa348269cfcd9c3d1"
format_stamp: "Formatted at 2026-08-12 17:42:43 on dist-test-slave-tk9z"
server_key: "9ec53fca8100a99fd02a7aec0b3e077e"
server_key_iv: "eb3e80ae5add3609b8915097f051411d"
server_key_version: "encryptionkey@0"
I20260812 17:42:43.323348 20039 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 17:42:43.326210 20071 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:43.327862 20039 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 17:42:43.328063 20039 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-2/wal
uuid: "01e529e1ea19421aa348269cfcd9c3d1"
format_stamp: "Formatted at 2026-08-12 17:42:43 on dist-test-slave-tk9z"
server_key: "9ec53fca8100a99fd02a7aec0b3e077e"
server_key_iv: "eb3e80ae5add3609b8915097f051411d"
server_key_version: "encryptionkey@0"
I20260812 17:42:43.328213 20039 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:42:43.363240 20039 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:42:43.367444 20039 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:42:43.367815 20039 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:42:43.368616 20039 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:42:43.369727 20039 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:42:43.369784 20039 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:43.369833 20039 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:42:43.369851 20039 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:43.383051 20039 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.3:34733
I20260812 17:42:43.383147 20282 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.3:34733 every 8 connection(s)
I20260812 17:42:43.384306 20039 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
I20260812 17:42:43.385386 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 20039
I20260812 17:42:43.385525 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance
I20260812 17:42:43.385833 18428 external_mini_cluster.cc:1428] Setting key b4ef15e0ab2a83b5fa0050c621142d54
Aug 12 17:42:43 dist-test-slave-tk9z krb5kdc[19359](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556563, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:42:43.402463 19517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:43.386982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:55743 (local address 127.17.255.62:40129)
0812 17:42:43.387130 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:43.387135 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:43.388511 (+ 1376us) server_negotiation.cc:407] Connection header received
0812 17:42:43.390348 (+ 1837us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:43.390352 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:43.390449 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:43.390547 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:42:43.392036 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:43.392636 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:43.394002 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:43.394256 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:43.394387 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:43.397587 (+ 3200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:42:43.397590 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:42:43.397592 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:42:43.397622 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:42:43.399532 (+ 1910us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:43.400305 (+ 773us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:43.400310 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:43.400314 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:43.400446 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:43.401031 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:43.401036 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:43.401038 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:43.401320 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:42:43.401415 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:43.402151 (+ 736us) server_negotiation.cc:299] Negotiation successful
0812 17:42:43.402285 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 17:42:43.403529 20286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:43.387683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40129 (local address 127.17.255.3:55743)
0812 17:42:43.388328 (+ 645us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:43.388387 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:43.390056 (+ 1669us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:43.390775 (+ 719us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:43.390784 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:43.391250 (+ 466us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:42:43.391856 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:43.391873 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:43.392795 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:43.392798 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:43.393848 (+ 1050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:43.393860 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:43.394502 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:43.394507 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:43.394715 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:43.395532 (+ 817us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:42:43.395555 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:42:43.397360 (+ 1805us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:42:43.399675 (+ 2315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:43.399684 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:43.399707 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:43.400129 (+ 422us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:43.400598 (+ 469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:43.400601 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:43.400603 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:43.400846 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:43.401457 (+ 611us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:42:43.401464 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:42:43.401810 (+ 346us) client_negotiation.cc:769] Sending connection context
0812 17:42:43.402039 (+ 229us) client_negotiation.cc:240] Negotiation successful
0812 17:42:43.402515 (+ 476us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":167,"threads_started":1}
I20260812 17:42:43.405027 20283 heartbeater.cc:347] Connected to a master server at 127.17.255.62:40129
I20260812 17:42:43.405539 20283 heartbeater.cc:464] Registering TS with master...
I20260812 17:42:43.406206 20283 heartbeater.cc:511] Master 127.17.255.62:40129 requested a full tablet report, sending...
I20260812 17:42:43.407593 19441 ts_manager.cc:194] Registered new tserver with Master: 01e529e1ea19421aa348269cfcd9c3d1 (127.17.255.3:34733)
I20260812 17:42:43.408174 19441 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.3@KRBTEST.COM'} at 127.17.255.3:55743
I20260812 17:42:43.413705 18428 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 17:42:43.428074 19517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:43.418608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54604 (local address 127.17.255.62:40129)
0812 17:42:43.418757 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:43.418762 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:43.418911 (+ 149us) server_negotiation.cc:407] Connection header received
0812 17:42:43.419014 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:43.419017 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:43.419070 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:43.419159 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:42:43.420027 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:43.420579 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:43.421639 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:43.421898 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:43.422031 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:43.424193 (+ 2162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:42:43.424197 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:42:43.424199 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:42:43.424237 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:42:43.425796 (+ 1559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:43.426335 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:43.426338 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:43.426340 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:43.426538 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:43.426913 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:43.426917 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:43.426918 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:43.427282 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:42:43.427434 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:43.427764 (+ 330us) server_negotiation.cc:299] Negotiation successful
0812 17:42:43.427935 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 17:42:43.435361 19441 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54604:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 17:42:43.438771 19441 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 17:42:43.457357 20303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:43.450580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:43243 (local address 127.0.0.1:36068)
0812 17:42:43.451456 (+ 876us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:43.451827 (+ 371us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:43.451997 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:43.452554 (+ 557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:43.452559 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:43.452601 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:42:43.452819 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:43.452827 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:43.454003 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:43.454007 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:43.455311 (+ 1304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:43.455322 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:43.456679 (+ 1357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:43.456683 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:43.456805 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:43.456848 (+ 43us) client_negotiation.cc:769] Sending connection context
0812 17:42:43.456997 (+ 149us) client_negotiation.cc:240] Negotiation successful
0812 17:42:43.457171 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":759,"mutex_wait_us":7,"spinlock_wait_cycles":9344,"thread_start_us":86,"threads_started":1}
I20260812 17:42:43.457443 20309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:43.450776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36068 (local address 127.17.255.1:43243)
0812 17:42:43.451166 (+ 390us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:43.451176 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:43.451916 (+ 740us) server_negotiation.cc:407] Connection header received
0812 17:42:43.452153 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:43.452159 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:43.452331 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:43.452520 (+ 189us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:42:43.452972 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:43.453856 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:43.455443 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:43.456261 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:43.456398 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:43.456580 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:43.457100 (+ 520us) server_negotiation.cc:299] Negotiation successful
0812 17:42:43.457230 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281,"thread_start_us":88,"threads_started":1}
I20260812 17:42:43.458300 20304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:43.450477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:35379 (local address 127.0.0.1:43246)
0812 17:42:43.451454 (+ 977us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:43.451511 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:43.451694 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:43.452558 (+ 864us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:43.452561 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:43.452603 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:42:43.452821 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:43.452828 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:43.454649 (+ 1821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:43.454651 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:43.456218 (+ 1567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:43.456230 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:43.457891 (+ 1661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:43.457896 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:43.457997 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:43.458017 (+ 20us) client_negotiation.cc:769] Sending connection context
0812 17:42:43.458103 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 17:42:43.458182 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":780,"mutex_wait_us":275,"spinlock_wait_cycles":7936,"thread_start_us":112,"threads_started":1}
I20260812 17:42:43.459072 20305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:43.450680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43246 (local address 127.17.255.2:35379)
0812 17:42:43.451166 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:43.451178 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:43.451632 (+ 454us) server_negotiation.cc:407] Connection header received
0812 17:42:43.451947 (+ 315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:43.451953 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:43.452173 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:43.452304 (+ 131us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:42:43.453169 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:43.454443 (+ 1274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:43.456367 (+ 1924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:43.457306 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:43.457420 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:43.458801 (+ 1381us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:43.458852 (+ 51us) server_negotiation.cc:299] Negotiation successful
0812 17:42:43.458928 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":127,"threads_started":1}
I20260812 17:42:43.461001 20310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:43.451672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.3:34733 (local address 127.0.0.1:33138)
0812 17:42:43.452315 (+ 643us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:43.452328 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:43.452419 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:43.452966 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:43.452968 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:43.452985 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:42:43.453075 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:43.453081 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:43.454642 (+ 1561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:43.454645 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:43.456218 (+ 1573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:43.456230 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:43.460561 (+ 4331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:43.460565 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:43.460671 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:43.460695 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 17:42:43.460773 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 17:42:43.460859 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":573,"mutex_wait_us":193,"thread_start_us":115,"threads_started":1}
I20260812 17:42:43.461107 20311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:43.452002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33138 (local address 127.17.255.3:34733)
0812 17:42:43.452520 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:43.452533 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:43.452554 (+ 21us) server_negotiation.cc:407] Connection header received
0812 17:42:43.452627 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:43.452634 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:43.452840 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:43.452986 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:42:43.453205 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:43.454443 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:43.459319 (+ 4876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:43.460423 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:43.460560 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:43.460714 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:43.460841 (+ 127us) server_negotiation.cc:299] Negotiation successful
0812 17:42:43.460945 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":188,"threads_started":1}
I20260812 17:42:43.461519 19672 tablet_service.cc:1467] Processing CreateTablet for tablet effecf9f855e4811b7a34c72a653c152 (DEFAULT_TABLE table=test-table [id=103de1a90ab846fba9d4eb8458cda0ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:42:43.463073 19672 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet effecf9f855e4811b7a34c72a653c152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:42:43.462612 19915 tablet_service.cc:1467] Processing CreateTablet for tablet effecf9f855e4811b7a34c72a653c152 (DEFAULT_TABLE table=test-table [id=103de1a90ab846fba9d4eb8458cda0ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:42:43.463750 19915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet effecf9f855e4811b7a34c72a653c152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:42:43.469291 20157 tablet_service.cc:1467] Processing CreateTablet for tablet effecf9f855e4811b7a34c72a653c152 (DEFAULT_TABLE table=test-table [id=103de1a90ab846fba9d4eb8458cda0ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:42:43.470702 20157 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet effecf9f855e4811b7a34c72a653c152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:42:43.471660 20313 tablet_bootstrap.cc:492] T effecf9f855e4811b7a34c72a653c152 P b6f7e867776242eebc5efc755d82af37: Bootstrap starting.
I20260812 17:42:43.473282 20314 tablet_bootstrap.cc:492] T effecf9f855e4811b7a34c72a653c152 P 05302300e6ab46fcbee217a0010c1b1d: Bootstrap starting.
I20260812 17:42:43.475332 20313 tablet_bootstrap.cc:654] T effecf9f855e4811b7a34c72a653c152 P b6f7e867776242eebc5efc755d82af37: Neither blocks nor log segments found. Creating new log.
I20260812 17:42:43.475598 20314 tablet_bootstrap.cc:654] T effecf9f855e4811b7a34c72a653c152 P 05302300e6ab46fcbee217a0010c1b1d: Neither blocks nor log segments found. Creating new log.
I20260812 17:42:43.476588 20314 log.cc:824] T effecf9f855e4811b7a34c72a653c152 P 05302300e6ab46fcbee217a0010c1b1d: Log is configured to *not* fsync() on all Append() calls
I20260812 17:42:43.476737 20313 log.cc:824] T effecf9f855e4811b7a34c72a653c152 P b6f7e867776242eebc5efc755d82af37: Log is configured to *not* fsync() on all Append() calls
I20260812 17:42:43.478889 20313 tablet_bootstrap.cc:492] T effecf9f855e4811b7a34c72a653c152 P b6f7e867776242eebc5efc755d82af37: No bootstrap required, opened a new log
I20260812 17:42:43.478940 20314 tablet_bootstrap.cc:492] T effecf9f855e4811b7a34c72a653c152 P 05302300e6ab46fcbee217a0010c1b1d: No bootstrap required, opened a new log
I20260812 17:42:43.479135 20313 ts_tablet_manager.cc:1397] T effecf9f855e4811b7a34c72a653c152 P b6f7e867776242eebc5efc755d82af37: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260812 17:42:43.479137 20314 ts_tablet_manager.cc:1397] T effecf9f855e4811b7a34c72a653c152 P 05302300e6ab46fcbee217a0010c1b1d: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260812 17:42:43.480611 20317 tablet_bootstrap.cc:492] T effecf9f855e4811b7a34c72a653c152 P 01e529e1ea19421aa348269cfcd9c3d1: Bootstrap starting.
I20260812 17:42:43.483425 20317 tablet_bootstrap.cc:654] T effecf9f855e4811b7a34c72a653c152 P 01e529e1ea19421aa348269cfcd9c3d1: Neither blocks nor log segments found. Creating new log.
I20260812 17:42:43.483484 20314 raft_consensus.cc:348] T effecf9f855e4811b7a34c72a653c152 P 05302300e6ab46fcbee217a0010c1b1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f7e867776242eebc5efc755d82af37" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 35379 } } peers { permanent_uuid: "05302300e6ab46fcbee217a0010c1b1d" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 43243 } } peers { permanent_uuid: "01e529e1ea19421aa348269cfcd9c3d1" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 34733 } }
I20260812 17:42:43.483378 20313 raft_consensus.cc:348] T effecf9f855e4811b7a34c72a653c152 P b6f7e867776242eebc5efc755d82af37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f7e867776242eebc5efc755d82af37" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 35379 } } peers { permanent_uuid: "05302300e6ab46fcbee217a0010c1b1d" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 43243 } } peers { permanent_uuid: "01e529e1ea19421aa348269cfcd9c3d1" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 34733 } }
I20260812 17:42:43.483777 20314 raft_consensus.cc:374] T effecf9f855e4811b7a34c72a653c152 P 05302300e6ab46fcbee217a0010c1b1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:42:43.483788 20313 raft_consensus.cc:374] T effecf9f855e4811b7a34c72a653c152 P b6f7e867776242eebc5efc755d82af37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:42:43.483844 20313 raft_consensus.cc:729] T effecf9f855e4811b7a34c72a653c152 P b6f7e867776242eebc5efc755d82af37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f7e867776242eebc5efc755d82af37, State: Initialized, Role: FOLLOWER
I20260812 17:42:43.483843 20314 raft_consensus.cc:729] T effecf9f855e4811b7a34c72a653c152 P 05302300e6ab46fcbee217a0010c1b1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05302300e6ab46fcbee217a0010c1b1d, State: Initialized, Role: FOLLOWER
I20260812 17:42:43.484392 20314 consensus_queue.cc:260] T effecf9f855e4811b7a34c72a653c152 P 05302300e6ab46fcbee217a0010c1b1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f7e867776242eebc5efc755d82af37" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 35379 } } peers { permanent_uuid: "05302300e6ab46fcbee217a0010c1b1d" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 43243 } } peers { permanent_uuid: "01e529e1ea19421aa348269cfcd9c3d1" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 34733 } }
I20260812 17:42:43.484402 20313 consensus_queue.cc:260] T effecf9f855e4811b7a34c72a653c152 P b6f7e867776242eebc5efc755d82af37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f7e867776242eebc5efc755d82af37" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 35379 } } peers { permanent_uuid: "05302300e6ab46fcbee217a0010c1b1d" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 43243 } } peers { permanent_uuid: "01e529e1ea19421aa348269cfcd9c3d1" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 34733 } }
I20260812 17:42:43.485252 19785 heartbeater.cc:503] Master 127.17.255.62:40129 was elected leader, sending a full tablet report...
I20260812 17:42:43.485412 20317 log.cc:824] T effecf9f855e4811b7a34c72a653c152 P 01e529e1ea19421aa348269cfcd9c3d1: Log is configured to *not* fsync() on all Append() calls
I20260812 17:42:43.485608 20313 ts_tablet_manager.cc:1428] T effecf9f855e4811b7a34c72a653c152 P b6f7e867776242eebc5efc755d82af37: Time spent starting tablet: real 0.006s user 0.002s sys 0.004s
I20260812 17:42:43.485689 20028 heartbeater.cc:503] Master 127.17.255.62:40129 was elected leader, sending a full tablet report...
I20260812 17:42:43.487105 20314 ts_tablet_manager.cc:1428] T effecf9f855e4811b7a34c72a653c152 P 05302300e6ab46fcbee217a0010c1b1d: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260812 17:42:43.488472 20317 tablet_bootstrap.cc:492] T effecf9f855e4811b7a34c72a653c152 P 01e529e1ea19421aa348269cfcd9c3d1: No bootstrap required, opened a new log
I20260812 17:42:43.488773 20317 ts_tablet_manager.cc:1397] T effecf9f855e4811b7a34c72a653c152 P 01e529e1ea19421aa348269cfcd9c3d1: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260812 17:42:43.493422 20317 raft_consensus.cc:348] T effecf9f855e4811b7a34c72a653c152 P 01e529e1ea19421aa348269cfcd9c3d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f7e867776242eebc5efc755d82af37" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 35379 } } peers { permanent_uuid: "05302300e6ab46fcbee217a0010c1b1d" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 43243 } } peers { permanent_uuid: "01e529e1ea19421aa348269cfcd9c3d1" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 34733 } }
I20260812 17:42:43.493731 20317 raft_consensus.cc:374] T effecf9f855e4811b7a34c72a653c152 P 01e529e1ea19421aa348269cfcd9c3d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:42:43.493830 20317 raft_consensus.cc:729] T effecf9f855e4811b7a34c72a653c152 P 01e529e1ea19421aa348269cfcd9c3d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01e529e1ea19421aa348269cfcd9c3d1, State: Initialized, Role: FOLLOWER
I20260812 17:42:43.494364 20317 consensus_queue.cc:260] T effecf9f855e4811b7a34c72a653c152 P 01e529e1ea19421aa348269cfcd9c3d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f7e867776242eebc5efc755d82af37" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 35379 } } peers { permanent_uuid: "05302300e6ab46fcbee217a0010c1b1d" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 43243 } } peers { permanent_uuid: "01e529e1ea19421aa348269cfcd9c3d1" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 34733 } }
I20260812 17:42:43.495234 20283 heartbeater.cc:503] Master 127.17.255.62:40129 was elected leader, sending a full tablet report...
I20260812 17:42:43.495666 20317 ts_tablet_manager.cc:1428] T effecf9f855e4811b7a34c72a653c152 P 01e529e1ea19421aa348269cfcd9c3d1: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260812 17:42:43.551080 20318 raft_consensus.cc:482] T effecf9f855e4811b7a34c72a653c152 P 05302300e6ab46fcbee217a0010c1b1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:42:43.551368 20318 raft_consensus.cc:504] T effecf9f855e4811b7a34c72a653c152 P 05302300e6ab46fcbee217a0010c1b1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f7e867776242eebc5efc755d82af37" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 35379 } } peers { permanent_uuid: "05302300e6ab46fcbee217a0010c1b1d" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 43243 } } peers { permanent_uuid: "01e529e1ea19421aa348269cfcd9c3d1" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 34733 } }
I20260812 17:42:43.552977 20318 leader_election.cc:288] T effecf9f855e4811b7a34c72a653c152 P 05302300e6ab46fcbee217a0010c1b1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6f7e867776242eebc5efc755d82af37 (127.17.255.2:35379), 01e529e1ea19421aa348269cfcd9c3d1 (127.17.255.3:34733)
I20260812 17:42:43.562599 20311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:43.553522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:38029 (local address 127.17.255.3:34733)
0812 17:42:43.553662 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:43.553667 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:43.553912 (+ 245us) server_negotiation.cc:407] Connection header received
0812 17:42:43.554090 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:43.554093 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:43.554146 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:43.554245 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:42:43.557419 (+ 3174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:43.558268 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:43.561128 (+ 2860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:43.561616 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:43.561796 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:43.561864 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:43.562238 (+ 374us) server_negotiation.cc:299] Negotiation successful
0812 17:42:43.562363 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 17:42:43.562673 20331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:43.553338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.3:34733 (local address 127.17.255.1:38029)
0812 17:42:43.553812 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:43.553824 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:43.553968 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:43.554265 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:43.554268 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:43.554287 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:42:43.554473 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:43.554501 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:43.559962 (+ 5461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:43.559967 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:43.560949 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:43.560962 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:43.561941 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:43.561945 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:43.562064 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:43.562093 (+ 29us) client_negotiation.cc:769] Sending connection context
0812 17:42:43.562196 (+ 103us) client_negotiation.cc:240] Negotiation successful
0812 17:42:43.562306 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":132,"threads_started":1}
I20260812 17:42:43.563376 20305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:43.554606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:45537 (local address 127.17.255.2:35379)
0812 17:42:43.557437 (+ 2831us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:43.557442 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:43.557459 (+ 17us) server_negotiation.cc:407] Connection header received
0812 17:42:43.557521 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:43.557524 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:43.557591 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:43.557709 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:42:43.558305 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:43.559427 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:43.561717 (+ 2290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:43.562494 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:43.562654 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:43.562727 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:43.563145 (+ 418us) server_negotiation.cc:299] Negotiation successful
0812 17:42:43.563246 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2694}
I20260812 17:42:43.563851 20332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:43.553400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:35379 (local address 127.17.255.1:45537)
0812 17:42:43.554076 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:43.554094 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:43.554214 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:43.557769 (+ 3555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:43.557776 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:43.557817 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:42:43.558099 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:43.558115 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:43.559699 (+ 1584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:43.559705 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:43.561535 (+ 1830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:43.561552 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:43.562815 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:43.562820 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:43.562950 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:43.562985 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 17:42:43.563559 (+ 574us) client_negotiation.cc:240] Negotiation successful
0812 17:42:43.563695 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":600,"thread_start_us":228,"threads_started":1}
I20260812 17:42:43.564077 20194 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "effecf9f855e4811b7a34c72a653c152" candidate_uuid: "05302300e6ab46fcbee217a0010c1b1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01e529e1ea19421aa348269cfcd9c3d1" is_pre_election: true
I20260812 17:42:43.564677 20194 raft_consensus.cc:2454] T effecf9f855e4811b7a34c72a653c152 P 01e529e1ea19421aa348269cfcd9c3d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05302300e6ab46fcbee217a0010c1b1d in term 0.
I20260812 17:42:43.564733 19955 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "effecf9f855e4811b7a34c72a653c152" candidate_uuid: "05302300e6ab46fcbee217a0010c1b1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f7e867776242eebc5efc755d82af37" is_pre_election: true
I20260812 17:42:43.565114 19955 raft_consensus.cc:2454] T effecf9f855e4811b7a34c72a653c152 P b6f7e867776242eebc5efc755d82af37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05302300e6ab46fcbee217a0010c1b1d in term 0.
I20260812 17:42:43.565480 19592 leader_election.cc:302] T effecf9f855e4811b7a34c72a653c152 P 05302300e6ab46fcbee217a0010c1b1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01e529e1ea19421aa348269cfcd9c3d1, 05302300e6ab46fcbee217a0010c1b1d; no voters:
I20260812 17:42:43.565883 20318 raft_consensus.cc:2781] T effecf9f855e4811b7a34c72a653c152 P 05302300e6ab46fcbee217a0010c1b1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 17:42:43.565980 20318 raft_consensus.cc:482] T effecf9f855e4811b7a34c72a653c152 P 05302300e6ab46fcbee217a0010c1b1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 17:42:43.566043 20318 raft_consensus.cc:3037] T effecf9f855e4811b7a34c72a653c152 P 05302300e6ab46fcbee217a0010c1b1d [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:42:43.567878 20318 raft_consensus.cc:504] T effecf9f855e4811b7a34c72a653c152 P 05302300e6ab46fcbee217a0010c1b1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f7e867776242eebc5efc755d82af37" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 35379 } } peers { permanent_uuid: "05302300e6ab46fcbee217a0010c1b1d" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 43243 } } peers { permanent_uuid: "01e529e1ea19421aa348269cfcd9c3d1" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 34733 } }
I20260812 17:42:43.568351 20318 leader_election.cc:288] T effecf9f855e4811b7a34c72a653c152 P 05302300e6ab46fcbee217a0010c1b1d [CANDIDATE]: Term 1 election: Requested vote from peers b6f7e867776242eebc5efc755d82af37 (127.17.255.2:35379), 01e529e1ea19421aa348269cfcd9c3d1 (127.17.255.3:34733)
I20260812 17:42:43.568885 19955 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "effecf9f855e4811b7a34c72a653c152" candidate_uuid: "05302300e6ab46fcbee217a0010c1b1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f7e867776242eebc5efc755d82af37"
I20260812 17:42:43.568966 20194 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "effecf9f855e4811b7a34c72a653c152" candidate_uuid: "05302300e6ab46fcbee217a0010c1b1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01e529e1ea19421aa348269cfcd9c3d1"
I20260812 17:42:43.569031 19955 raft_consensus.cc:3037] T effecf9f855e4811b7a34c72a653c152 P b6f7e867776242eebc5efc755d82af37 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:42:43.569196 20194 raft_consensus.cc:3037] T effecf9f855e4811b7a34c72a653c152 P 01e529e1ea19421aa348269cfcd9c3d1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:42:43.570308 19955 raft_consensus.cc:2454] T effecf9f855e4811b7a34c72a653c152 P b6f7e867776242eebc5efc755d82af37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05302300e6ab46fcbee217a0010c1b1d in term 1.
I20260812 17:42:43.570590 20194 raft_consensus.cc:2454] T effecf9f855e4811b7a34c72a653c152 P 01e529e1ea19421aa348269cfcd9c3d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05302300e6ab46fcbee217a0010c1b1d in term 1.
I20260812 17:42:43.570791 19588 leader_election.cc:302] T effecf9f855e4811b7a34c72a653c152 P 05302300e6ab46fcbee217a0010c1b1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05302300e6ab46fcbee217a0010c1b1d, b6f7e867776242eebc5efc755d82af37; no voters:
I20260812 17:42:43.571049 20318 raft_consensus.cc:2781] T effecf9f855e4811b7a34c72a653c152 P 05302300e6ab46fcbee217a0010c1b1d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:42:43.571310 20318 raft_consensus.cc:686] T effecf9f855e4811b7a34c72a653c152 P 05302300e6ab46fcbee217a0010c1b1d [term 1 LEADER]: Becoming Leader. State: Replica: 05302300e6ab46fcbee217a0010c1b1d, State: Running, Role: LEADER
I20260812 17:42:43.571686 20318 consensus_queue.cc:237] T effecf9f855e4811b7a34c72a653c152 P 05302300e6ab46fcbee217a0010c1b1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f7e867776242eebc5efc755d82af37" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 35379 } } peers { permanent_uuid: "05302300e6ab46fcbee217a0010c1b1d" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 43243 } } peers { permanent_uuid: "01e529e1ea19421aa348269cfcd9c3d1" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 34733 } }
I20260812 17:42:43.575954 19441 catalog_manager.cc:5495] T effecf9f855e4811b7a34c72a653c152 P 05302300e6ab46fcbee217a0010c1b1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 05302300e6ab46fcbee217a0010c1b1d (127.17.255.1). New cstate: current_term: 1 leader_uuid: "05302300e6ab46fcbee217a0010c1b1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f7e867776242eebc5efc755d82af37" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 35379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05302300e6ab46fcbee217a0010c1b1d" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 43243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01e529e1ea19421aa348269cfcd9c3d1" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 34733 } health_report { overall_health: UNKNOWN } } }
W20260812 17:42:43.583673 19786 tablet.cc:2369] T effecf9f855e4811b7a34c72a653c152 P 05302300e6ab46fcbee217a0010c1b1d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 17:42:43.592840 20031 tablet.cc:2369] T effecf9f855e4811b7a34c72a653c152 P b6f7e867776242eebc5efc755d82af37: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 12 17:42:43 dist-test-slave-tk9z krb5kdc[19359](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556562, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.255.1@KRBTEST.COM
I20260812 17:42:43.620362 20309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:43.609709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36076 (local address 127.17.255.1:43243)
0812 17:42:43.609922 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:43.609926 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:43.610086 (+ 160us) server_negotiation.cc:407] Connection header received
0812 17:42:43.610179 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:43.610182 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:43.610245 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:43.610342 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:42:43.611232 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:43.611781 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:43.612749 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:43.613014 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:43.613112 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:43.616148 (+ 3036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:42:43.616164 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:42:43.616184 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:42:43.616216 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:42:43.618459 (+ 2243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:43.618928 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:43.618934 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:43.618936 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:43.619031 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:43.619279 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:43.619282 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:43.619283 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:43.619597 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:42:43.619788 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:43.619927 (+ 139us) server_negotiation.cc:299] Negotiation successful
0812 17:42:43.620039 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
W20260812 17:42:43.635771 20285 tablet.cc:2369] T effecf9f855e4811b7a34c72a653c152 P 01e529e1ea19421aa348269cfcd9c3d1: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 12 17:42:43 dist-test-slave-tk9z krb5kdc[19359](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556563, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 17:42:43 dist-test-slave-tk9z krb5kdc[19359](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556563, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.255.1@KRBTEST.COM
I20260812 17:42:43.653523 20309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:43.643817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36090 (local address 127.17.255.1:43243)
0812 17:42:43.644038 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:43.644042 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:43.644120 (+ 78us) server_negotiation.cc:407] Connection header received
0812 17:42:43.644261 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:43.644264 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:43.644311 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:43.644392 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:42:43.645184 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:43.645723 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:43.646699 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:43.646976 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:43.647087 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:43.649921 (+ 2834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:42:43.649925 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:42:43.649927 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:42:43.649958 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:42:43.651624 (+ 1666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:43.652106 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:43.652108 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:43.652110 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:43.652200 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:43.652558 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:43.652561 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:43.652563 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:43.652764 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:42:43.652902 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:43.653241 (+ 339us) server_negotiation.cc:299] Negotiation successful
0812 17:42:43.653363 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
Aug 12 17:42:43 dist-test-slave-tk9z krb5kdc[19359](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556563, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 17:42:43 dist-test-slave-tk9z krb5kdc[19359](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556563, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.255.1@KRBTEST.COM
I20260812 17:42:43.684705 20309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:43.675372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36102 (local address 127.17.255.1:43243)
0812 17:42:43.675702 (+ 330us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:43.675708 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:43.675903 (+ 195us) server_negotiation.cc:407] Connection header received
0812 17:42:43.676106 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:43.676109 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:43.676154 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:43.676248 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:42:43.677042 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:43.677561 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:43.678515 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:43.678736 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:43.678864 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:43.681374 (+ 2510us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:42:43.681380 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:42:43.681383 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:42:43.681420 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:42:43.682898 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:43.683384 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:43.683390 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:43.683396 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:43.683476 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:43.683766 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:43.683770 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:43.683772 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:43.683970 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:42:43.684141 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:43.684390 (+ 249us) server_negotiation.cc:299] Negotiation successful
0812 17:42:43.684520 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112}
W20260812 17:42:43.686432 19639 tablet_service.cc:2908] Rejecting scan request for tablet effecf9f855e4811b7a34c72a653c152: Uninitialized: clean time has not yet been initialized
I20260812 17:42:43.688980 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 19562
I20260812 17:42:43.706802 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 19793
I20260812 17:42:43.720399 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 20039
I20260812 17:42:43.735379 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 19384
2026-08-12T17:42:43Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2879 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:42:43 dist-test-slave-tk9z krb5kdc[20360](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:42:43 dist-test-slave-tk9z krb5kdc[20360](info): set up 2 sockets
Aug 12 17:42:43 dist-test-slave-tk9z krb5kdc[20360](info): commencing operation
krb5kdc: starting...
W20260812 17:42:45.048578 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.282s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:42:45 dist-test-slave-tk9z krb5kdc[20360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:42:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:42:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.255.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
I20260812 17:42:45.189491 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:39007
--webserver_interface=127.17.255.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:37507
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:39007
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:42:45.317847 20389 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:42:45.318181 20389 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:42:45.318224 20389 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:42:45.322559 20389 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:42:45.322636 20389 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 17:42:45.322654 20389 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:42:45.322675 20389 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:42:45.322691 20389 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:42:45.322733 20389 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:42:45.328724 20389 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:37507
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:39007
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:39007
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20389
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:42:45.330072 20389 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:42:45.331305 20389 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:42:45.341913 20395 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:42:45.341907 20396 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:42:45.342008 20389 server_base.cc:1034] running on GCE node
W20260812 17:42:45.341909 20401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:42:45.343077 20389 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:42:45.344308 20389 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:42:45.345662 20389 hybrid_clock.cc:648] HybridClock initialized: now 1786556565345536 us; error 132 us; skew 500 ppm
Aug 12 17:42:45 dist-test-slave-tk9z krb5kdc[20360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556565, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:42:45.349371 20389 init.cc:377] Logged in from keytab as kudu/127.17.255.62@KRBTEST.COM (short username kudu)
I20260812 17:42:45.350595 20389 webserver.cc:460] Webserver started at http://127.17.255.62:39231/ using document root <none> and password file <none>
I20260812 17:42:45.351281 20389 fs_manager.cc:359] Metadata directory not provided
I20260812 17:42:45.351365 20389 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:42:45.351626 20389 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:42:45.354070 20389 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "9152398953ab47c6b332e0e97a99728b"
format_stamp: "Formatted at 2026-08-12 17:42:45 on dist-test-slave-tk9z"
server_key: "2d95eeeaa897c3347d66b98579140217"
server_key_iv: "ce2d680916f892f7660e30b6f6bd2765"
server_key_version: "encryptionkey@0"
I20260812 17:42:45.354842 20389 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "9152398953ab47c6b332e0e97a99728b"
format_stamp: "Formatted at 2026-08-12 17:42:45 on dist-test-slave-tk9z"
server_key: "2d95eeeaa897c3347d66b98579140217"
server_key_iv: "ce2d680916f892f7660e30b6f6bd2765"
server_key_version: "encryptionkey@0"
I20260812 17:42:45.359328 20389 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 17:42:45.362180 20415 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:45.363690 20389 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 17:42:45.363821 20389 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "9152398953ab47c6b332e0e97a99728b"
format_stamp: "Formatted at 2026-08-12 17:42:45 on dist-test-slave-tk9z"
server_key: "2d95eeeaa897c3347d66b98579140217"
server_key_iv: "ce2d680916f892f7660e30b6f6bd2765"
server_key_version: "encryptionkey@0"
I20260812 17:42:45.364002 20389 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:42:45.384166 20389 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:42:45.388438 20389 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:42:45.388692 20389 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:42:45.398741 20389 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:39007
I20260812 17:42:45.398806 20531 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:39007 every 8 connection(s)
I20260812 17:42:45.399892 20389 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:42:45.403254 20532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:42:45.408257 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 20389
I20260812 17:42:45.408401 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:42:45.408694 18428 external_mini_cluster.cc:1428] Setting key 07bfc4c082bde91e574c93af533e283d
I20260812 17:42:45.410205 20532 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9152398953ab47c6b332e0e97a99728b: Bootstrap starting.
I20260812 17:42:45.413017 20532 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9152398953ab47c6b332e0e97a99728b: Neither blocks nor log segments found. Creating new log.
I20260812 17:42:45.413955 20532 log.cc:824] T 00000000000000000000000000000000 P 9152398953ab47c6b332e0e97a99728b: Log is configured to *not* fsync() on all Append() calls
I20260812 17:42:45.416275 20532 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9152398953ab47c6b332e0e97a99728b: No bootstrap required, opened a new log
Aug 12 17:42:45 dist-test-slave-tk9z krb5kdc[20360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:42:45.421039 20532 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9152398953ab47c6b332e0e97a99728b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9152398953ab47c6b332e0e97a99728b" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 39007 } }
I20260812 17:42:45.421350 20532 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9152398953ab47c6b332e0e97a99728b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:42:45.421445 20532 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9152398953ab47c6b332e0e97a99728b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9152398953ab47c6b332e0e97a99728b, State: Initialized, Role: FOLLOWER
I20260812 17:42:45.422091 20532 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9152398953ab47c6b332e0e97a99728b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9152398953ab47c6b332e0e97a99728b" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 39007 } }
I20260812 17:42:45.422312 20542 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9152398953ab47c6b332e0e97a99728b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:42:45.422521 20542 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9152398953ab47c6b332e0e97a99728b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9152398953ab47c6b332e0e97a99728b" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 39007 } }
I20260812 17:42:45.422277 20532 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9152398953ab47c6b332e0e97a99728b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:42:45.422999 20542 leader_election.cc:302] T 00000000000000000000000000000000 P 9152398953ab47c6b332e0e97a99728b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9152398953ab47c6b332e0e97a99728b; no voters:
I20260812 17:42:45.423070 20532 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9152398953ab47c6b332e0e97a99728b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:42:45.423244 20532 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9152398953ab47c6b332e0e97a99728b [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:42:45.423450 20542 leader_election.cc:288] T 00000000000000000000000000000000 P 9152398953ab47c6b332e0e97a99728b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers
I20260812 17:42:45.424746 20532 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9152398953ab47c6b332e0e97a99728b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9152398953ab47c6b332e0e97a99728b" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 39007 } }
I20260812 17:42:45.424925 20532 leader_election.cc:302] T 00000000000000000000000000000000 P 9152398953ab47c6b332e0e97a99728b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9152398953ab47c6b332e0e97a99728b; no voters:
I20260812 17:42:45.425037 20532 leader_election.cc:288] T 00000000000000000000000000000000 P 9152398953ab47c6b332e0e97a99728b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:42:45.425153 20543 raft_consensus.cc:2741] T 00000000000000000000000000000000 P 9152398953ab47c6b332e0e97a99728b [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260812 17:42:45.426017 20542 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9152398953ab47c6b332e0e97a99728b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:42:45.426149 20542 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9152398953ab47c6b332e0e97a99728b [term 1 LEADER]: Becoming Leader. State: Replica: 9152398953ab47c6b332e0e97a99728b, State: Running, Role: LEADER
I20260812 17:42:45.426513 20536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:45.410443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39178 (local address 127.17.255.62:39007)
0812 17:42:45.411022 (+ 579us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:45.411039 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:45.411081 (+ 42us) server_negotiation.cc:407] Connection header received
0812 17:42:45.412203 (+ 1122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:45.412240 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:45.412648 (+ 408us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:45.413051 (+ 403us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:42:45.413985 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:45.415224 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:45.416141 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:45.416710 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:45.416909 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:45.419580 (+ 2671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:42:45.419586 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:42:45.419603 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:42:45.419634 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:42:45.422204 (+ 2570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:45.423064 (+ 860us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:45.423072 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:45.423081 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:45.423269 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:45.423737 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:45.423741 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:45.423743 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:45.424356 (+ 613us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:42:45.424597 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:45.424940 (+ 343us) server_negotiation.cc:299] Negotiation successful
0812 17:42:45.425331 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":168,"threads_started":1}
I20260812 17:42:45.426539 20532 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9152398953ab47c6b332e0e97a99728b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:42:45.426568 20542 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9152398953ab47c6b332e0e97a99728b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9152398953ab47c6b332e0e97a99728b" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 39007 } }
I20260812 17:42:45.428129 20542 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9152398953ab47c6b332e0e97a99728b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9152398953ab47c6b332e0e97a99728b. Latest consensus state: current_term: 1 leader_uuid: "9152398953ab47c6b332e0e97a99728b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9152398953ab47c6b332e0e97a99728b" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 39007 } } }
I20260812 17:42:45.428298 20542 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9152398953ab47c6b332e0e97a99728b [sys.catalog]: This master's current role is: LEADER
I20260812 17:42:45.428298 20544 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9152398953ab47c6b332e0e97a99728b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9152398953ab47c6b332e0e97a99728b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9152398953ab47c6b332e0e97a99728b" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 39007 } } }
I20260812 17:42:45.428547 20544 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9152398953ab47c6b332e0e97a99728b [sys.catalog]: This master's current role is: LEADER
W20260812 17:42:45.432178 20574 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9152398953ab47c6b332e0e97a99728b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 17:42:45.432264 20574 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 17:42:45.432355 20567 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:42:45.433319 20567 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:42:45.440819 20567 catalog_manager.cc:1347] Generated new cluster ID: a832630593ee4089adbd565096c55968
I20260812 17:42:45.440960 20567 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:42:45.466486 20567 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:42:45.468005 20567 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:42:45.478317 20567 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9152398953ab47c6b332e0e97a99728b: Generated new TSK 0
I20260812 17:42:45.479351 20567 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.255.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab.
Entry for principal kudu/127.17.255.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab.
I20260812 17:42:45.521592 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.1:0
--local_ip_for_outbound_sockets=127.17.255.1
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:39007
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:37507
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:42:45.646484 20584 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:42:45.646806 20584 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:42:45.646857 20584 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:42:45.651175 20584 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:42:45.651249 20584 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:42:45.651295 20584 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 17:42:45.651330 20584 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.1
I20260812 17:42:45.657413 20584 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:37507
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.255.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.255.62:39007
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20584
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.1
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:42:45.658846 20584 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:42:45.659924 20584 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 17:42:45.670416 20584 server_base.cc:1034] running on GCE node
W20260812 17:42:45.670325 20593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:42:45.670305 20590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:42:45.670293 20591 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:42:45.671093 20584 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:42:45.671795 20584 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:42:45.673023 20584 hybrid_clock.cc:648] HybridClock initialized: now 1786556565673003 us; error 30 us; skew 500 ppm
Aug 12 17:42:45 dist-test-slave-tk9z krb5kdc[20360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556565, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:42:45.676608 20584 init.cc:377] Logged in from keytab as kudu/127.17.255.1@KRBTEST.COM (short username kudu)
I20260812 17:42:45.677773 20584 webserver.cc:460] Webserver started at http://127.17.255.1:37043/ using document root <none> and password file <none>
I20260812 17:42:45.678515 20584 fs_manager.cc:359] Metadata directory not provided
I20260812 17:42:45.678628 20584 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:42:45.678936 20584 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:42:45.681352 20584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-0/data/instance:
uuid: "999f555d85d24dbfafce7efa54da39e8"
format_stamp: "Formatted at 2026-08-12 17:42:45 on dist-test-slave-tk9z"
server_key: "d09ae3124181a2822c492621294bd5ab"
server_key_iv: "72965f593ff7ab9b3a342ed9122359f8"
server_key_version: "encryptionkey@0"
I20260812 17:42:45.682024 20584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance:
uuid: "999f555d85d24dbfafce7efa54da39e8"
format_stamp: "Formatted at 2026-08-12 17:42:45 on dist-test-slave-tk9z"
server_key: "d09ae3124181a2822c492621294bd5ab"
server_key_iv: "72965f593ff7ab9b3a342ed9122359f8"
server_key_version: "encryptionkey@0"
I20260812 17:42:45.686328 20584 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260812 17:42:45.689188 20607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:45.690662 20584 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:42:45.690820 20584 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-0/wal
uuid: "999f555d85d24dbfafce7efa54da39e8"
format_stamp: "Formatted at 2026-08-12 17:42:45 on dist-test-slave-tk9z"
server_key: "d09ae3124181a2822c492621294bd5ab"
server_key_iv: "72965f593ff7ab9b3a342ed9122359f8"
server_key_version: "encryptionkey@0"
I20260812 17:42:45.690956 20584 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:42:45.714991 20584 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:42:45.718844 20584 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:42:45.719103 20584 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:42:45.721299 20584 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:42:45.721371 20584 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:45.721441 20584 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:42:45.721472 20584 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 17:42:45 dist-test-slave-tk9z krb5kdc[20360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556565, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:42:45.734977 20584 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.1:36463
I20260812 17:42:45.735047 20811 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.1:36463 every 8 connection(s)
I20260812 17:42:45.736218 20584 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
I20260812 17:42:45.737820 20536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:45.722151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:41961 (local address 127.17.255.62:39007)
0812 17:42:45.722316 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:45.722321 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:45.724105 (+ 1784us) server_negotiation.cc:407] Connection header received
0812 17:42:45.725325 (+ 1220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:45.725329 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:45.725418 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:45.725477 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:42:45.727134 (+ 1657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:45.727851 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:45.729435 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:45.729812 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:45.729928 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:45.733262 (+ 3334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:42:45.733266 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:42:45.733269 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:42:45.733302 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:42:45.735010 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:45.735621 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:45.735625 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:45.735627 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:45.735735 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:45.736213 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:45.736217 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:45.736219 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:45.736487 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:42:45.736614 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:45.737561 (+ 947us) server_negotiation.cc:299] Negotiation successful
0812 17:42:45.737684 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 17:42:45.738782 20621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:45.723408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:39007 (local address 127.17.255.1:41961)
0812 17:42:45.723934 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:45.723996 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:45.725050 (+ 1054us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:45.725826 (+ 776us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:45.725832 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:45.726245 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:42:45.726959 (+ 714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:45.726983 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:45.727994 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:45.727999 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:45.729292 (+ 1293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:45.729302 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:45.729984 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:45.729988 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:45.730168 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:45.730940 (+ 772us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:42:45.730964 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:42:45.733050 (+ 2086us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:42:45.735156 (+ 2106us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:45.735162 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:45.735179 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:45.735478 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:45.735893 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:45.735897 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:45.735898 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:45.736076 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:45.736667 (+ 591us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:42:45.736674 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:42:45.737052 (+ 378us) client_negotiation.cc:769] Sending connection context
0812 17:42:45.737330 (+ 278us) client_negotiation.cc:240] Negotiation successful
0812 17:42:45.737655 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":147,"threads_started":1}
I20260812 17:42:45.740168 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 20584
I20260812 17:42:45.740316 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance
I20260812 17:42:45.740473 20812 heartbeater.cc:347] Connected to a master server at 127.17.255.62:39007
I20260812 17:42:45.740665 20812 heartbeater.cc:464] Registering TS with master...
I20260812 17:42:45.740728 18428 external_mini_cluster.cc:1428] Setting key fab0c9386bab88a806630c0b0361ff81
I20260812 17:42:45.741416 20812 heartbeater.cc:511] Master 127.17.255.62:39007 requested a full tablet report, sending...
I20260812 17:42:45.743548 20446 ts_manager.cc:194] Registered new tserver with Master: 999f555d85d24dbfafce7efa54da39e8 (127.17.255.1:36463)
I20260812 17:42:45.745018 20446 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.1@KRBTEST.COM'} at 127.17.255.1:41961
I20260812 17:42:45.752950 20536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:45.743209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:34911 (local address 127.17.255.62:39007)
0812 17:42:45.743335 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:45.743339 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:45.743610 (+ 271us) server_negotiation.cc:407] Connection header received
0812 17:42:45.743786 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:45.743790 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:45.743838 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:45.743921 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:42:45.744505 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:45.745080 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:45.746455 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:45.746913 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:45.747015 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:45.748922 (+ 1907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:42:45.748926 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:42:45.748929 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:42:45.748963 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:42:45.750787 (+ 1824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:45.751314 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:45.751321 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:45.751326 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:45.751453 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:45.751794 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:45.751798 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:45.751800 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:45.752073 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:42:45.752167 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:45.752664 (+ 497us) server_negotiation.cc:299] Negotiation successful
0812 17:42:45.752805 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 17:42:45.753115 20824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:45.743099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:39007 (local address 127.17.255.1:34911)
0812 17:42:45.743493 (+ 394us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:45.743510 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:45.743630 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:45.743970 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:45.743973 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:45.744227 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:42:45.744369 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:45.744377 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:45.745329 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:45.745333 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:45.746250 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:45.746268 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:45.747216 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:45.747222 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:45.747363 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:45.748100 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:42:45.748114 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:42:45.748737 (+ 623us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:42:45.750923 (+ 2186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:45.750928 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:45.750930 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:45.751154 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:45.751584 (+ 430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:45.751587 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:45.751588 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:45.751683 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:45.752213 (+ 530us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:42:45.752219 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:42:45.752369 (+ 150us) client_negotiation.cc:769] Sending connection context
0812 17:42:45.752544 (+ 175us) client_negotiation.cc:240] Negotiation successful
0812 17:42:45.752763 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":139,"threads_started":1}
WARNING: no policy specified for kudu/127.17.255.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab.
Entry for principal kudu/127.17.255.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab.
I20260812 17:42:45.777637 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.2:0
--local_ip_for_outbound_sockets=127.17.255.2
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:39007
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:37507
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:42:45.900413 20830 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:42:45.900679 20830 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:42:45.900727 20830 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:42:45.904853 20830 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:42:45.904912 20830 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:42:45.904951 20830 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 17:42:45.904983 20830 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.2
I20260812 17:42:45.910277 20830 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:37507
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.255.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.255.62:39007
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20830
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.2
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:42:45.911373 20830 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:42:45.912382 20830 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:42:45.922386 20837 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:42:45.922472 20830 server_base.cc:1034] running on GCE node
W20260812 17:42:45.922480 20840 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:42:45.922621 20838 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:42:45.923130 20830 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:42:45.923946 20830 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:42:45.925220 20830 hybrid_clock.cc:648] HybridClock initialized: now 1786556565925190 us; error 35 us; skew 500 ppm
Aug 12 17:42:45 dist-test-slave-tk9z krb5kdc[20360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556565, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:42:45.928751 20830 init.cc:377] Logged in from keytab as kudu/127.17.255.2@KRBTEST.COM (short username kudu)
I20260812 17:42:45.929957 20830 webserver.cc:460] Webserver started at http://127.17.255.2:35791/ using document root <none> and password file <none>
I20260812 17:42:45.930691 20830 fs_manager.cc:359] Metadata directory not provided
I20260812 17:42:45.930791 20830 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:42:45.931059 20830 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:42:45.933501 20830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-1/data/instance:
uuid: "a3814529c7a6441b8170b45625b5211c"
format_stamp: "Formatted at 2026-08-12 17:42:45 on dist-test-slave-tk9z"
server_key: "b6ad01fbe983db10742655e42200b14d"
server_key_iv: "20e222a2dbcadb2da65dca91a4ad1e6d"
server_key_version: "encryptionkey@0"
I20260812 17:42:45.934227 20830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance:
uuid: "a3814529c7a6441b8170b45625b5211c"
format_stamp: "Formatted at 2026-08-12 17:42:45 on dist-test-slave-tk9z"
server_key: "b6ad01fbe983db10742655e42200b14d"
server_key_iv: "20e222a2dbcadb2da65dca91a4ad1e6d"
server_key_version: "encryptionkey@0"
I20260812 17:42:45.938668 20830 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 17:42:45.941633 20851 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:45.943071 20830 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:42:45.943239 20830 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-1/wal
uuid: "a3814529c7a6441b8170b45625b5211c"
format_stamp: "Formatted at 2026-08-12 17:42:45 on dist-test-slave-tk9z"
server_key: "b6ad01fbe983db10742655e42200b14d"
server_key_iv: "20e222a2dbcadb2da65dca91a4ad1e6d"
server_key_version: "encryptionkey@0"
I20260812 17:42:45.943372 20830 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:42:45.961403 20830 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:42:45.965126 20830 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:42:45.965411 20830 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:42:45.967198 20830 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:42:45.967250 20830 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:45.967303 20830 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:42:45.967356 20830 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 17:42:45 dist-test-slave-tk9z krb5kdc[20360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556565, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:42:45.979127 20830 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.2:34425
I20260812 17:42:45.979235 21036 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.2:34425 every 8 connection(s)
I20260812 17:42:45.980192 20830 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
I20260812 17:42:45.984017 20536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:45.967934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:54423 (local address 127.17.255.62:39007)
0812 17:42:45.968117 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:45.968122 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:45.969755 (+ 1633us) server_negotiation.cc:407] Connection header received
0812 17:42:45.971281 (+ 1526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:45.971285 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:45.971352 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:45.971432 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:42:45.973284 (+ 1852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:45.974075 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:45.975573 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:45.975893 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:45.976026 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:45.979677 (+ 3651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:42:45.979681 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:42:45.979683 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:42:45.979713 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:42:45.981522 (+ 1809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:45.982190 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:45.982194 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:45.982195 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:45.982305 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:45.982824 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:45.982828 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:45.982829 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:45.983059 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:42:45.983149 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:45.983774 (+ 625us) server_negotiation.cc:299] Negotiation successful
0812 17:42:45.983888 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 17:42:45.984979 20873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:45.969016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:39007 (local address 127.17.255.2:54423)
0812 17:42:45.969539 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:45.969624 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:45.971008 (+ 1384us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:45.971675 (+ 667us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:45.971686 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:45.972265 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:42:45.973083 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:45.973109 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:45.974230 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:45.974233 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:45.975340 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:45.975363 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:45.976107 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:45.976112 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:45.976316 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:45.977133 (+ 817us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:42:45.977161 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:42:45.979458 (+ 2297us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:42:45.981693 (+ 2235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:45.981704 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:45.981723 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:45.982039 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:45.982518 (+ 479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:45.982521 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:45.982523 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:45.982684 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:45.983165 (+ 481us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:42:45.983171 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:42:45.983482 (+ 311us) client_negotiation.cc:769] Sending connection context
0812 17:42:45.983656 (+ 174us) client_negotiation.cc:240] Negotiation successful
0812 17:42:45.983948 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":116,"threads_started":1}
I20260812 17:42:45.986073 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 20830
I20260812 17:42:45.986202 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance
I20260812 17:42:45.986541 18428 external_mini_cluster.cc:1428] Setting key 9c872bd1c3a9f13a5e0c7fce082a9b67
I20260812 17:42:45.986654 21037 heartbeater.cc:347] Connected to a master server at 127.17.255.62:39007
I20260812 17:42:45.986845 21037 heartbeater.cc:464] Registering TS with master...
I20260812 17:42:45.987485 21037 heartbeater.cc:511] Master 127.17.255.62:39007 requested a full tablet report, sending...
I20260812 17:42:45.988674 20446 ts_manager.cc:194] Registered new tserver with Master: a3814529c7a6441b8170b45625b5211c (127.17.255.2:34425)
I20260812 17:42:45.989605 20446 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.2@KRBTEST.COM'} at 127.17.255.2:54423
I20260812 17:42:45.998764 21047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:45.989210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:39007 (local address 127.17.255.2:47873)
0812 17:42:45.989518 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:45.989532 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:45.989609 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:45.990558 (+ 949us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:45.990564 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:45.990868 (+ 304us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:42:45.991151 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:45.991159 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:45.992004 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:45.992008 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:45.992654 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:45.992664 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:45.993184 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:45.993187 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:45.993295 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:45.993890 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:42:45.993903 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:42:45.994249 (+ 346us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:42:45.996764 (+ 2515us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:45.996767 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:45.996768 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:45.997018 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:45.997411 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:45.997414 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:45.997416 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:45.997523 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:45.998170 (+ 647us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:42:45.998172 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:42:45.998265 (+ 93us) client_negotiation.cc:769] Sending connection context
0812 17:42:45.998453 (+ 188us) client_negotiation.cc:240] Negotiation successful
0812 17:42:45.998598 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":127,"threads_started":1}
I20260812 17:42:45.998908 20536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:45.989963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:47873 (local address 127.17.255.62:39007)
0812 17:42:45.990106 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:45.990113 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:45.990131 (+ 18us) server_negotiation.cc:407] Connection header received
0812 17:42:45.990177 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:45.990183 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:45.990240 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:45.990353 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:42:45.991294 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:45.991859 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:45.992789 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:45.993050 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:45.993175 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:45.994455 (+ 1280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:42:45.994462 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:42:45.994469 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:42:45.994505 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:42:45.996612 (+ 2107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:45.997138 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:45.997145 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:45.997147 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:45.997265 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:45.997645 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:45.997652 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:45.997656 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:45.998032 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:42:45.998182 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:45.998540 (+ 358us) server_negotiation.cc:299] Negotiation successful
0812 17:42:45.998690 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
WARNING: no policy specified for kudu/127.17.255.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab.
Entry for principal kudu/127.17.255.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab.
I20260812 17:42:46.022771 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.3:0
--local_ip_for_outbound_sockets=127.17.255.3
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:39007
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:37507
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:42:46.154912 21052 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:42:46.155193 21052 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:42:46.155238 21052 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:42:46.159420 21052 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:42:46.159487 21052 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:42:46.159528 21052 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 17:42:46.159592 21052 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.3
I20260812 17:42:46.165113 21052 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:37507
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.255.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.255.62:39007
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21052
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.3
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:42:46.166275 21052 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:42:46.167382 21052 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:42:46.177989 21070 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:42:46.177990 21068 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:42:46.177990 21067 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:42:46.178222 21052 server_base.cc:1034] running on GCE node
I20260812 17:42:46.178805 21052 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:42:46.179517 21052 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:42:46.180721 21052 hybrid_clock.cc:648] HybridClock initialized: now 1786556566180698 us; error 32 us; skew 500 ppm
Aug 12 17:42:46 dist-test-slave-tk9z krb5kdc[20360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556566, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:42:46.183842 21052 init.cc:377] Logged in from keytab as kudu/127.17.255.3@KRBTEST.COM (short username kudu)
I20260812 17:42:46.184834 21052 webserver.cc:460] Webserver started at http://127.17.255.3:46821/ using document root <none> and password file <none>
I20260812 17:42:46.185482 21052 fs_manager.cc:359] Metadata directory not provided
I20260812 17:42:46.185592 21052 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:42:46.185869 21052 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:42:46.188498 21052 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-2/data/instance:
uuid: "b9d22a3008d1419b99bec15d92182662"
format_stamp: "Formatted at 2026-08-12 17:42:46 on dist-test-slave-tk9z"
server_key: "739919ecc15d4979a63a0fe37c4c79d1"
server_key_iv: "4b1188e772c3ee60452a12afd16bcaec"
server_key_version: "encryptionkey@0"
I20260812 17:42:46.189162 21052 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance:
uuid: "b9d22a3008d1419b99bec15d92182662"
format_stamp: "Formatted at 2026-08-12 17:42:46 on dist-test-slave-tk9z"
server_key: "739919ecc15d4979a63a0fe37c4c79d1"
server_key_iv: "4b1188e772c3ee60452a12afd16bcaec"
server_key_version: "encryptionkey@0"
I20260812 17:42:46.193886 21052 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260812 17:42:46.197052 21085 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:46.198606 21052 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:42:46.198755 21052 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-2/wal
uuid: "b9d22a3008d1419b99bec15d92182662"
format_stamp: "Formatted at 2026-08-12 17:42:46 on dist-test-slave-tk9z"
server_key: "739919ecc15d4979a63a0fe37c4c79d1"
server_key_iv: "4b1188e772c3ee60452a12afd16bcaec"
server_key_version: "encryptionkey@0"
I20260812 17:42:46.198904 21052 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:42:46.216246 21052 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:42:46.219939 21052 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:42:46.220216 21052 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:42:46.222033 21052 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:42:46.222131 21052 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:46.222245 21052 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:42:46.222298 21052 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 17:42:46 dist-test-slave-tk9z krb5kdc[20360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556566, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:42:46.237573 21052 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.3:41941
I20260812 17:42:46.238643 21284 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.3:41941 every 8 connection(s)
I20260812 17:42:46.238837 21052 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
I20260812 17:42:46.239234 20536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:46.223047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:54855 (local address 127.17.255.62:39007)
0812 17:42:46.223197 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:46.223201 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:46.224610 (+ 1409us) server_negotiation.cc:407] Connection header received
0812 17:42:46.225652 (+ 1042us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:46.225655 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:46.225721 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:46.225828 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:42:46.227683 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.228440 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.229885 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.230135 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.230265 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:46.234917 (+ 4652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:42:46.234921 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:42:46.234924 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:42:46.234960 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:42:46.236714 (+ 1754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:46.237294 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:46.237297 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:46.237299 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:46.237396 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:46.237807 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:46.237810 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:46.237812 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:46.238035 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:42:46.238155 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:46.238893 (+ 738us) server_negotiation.cc:299] Negotiation successful
0812 17:42:46.239039 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 17:42:46.240213 21099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:46.223717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:39007 (local address 127.17.255.3:54855)
0812 17:42:46.224363 (+ 646us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:46.224411 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:46.225396 (+ 985us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:46.226039 (+ 643us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:46.226049 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:46.226679 (+ 630us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:42:46.227510 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:46.227530 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.228583 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.228587 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:46.229744 (+ 1157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:46.229755 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.230328 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.230332 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:46.230674 (+ 342us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:46.231397 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:42:46.231423 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:42:46.234721 (+ 3298us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:42:46.236849 (+ 2128us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:46.236856 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:46.236874 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:46.237193 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:46.237505 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:46.237508 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:46.237510 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:46.237712 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:46.238167 (+ 455us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:42:46.238175 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:42:46.238549 (+ 374us) client_negotiation.cc:769] Sending connection context
0812 17:42:46.238786 (+ 237us) client_negotiation.cc:240] Negotiation successful
0812 17:42:46.239143 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":140,"threads_started":1}
I20260812 17:42:46.241508 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 21052
I20260812 17:42:46.241643 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance
I20260812 17:42:46.241967 18428 external_mini_cluster.cc:1428] Setting key 59b333c6eb7763538c1025c9566653fb
I20260812 17:42:46.242060 21288 heartbeater.cc:347] Connected to a master server at 127.17.255.62:39007
I20260812 17:42:46.242218 21288 heartbeater.cc:464] Registering TS with master...
I20260812 17:42:46.242950 21288 heartbeater.cc:511] Master 127.17.255.62:39007 requested a full tablet report, sending...
I20260812 17:42:46.244102 20446 ts_manager.cc:194] Registered new tserver with Master: b9d22a3008d1419b99bec15d92182662 (127.17.255.3:41941)
I20260812 17:42:46.244716 20446 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.3@KRBTEST.COM'} at 127.17.255.3:54855
I20260812 17:42:46.252730 21294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:46.244758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:39007 (local address 127.17.255.3:42841)
0812 17:42:46.245140 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:46.245154 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:46.245236 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:46.245504 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:46.245507 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:46.245752 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:42:46.245877 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:46.245885 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.246869 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.246872 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:46.247513 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:46.247522 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.248100 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.248103 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:46.248186 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:46.248735 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:42:46.248748 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:42:46.249094 (+ 346us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:42:46.251018 (+ 1924us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:46.251021 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:46.251023 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:46.251322 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:46.251661 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:46.251664 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:46.251665 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:46.251778 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:46.252198 (+ 420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:42:46.252201 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:42:46.252354 (+ 153us) client_negotiation.cc:769] Sending connection context
0812 17:42:46.252451 (+ 97us) client_negotiation.cc:240] Negotiation successful
0812 17:42:46.252577 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":125,"threads_started":1}
I20260812 17:42:46.252753 20536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:46.244827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:42841 (local address 127.17.255.62:39007)
0812 17:42:46.244970 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:46.244974 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:46.245228 (+ 254us) server_negotiation.cc:407] Connection header received
0812 17:42:46.245351 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:46.245354 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:46.245394 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:46.245460 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:42:46.246018 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.246655 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.247642 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.247958 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.248055 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:46.249238 (+ 1183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:42:46.249241 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:42:46.249243 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:42:46.249266 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:42:46.250893 (+ 1627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:46.251445 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:46.251448 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:46.251449 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:46.251538 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:46.251886 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:46.251889 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:46.251890 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:46.252087 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:42:46.252170 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:46.252527 (+ 357us) server_negotiation.cc:299] Negotiation successful
0812 17:42:46.252637 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 17:42:46.256187 18428 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 17:42:46 dist-test-slave-tk9z krb5kdc[20360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556566, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 17:42:46 dist-test-slave-tk9z krb5kdc[20360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556566, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:42:46.284696 20536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:46.275314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39194 (local address 127.17.255.62:39007)
0812 17:42:46.275453 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:46.275457 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:46.275470 (+ 13us) server_negotiation.cc:407] Connection header received
0812 17:42:46.275516 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:46.275519 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:46.275561 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:46.275636 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:42:46.276483 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.277013 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.277982 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.278203 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.278286 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:46.281352 (+ 3066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:42:46.281356 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:42:46.281358 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:42:46.281387 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:42:46.282998 (+ 1611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:46.283491 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:46.283494 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:46.283495 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:46.283581 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:46.283834 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:46.283837 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:46.283838 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:46.284028 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:42:46.284132 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:46.284389 (+ 257us) server_negotiation.cc:299] Negotiation successful
0812 17:42:46.284498 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 17:42:46.288240 20446 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39194:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 17:42:46.291471 20446 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 17:42:46.307767 21331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:46.301948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49660 (local address 127.17.255.2:34425)
0812 17:42:46.302515 (+ 567us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:46.302525 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:46.302648 (+ 123us) server_negotiation.cc:407] Connection header received
0812 17:42:46.302774 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:46.302781 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:46.303004 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:46.303174 (+ 170us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:42:46.303683 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.304566 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.306120 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.306840 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.306964 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:46.307153 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:46.307480 (+ 327us) server_negotiation.cc:299] Negotiation successful
0812 17:42:46.307598 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":93,"threads_started":1}
I20260812 17:42:46.307767 21321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:46.301503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:34425 (local address 127.0.0.1:49660)
0812 17:42:46.302544 (+ 1041us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:46.302556 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:46.302653 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:46.303379 (+ 726us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:46.303382 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:46.303400 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:42:46.303552 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:46.303557 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.304692 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.304695 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:46.305990 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:46.306000 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.306985 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.306989 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:46.307203 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:46.307268 (+ 65us) client_negotiation.cc:769] Sending connection context
0812 17:42:46.307433 (+ 165us) client_negotiation.cc:240] Negotiation successful
0812 17:42:46.307588 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":982,"mutex_wait_us":48,"thread_start_us":88,"threads_started":1}
I20260812 17:42:46.308420 21325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:46.301321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53378 (local address 127.17.255.1:36463)
0812 17:42:46.302095 (+ 774us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:46.302102 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:46.302342 (+ 240us) server_negotiation.cc:407] Connection header received
0812 17:42:46.302835 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:46.302842 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:46.303047 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:46.303300 (+ 253us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:42:46.303783 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.304925 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.306780 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.307552 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.307661 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:46.307807 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:46.308141 (+ 334us) server_negotiation.cc:299] Negotiation successful
0812 17:42:46.308257 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":666,"thread_start_us":122,"threads_started":1}
I20260812 17:42:46.308679 21327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:46.301020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.3:41941 (local address 127.0.0.1:43286)
0812 17:42:46.301929 (+ 909us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:46.301985 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:46.302126 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:46.303190 (+ 1064us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:46.303197 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:46.303224 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:42:46.303505 (+ 281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:46.303512 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.305073 (+ 1561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.305076 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:46.306635 (+ 1559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:46.306647 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.308227 (+ 1580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.308235 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:46.308354 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:46.308381 (+ 27us) client_negotiation.cc:769] Sending connection context
0812 17:42:46.308461 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 17:42:46.308538 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":688,"mutex_wait_us":133,"spinlock_wait_cycles":4992,"thread_start_us":115,"threads_started":1}
I20260812 17:42:46.308826 21322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:46.301036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:36463 (local address 127.0.0.1:53378)
0812 17:42:46.302211 (+ 1175us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:46.302227 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:46.302336 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:46.303501 (+ 1165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:46.303504 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:46.303522 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:42:46.303620 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:46.303626 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.305075 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.305077 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:46.306637 (+ 1560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:46.306647 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.307881 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.307887 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:46.307979 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:46.308003 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 17:42:46.308619 (+ 616us) client_negotiation.cc:240] Negotiation successful
0812 17:42:46.308690 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1104,"mutex_wait_us":209,"thread_start_us":132,"threads_started":1}
I20260812 17:42:46.309158 21328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:46.301806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43286 (local address 127.17.255.3:41941)
0812 17:42:46.302722 (+ 916us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:46.302734 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:46.302754 (+ 20us) server_negotiation.cc:407] Connection header received
0812 17:42:46.302817 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:46.302821 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:46.303004 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:46.303174 (+ 170us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:42:46.303635 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.304931 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.306796 (+ 1865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.307783 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.307921 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:46.308150 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:46.308873 (+ 723us) server_negotiation.cc:299] Negotiation successful
0812 17:42:46.308979 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":813,"thread_start_us":109,"threads_started":1}
I20260812 17:42:46.311569 20689 tablet_service.cc:1467] Processing CreateTablet for tablet 09df4e8a60f946e2b3025bf9c12b2b4c (DEFAULT_TABLE table=test-table [id=656b286194e44385945e2c61eb1c5e44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:42:46.311853 21151 tablet_service.cc:1467] Processing CreateTablet for tablet 09df4e8a60f946e2b3025bf9c12b2b4c (DEFAULT_TABLE table=test-table [id=656b286194e44385945e2c61eb1c5e44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:42:46.311697 20938 tablet_service.cc:1467] Processing CreateTablet for tablet 09df4e8a60f946e2b3025bf9c12b2b4c (DEFAULT_TABLE table=test-table [id=656b286194e44385945e2c61eb1c5e44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:42:46.312668 20689 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09df4e8a60f946e2b3025bf9c12b2b4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:42:46.312923 20938 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09df4e8a60f946e2b3025bf9c12b2b4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:42:46.312938 21151 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09df4e8a60f946e2b3025bf9c12b2b4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:42:46.319706 21334 tablet_bootstrap.cc:492] T 09df4e8a60f946e2b3025bf9c12b2b4c P 999f555d85d24dbfafce7efa54da39e8: Bootstrap starting.
I20260812 17:42:46.322091 21334 tablet_bootstrap.cc:654] T 09df4e8a60f946e2b3025bf9c12b2b4c P 999f555d85d24dbfafce7efa54da39e8: Neither blocks nor log segments found. Creating new log.
I20260812 17:42:46.322093 21335 tablet_bootstrap.cc:492] T 09df4e8a60f946e2b3025bf9c12b2b4c P b9d22a3008d1419b99bec15d92182662: Bootstrap starting.
I20260812 17:42:46.323097 21336 tablet_bootstrap.cc:492] T 09df4e8a60f946e2b3025bf9c12b2b4c P a3814529c7a6441b8170b45625b5211c: Bootstrap starting.
I20260812 17:42:46.323374 21334 log.cc:824] T 09df4e8a60f946e2b3025bf9c12b2b4c P 999f555d85d24dbfafce7efa54da39e8: Log is configured to *not* fsync() on all Append() calls
I20260812 17:42:46.324903 21335 tablet_bootstrap.cc:654] T 09df4e8a60f946e2b3025bf9c12b2b4c P b9d22a3008d1419b99bec15d92182662: Neither blocks nor log segments found. Creating new log.
I20260812 17:42:46.325567 21336 tablet_bootstrap.cc:654] T 09df4e8a60f946e2b3025bf9c12b2b4c P a3814529c7a6441b8170b45625b5211c: Neither blocks nor log segments found. Creating new log.
I20260812 17:42:46.325737 21335 log.cc:824] T 09df4e8a60f946e2b3025bf9c12b2b4c P b9d22a3008d1419b99bec15d92182662: Log is configured to *not* fsync() on all Append() calls
I20260812 17:42:46.325789 21334 tablet_bootstrap.cc:492] T 09df4e8a60f946e2b3025bf9c12b2b4c P 999f555d85d24dbfafce7efa54da39e8: No bootstrap required, opened a new log
I20260812 17:42:46.326036 21334 ts_tablet_manager.cc:1397] T 09df4e8a60f946e2b3025bf9c12b2b4c P 999f555d85d24dbfafce7efa54da39e8: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 17:42:46.326560 21336 log.cc:824] T 09df4e8a60f946e2b3025bf9c12b2b4c P a3814529c7a6441b8170b45625b5211c: Log is configured to *not* fsync() on all Append() calls
I20260812 17:42:46.328094 21335 tablet_bootstrap.cc:492] T 09df4e8a60f946e2b3025bf9c12b2b4c P b9d22a3008d1419b99bec15d92182662: No bootstrap required, opened a new log
I20260812 17:42:46.328307 21335 ts_tablet_manager.cc:1397] T 09df4e8a60f946e2b3025bf9c12b2b4c P b9d22a3008d1419b99bec15d92182662: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260812 17:42:46.329172 21336 tablet_bootstrap.cc:492] T 09df4e8a60f946e2b3025bf9c12b2b4c P a3814529c7a6441b8170b45625b5211c: No bootstrap required, opened a new log
I20260812 17:42:46.329386 21336 ts_tablet_manager.cc:1397] T 09df4e8a60f946e2b3025bf9c12b2b4c P a3814529c7a6441b8170b45625b5211c: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260812 17:42:46.332212 21334 raft_consensus.cc:348] T 09df4e8a60f946e2b3025bf9c12b2b4c P 999f555d85d24dbfafce7efa54da39e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d22a3008d1419b99bec15d92182662" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41941 } } peers { permanent_uuid: "999f555d85d24dbfafce7efa54da39e8" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 36463 } } peers { permanent_uuid: "a3814529c7a6441b8170b45625b5211c" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 34425 } }
I20260812 17:42:46.332567 21334 raft_consensus.cc:374] T 09df4e8a60f946e2b3025bf9c12b2b4c P 999f555d85d24dbfafce7efa54da39e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:42:46.332401 21335 raft_consensus.cc:348] T 09df4e8a60f946e2b3025bf9c12b2b4c P b9d22a3008d1419b99bec15d92182662 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d22a3008d1419b99bec15d92182662" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41941 } } peers { permanent_uuid: "999f555d85d24dbfafce7efa54da39e8" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 36463 } } peers { permanent_uuid: "a3814529c7a6441b8170b45625b5211c" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 34425 } }
I20260812 17:42:46.332659 21334 raft_consensus.cc:729] T 09df4e8a60f946e2b3025bf9c12b2b4c P 999f555d85d24dbfafce7efa54da39e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 999f555d85d24dbfafce7efa54da39e8, State: Initialized, Role: FOLLOWER
I20260812 17:42:46.332659 21335 raft_consensus.cc:374] T 09df4e8a60f946e2b3025bf9c12b2b4c P b9d22a3008d1419b99bec15d92182662 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:42:46.332723 21335 raft_consensus.cc:729] T 09df4e8a60f946e2b3025bf9c12b2b4c P b9d22a3008d1419b99bec15d92182662 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d22a3008d1419b99bec15d92182662, State: Initialized, Role: FOLLOWER
I20260812 17:42:46.333187 21335 consensus_queue.cc:260] T 09df4e8a60f946e2b3025bf9c12b2b4c P b9d22a3008d1419b99bec15d92182662 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d22a3008d1419b99bec15d92182662" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41941 } } peers { permanent_uuid: "999f555d85d24dbfafce7efa54da39e8" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 36463 } } peers { permanent_uuid: "a3814529c7a6441b8170b45625b5211c" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 34425 } }
I20260812 17:42:46.333213 21334 consensus_queue.cc:260] T 09df4e8a60f946e2b3025bf9c12b2b4c P 999f555d85d24dbfafce7efa54da39e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d22a3008d1419b99bec15d92182662" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41941 } } peers { permanent_uuid: "999f555d85d24dbfafce7efa54da39e8" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 36463 } } peers { permanent_uuid: "a3814529c7a6441b8170b45625b5211c" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 34425 } }
I20260812 17:42:46.334038 21288 heartbeater.cc:503] Master 127.17.255.62:39007 was elected leader, sending a full tablet report...
I20260812 17:42:46.334347 21335 ts_tablet_manager.cc:1428] T 09df4e8a60f946e2b3025bf9c12b2b4c P b9d22a3008d1419b99bec15d92182662: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260812 17:42:46.334467 21334 ts_tablet_manager.cc:1428] T 09df4e8a60f946e2b3025bf9c12b2b4c P 999f555d85d24dbfafce7efa54da39e8: Time spent starting tablet: real 0.008s user 0.006s sys 0.004s
I20260812 17:42:46.334867 20812 heartbeater.cc:503] Master 127.17.255.62:39007 was elected leader, sending a full tablet report...
I20260812 17:42:46.335182 21336 raft_consensus.cc:348] T 09df4e8a60f946e2b3025bf9c12b2b4c P a3814529c7a6441b8170b45625b5211c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d22a3008d1419b99bec15d92182662" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41941 } } peers { permanent_uuid: "999f555d85d24dbfafce7efa54da39e8" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 36463 } } peers { permanent_uuid: "a3814529c7a6441b8170b45625b5211c" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 34425 } }
I20260812 17:42:46.335458 21336 raft_consensus.cc:374] T 09df4e8a60f946e2b3025bf9c12b2b4c P a3814529c7a6441b8170b45625b5211c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:42:46.335500 21336 raft_consensus.cc:729] T 09df4e8a60f946e2b3025bf9c12b2b4c P a3814529c7a6441b8170b45625b5211c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3814529c7a6441b8170b45625b5211c, State: Initialized, Role: FOLLOWER
I20260812 17:42:46.335999 21336 consensus_queue.cc:260] T 09df4e8a60f946e2b3025bf9c12b2b4c P a3814529c7a6441b8170b45625b5211c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d22a3008d1419b99bec15d92182662" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41941 } } peers { permanent_uuid: "999f555d85d24dbfafce7efa54da39e8" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 36463 } } peers { permanent_uuid: "a3814529c7a6441b8170b45625b5211c" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 34425 } }
I20260812 17:42:46.336886 21037 heartbeater.cc:503] Master 127.17.255.62:39007 was elected leader, sending a full tablet report...
I20260812 17:42:46.337158 21336 ts_tablet_manager.cc:1428] T 09df4e8a60f946e2b3025bf9c12b2b4c P a3814529c7a6441b8170b45625b5211c: Time spent starting tablet: real 0.008s user 0.006s sys 0.002s
I20260812 17:42:46.424012 21342 raft_consensus.cc:482] T 09df4e8a60f946e2b3025bf9c12b2b4c P 999f555d85d24dbfafce7efa54da39e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:42:46.424345 21342 raft_consensus.cc:504] T 09df4e8a60f946e2b3025bf9c12b2b4c P 999f555d85d24dbfafce7efa54da39e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d22a3008d1419b99bec15d92182662" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41941 } } peers { permanent_uuid: "999f555d85d24dbfafce7efa54da39e8" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 36463 } } peers { permanent_uuid: "a3814529c7a6441b8170b45625b5211c" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 34425 } }
I20260812 17:42:46.425794 21342 leader_election.cc:288] T 09df4e8a60f946e2b3025bf9c12b2b4c P 999f555d85d24dbfafce7efa54da39e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9d22a3008d1419b99bec15d92182662 (127.17.255.3:41941), a3814529c7a6441b8170b45625b5211c (127.17.255.2:34425)
I20260812 17:42:46.431012 21331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:46.426349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:48357 (local address 127.17.255.2:34425)
0812 17:42:46.426561 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:46.426567 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:46.427074 (+ 507us) server_negotiation.cc:407] Connection header received
0812 17:42:46.427212 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:46.427216 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:46.427273 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:46.427352 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:42:46.427795 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.428432 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.429938 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.430339 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.430506 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:46.430564 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:46.430810 (+ 246us) server_negotiation.cc:299] Negotiation successful
0812 17:42:46.430891 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 17:42:46.431037 21346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:46.426265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:34425 (local address 127.17.255.1:48357)
0812 17:42:46.426919 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:46.426932 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:46.427075 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:46.427389 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:46.427396 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:46.427413 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:42:46.427663 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:46.427671 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.428575 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.428577 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:46.429805 (+ 1228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:46.429816 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.430506 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.430510 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:46.430675 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:46.430696 (+ 21us) client_negotiation.cc:769] Sending connection context
0812 17:42:46.430791 (+ 95us) client_negotiation.cc:240] Negotiation successful
0812 17:42:46.430865 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":580,"thread_start_us":312,"threads_started":1}
I20260812 17:42:46.431157 21328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:46.426487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:43793 (local address 127.17.255.3:41941)
0812 17:42:46.426650 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:46.426655 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:46.426875 (+ 220us) server_negotiation.cc:407] Connection header received
0812 17:42:46.427038 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:46.427042 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:46.427090 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:46.427170 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:42:46.427751 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.428389 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.429798 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.430440 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.430578 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:46.430649 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:46.430924 (+ 275us) server_negotiation.cc:299] Negotiation successful
0812 17:42:46.430995 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260812 17:42:46.431306 21347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:46.426137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.3:41941 (local address 127.17.255.1:43793)
0812 17:42:46.426776 (+ 639us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:46.426794 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:46.426914 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:46.427249 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:46.427252 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:46.427270 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:42:46.427611 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:46.427621 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.428506 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.428513 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:46.429647 (+ 1134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:46.429658 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.430572 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.430576 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:46.430784 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:46.430804 (+ 20us) client_negotiation.cc:769] Sending connection context
0812 17:42:46.430901 (+ 97us) client_negotiation.cc:240] Negotiation successful
0812 17:42:46.430973 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":297,"threads_started":1}
I20260812 17:42:46.432075 20975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09df4e8a60f946e2b3025bf9c12b2b4c" candidate_uuid: "999f555d85d24dbfafce7efa54da39e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3814529c7a6441b8170b45625b5211c" is_pre_election: true
I20260812 17:42:46.432075 21199 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09df4e8a60f946e2b3025bf9c12b2b4c" candidate_uuid: "999f555d85d24dbfafce7efa54da39e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d22a3008d1419b99bec15d92182662" is_pre_election: true
I20260812 17:42:46.432456 21199 raft_consensus.cc:2454] T 09df4e8a60f946e2b3025bf9c12b2b4c P b9d22a3008d1419b99bec15d92182662 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 999f555d85d24dbfafce7efa54da39e8 in term 0.
I20260812 17:42:46.432444 20975 raft_consensus.cc:2454] T 09df4e8a60f946e2b3025bf9c12b2b4c P a3814529c7a6441b8170b45625b5211c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 999f555d85d24dbfafce7efa54da39e8 in term 0.
I20260812 17:42:46.433091 20613 leader_election.cc:302] T 09df4e8a60f946e2b3025bf9c12b2b4c P 999f555d85d24dbfafce7efa54da39e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 999f555d85d24dbfafce7efa54da39e8, a3814529c7a6441b8170b45625b5211c, b9d22a3008d1419b99bec15d92182662; no voters:
I20260812 17:42:46.433405 21342 raft_consensus.cc:2781] T 09df4e8a60f946e2b3025bf9c12b2b4c P 999f555d85d24dbfafce7efa54da39e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 17:42:46.433519 21342 raft_consensus.cc:482] T 09df4e8a60f946e2b3025bf9c12b2b4c P 999f555d85d24dbfafce7efa54da39e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 17:42:46.433602 21342 raft_consensus.cc:3037] T 09df4e8a60f946e2b3025bf9c12b2b4c P 999f555d85d24dbfafce7efa54da39e8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:42:46.435236 21342 raft_consensus.cc:504] T 09df4e8a60f946e2b3025bf9c12b2b4c P 999f555d85d24dbfafce7efa54da39e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d22a3008d1419b99bec15d92182662" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41941 } } peers { permanent_uuid: "999f555d85d24dbfafce7efa54da39e8" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 36463 } } peers { permanent_uuid: "a3814529c7a6441b8170b45625b5211c" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 34425 } }
I20260812 17:42:46.435632 21342 leader_election.cc:288] T 09df4e8a60f946e2b3025bf9c12b2b4c P 999f555d85d24dbfafce7efa54da39e8 [CANDIDATE]: Term 1 election: Requested vote from peers b9d22a3008d1419b99bec15d92182662 (127.17.255.3:41941), a3814529c7a6441b8170b45625b5211c (127.17.255.2:34425)
I20260812 17:42:46.436108 21199 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09df4e8a60f946e2b3025bf9c12b2b4c" candidate_uuid: "999f555d85d24dbfafce7efa54da39e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d22a3008d1419b99bec15d92182662"
I20260812 17:42:46.436108 20975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09df4e8a60f946e2b3025bf9c12b2b4c" candidate_uuid: "999f555d85d24dbfafce7efa54da39e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3814529c7a6441b8170b45625b5211c"
I20260812 17:42:46.436264 20975 raft_consensus.cc:3037] T 09df4e8a60f946e2b3025bf9c12b2b4c P a3814529c7a6441b8170b45625b5211c [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:42:46.436264 21199 raft_consensus.cc:3037] T 09df4e8a60f946e2b3025bf9c12b2b4c P b9d22a3008d1419b99bec15d92182662 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:42:46.439533 20975 raft_consensus.cc:2454] T 09df4e8a60f946e2b3025bf9c12b2b4c P a3814529c7a6441b8170b45625b5211c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 999f555d85d24dbfafce7efa54da39e8 in term 1.
I20260812 17:42:46.439533 21199 raft_consensus.cc:2454] T 09df4e8a60f946e2b3025bf9c12b2b4c P b9d22a3008d1419b99bec15d92182662 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 999f555d85d24dbfafce7efa54da39e8 in term 1.
I20260812 17:42:46.439939 20613 leader_election.cc:302] T 09df4e8a60f946e2b3025bf9c12b2b4c P 999f555d85d24dbfafce7efa54da39e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 999f555d85d24dbfafce7efa54da39e8, a3814529c7a6441b8170b45625b5211c, b9d22a3008d1419b99bec15d92182662; no voters:
I20260812 17:42:46.440222 21342 raft_consensus.cc:2781] T 09df4e8a60f946e2b3025bf9c12b2b4c P 999f555d85d24dbfafce7efa54da39e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:42:46.440598 21342 raft_consensus.cc:686] T 09df4e8a60f946e2b3025bf9c12b2b4c P 999f555d85d24dbfafce7efa54da39e8 [term 1 LEADER]: Becoming Leader. State: Replica: 999f555d85d24dbfafce7efa54da39e8, State: Running, Role: LEADER
I20260812 17:42:46.441071 21342 consensus_queue.cc:237] T 09df4e8a60f946e2b3025bf9c12b2b4c P 999f555d85d24dbfafce7efa54da39e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d22a3008d1419b99bec15d92182662" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41941 } } peers { permanent_uuid: "999f555d85d24dbfafce7efa54da39e8" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 36463 } } peers { permanent_uuid: "a3814529c7a6441b8170b45625b5211c" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 34425 } }
I20260812 17:42:46.445013 20446 catalog_manager.cc:5495] T 09df4e8a60f946e2b3025bf9c12b2b4c P 999f555d85d24dbfafce7efa54da39e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 999f555d85d24dbfafce7efa54da39e8 (127.17.255.1). New cstate: current_term: 1 leader_uuid: "999f555d85d24dbfafce7efa54da39e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d22a3008d1419b99bec15d92182662" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "999f555d85d24dbfafce7efa54da39e8" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 36463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3814529c7a6441b8170b45625b5211c" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 34425 } health_report { overall_health: UNKNOWN } } }
I20260812 17:42:46.470721 21325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:46.466460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53390 (local address 127.17.255.1:36463)
0812 17:42:46.466627 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:46.466631 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:46.466648 (+ 17us) server_negotiation.cc:407] Connection header received
0812 17:42:46.466760 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:46.466763 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:46.466841 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:46.466937 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:42:46.467304 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.467909 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.468921 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.469171 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.469269 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:46.469697 (+ 428us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:42:46.470172 (+ 475us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:42:46.470294 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:46.470441 (+ 147us) server_negotiation.cc:299] Negotiation successful
0812 17:42:46.470508 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 17:42:46.477852 20975 raft_consensus.cc:1261] T 09df4e8a60f946e2b3025bf9c12b2b4c P a3814529c7a6441b8170b45625b5211c [term 1 FOLLOWER]: Refusing update from remote peer 999f555d85d24dbfafce7efa54da39e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:42:46.477852 21199 raft_consensus.cc:1261] T 09df4e8a60f946e2b3025bf9c12b2b4c P b9d22a3008d1419b99bec15d92182662 [term 1 FOLLOWER]: Refusing update from remote peer 999f555d85d24dbfafce7efa54da39e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:42:46.478770 21350 consensus_queue.cc:1035] T 09df4e8a60f946e2b3025bf9c12b2b4c P 999f555d85d24dbfafce7efa54da39e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3814529c7a6441b8170b45625b5211c" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 34425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:42:46.481070 21350 consensus_queue.cc:1035] T 09df4e8a60f946e2b3025bf9c12b2b4c P 999f555d85d24dbfafce7efa54da39e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d22a3008d1419b99bec15d92182662" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 17:42:46.481735 21038 tablet.cc:2369] T 09df4e8a60f946e2b3025bf9c12b2b4c P a3814529c7a6441b8170b45625b5211c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 17:42:46.491106 21289 tablet.cc:2369] T 09df4e8a60f946e2b3025bf9c12b2b4c P b9d22a3008d1419b99bec15d92182662: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 17:42:46.492131 21359 mvcc.cc:205] Tried to move back new op lower bound from 7317735696284557312 to 7317735696146210816. Current Snapshot: MvccSnapshot[applied={T|T < 7317735696284557312}]
I20260812 17:42:46.503875 20447 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39194:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:42:46.504158 20447 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39194:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:42:46.507105 20447 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9152398953ab47c6b332e0e97a99728b: Sending DeleteTablet for 3 replicas of tablet 09df4e8a60f946e2b3025bf9c12b2b4c
I20260812 17:42:46.508149 21151 tablet_service.cc:1514] Processing DeleteTablet for tablet 09df4e8a60f946e2b3025bf9c12b2b4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:42:46 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:43286
I20260812 17:42:46.508383 20689 tablet_service.cc:1514] Processing DeleteTablet for tablet 09df4e8a60f946e2b3025bf9c12b2b4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:42:46 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:53378
I20260812 17:42:46.508546 20938 tablet_service.cc:1514] Processing DeleteTablet for tablet 09df4e8a60f946e2b3025bf9c12b2b4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:42:46 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:49660
I20260812 17:42:46.509060 21372 tablet_replica.cc:330] T 09df4e8a60f946e2b3025bf9c12b2b4c P a3814529c7a6441b8170b45625b5211c: stopping tablet replica
I20260812 17:42:46.509347 21374 tablet_replica.cc:330] T 09df4e8a60f946e2b3025bf9c12b2b4c P 999f555d85d24dbfafce7efa54da39e8: stopping tablet replica
I20260812 17:42:46.509435 21372 raft_consensus.cc:2229] T 09df4e8a60f946e2b3025bf9c12b2b4c P a3814529c7a6441b8170b45625b5211c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:42:46.509845 21372 raft_consensus.cc:2258] T 09df4e8a60f946e2b3025bf9c12b2b4c P a3814529c7a6441b8170b45625b5211c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:42:46.509891 21374 raft_consensus.cc:2229] T 09df4e8a60f946e2b3025bf9c12b2b4c P 999f555d85d24dbfafce7efa54da39e8 [term 1 LEADER]: Raft consensus shutting down.
I20260812 17:42:46.510076 20447 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39194:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 17:42:46.510667 20447 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 17:42:46.510993 21374 raft_consensus.cc:2258] T 09df4e8a60f946e2b3025bf9c12b2b4c P 999f555d85d24dbfafce7efa54da39e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:42:46.511703 21369 tablet_replica.cc:330] T 09df4e8a60f946e2b3025bf9c12b2b4c P b9d22a3008d1419b99bec15d92182662: stopping tablet replica
I20260812 17:42:46.511881 21372 ts_tablet_manager.cc:1905] T 09df4e8a60f946e2b3025bf9c12b2b4c P a3814529c7a6441b8170b45625b5211c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:42:46.512042 21369 raft_consensus.cc:2229] T 09df4e8a60f946e2b3025bf9c12b2b4c P b9d22a3008d1419b99bec15d92182662 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:42:46.512493 21369 raft_consensus.cc:2258] T 09df4e8a60f946e2b3025bf9c12b2b4c P b9d22a3008d1419b99bec15d92182662 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:42:46.512624 21374 ts_tablet_manager.cc:1905] T 09df4e8a60f946e2b3025bf9c12b2b4c P 999f555d85d24dbfafce7efa54da39e8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:42:46.515919 21372 ts_tablet_manager.cc:1918] T 09df4e8a60f946e2b3025bf9c12b2b4c P a3814529c7a6441b8170b45625b5211c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 17:42:46.516116 21372 log.cc:1196] T 09df4e8a60f946e2b3025bf9c12b2b4c P a3814529c7a6441b8170b45625b5211c: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-1/wal/wals/09df4e8a60f946e2b3025bf9c12b2b4c
I20260812 17:42:46.516542 21374 ts_tablet_manager.cc:1918] T 09df4e8a60f946e2b3025bf9c12b2b4c P 999f555d85d24dbfafce7efa54da39e8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 17:42:46.516650 21374 log.cc:1196] T 09df4e8a60f946e2b3025bf9c12b2b4c P 999f555d85d24dbfafce7efa54da39e8: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-0/wal/wals/09df4e8a60f946e2b3025bf9c12b2b4c
I20260812 17:42:46.516824 21372 ts_tablet_manager.cc:1939] T 09df4e8a60f946e2b3025bf9c12b2b4c P a3814529c7a6441b8170b45625b5211c: Deleting consensus metadata
I20260812 17:42:46.517023 21374 ts_tablet_manager.cc:1939] T 09df4e8a60f946e2b3025bf9c12b2b4c P 999f555d85d24dbfafce7efa54da39e8: Deleting consensus metadata
I20260812 17:42:46.518152 20689 tablet_service.cc:1467] Processing CreateTablet for tablet 67fec8fe103742f193a77e3cc81794ee (DEFAULT_TABLE table=test-table [id=63fb6d9036ed440db74e660489db4e4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:42:46.518499 20689 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67fec8fe103742f193a77e3cc81794ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:42:46.518507 20419 catalog_manager.cc:4841] TS 999f555d85d24dbfafce7efa54da39e8 (127.17.255.1:36463): tablet 09df4e8a60f946e2b3025bf9c12b2b4c (table test-table [id=656b286194e44385945e2c61eb1c5e44]) successfully deleted
I20260812 17:42:46.521077 21334 tablet_bootstrap.cc:492] T 67fec8fe103742f193a77e3cc81794ee P 999f555d85d24dbfafce7efa54da39e8: Bootstrap starting.
I20260812 17:42:46.521930 21151 tablet_service.cc:1467] Processing CreateTablet for tablet 67fec8fe103742f193a77e3cc81794ee (DEFAULT_TABLE table=test-table [id=63fb6d9036ed440db74e660489db4e4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:42:46.521945 20421 catalog_manager.cc:4841] TS a3814529c7a6441b8170b45625b5211c (127.17.255.2:34425): tablet 09df4e8a60f946e2b3025bf9c12b2b4c (table test-table [id=656b286194e44385945e2c61eb1c5e44]) successfully deleted
I20260812 17:42:46.522235 21151 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67fec8fe103742f193a77e3cc81794ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:42:46.522625 20938 tablet_service.cc:1467] Processing CreateTablet for tablet 67fec8fe103742f193a77e3cc81794ee (DEFAULT_TABLE table=test-table [id=63fb6d9036ed440db74e660489db4e4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:42:46.522907 20938 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67fec8fe103742f193a77e3cc81794ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:42:46.524262 21369 ts_tablet_manager.cc:1905] T 09df4e8a60f946e2b3025bf9c12b2b4c P b9d22a3008d1419b99bec15d92182662: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:42:46.525277 21335 tablet_bootstrap.cc:492] T 67fec8fe103742f193a77e3cc81794ee P b9d22a3008d1419b99bec15d92182662: Bootstrap starting.
I20260812 17:42:46.527122 21335 tablet_bootstrap.cc:654] T 67fec8fe103742f193a77e3cc81794ee P b9d22a3008d1419b99bec15d92182662: Neither blocks nor log segments found. Creating new log.
I20260812 17:42:46.528427 21334 tablet_bootstrap.cc:654] T 67fec8fe103742f193a77e3cc81794ee P 999f555d85d24dbfafce7efa54da39e8: Neither blocks nor log segments found. Creating new log.
I20260812 17:42:46.529237 21335 tablet_bootstrap.cc:492] T 67fec8fe103742f193a77e3cc81794ee P b9d22a3008d1419b99bec15d92182662: No bootstrap required, opened a new log
I20260812 17:42:46.529313 21335 ts_tablet_manager.cc:1397] T 67fec8fe103742f193a77e3cc81794ee P b9d22a3008d1419b99bec15d92182662: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260812 17:42:46.529945 21369 ts_tablet_manager.cc:1918] T 09df4e8a60f946e2b3025bf9c12b2b4c P b9d22a3008d1419b99bec15d92182662: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 17:42:46.530102 21336 tablet_bootstrap.cc:492] T 67fec8fe103742f193a77e3cc81794ee P a3814529c7a6441b8170b45625b5211c: Bootstrap starting.
I20260812 17:42:46.530117 21335 raft_consensus.cc:348] T 67fec8fe103742f193a77e3cc81794ee P b9d22a3008d1419b99bec15d92182662 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "999f555d85d24dbfafce7efa54da39e8" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 36463 } } peers { permanent_uuid: "a3814529c7a6441b8170b45625b5211c" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 34425 } } peers { permanent_uuid: "b9d22a3008d1419b99bec15d92182662" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41941 } }
I20260812 17:42:46.530273 21335 raft_consensus.cc:374] T 67fec8fe103742f193a77e3cc81794ee P b9d22a3008d1419b99bec15d92182662 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:42:46.530315 21335 raft_consensus.cc:729] T 67fec8fe103742f193a77e3cc81794ee P b9d22a3008d1419b99bec15d92182662 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d22a3008d1419b99bec15d92182662, State: Initialized, Role: FOLLOWER
I20260812 17:42:46.530210 21369 log.cc:1196] T 09df4e8a60f946e2b3025bf9c12b2b4c P b9d22a3008d1419b99bec15d92182662: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-2/wal/wals/09df4e8a60f946e2b3025bf9c12b2b4c
I20260812 17:42:46.530488 21335 consensus_queue.cc:260] T 67fec8fe103742f193a77e3cc81794ee P b9d22a3008d1419b99bec15d92182662 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "999f555d85d24dbfafce7efa54da39e8" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 36463 } } peers { permanent_uuid: "a3814529c7a6441b8170b45625b5211c" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 34425 } } peers { permanent_uuid: "b9d22a3008d1419b99bec15d92182662" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41941 } }
I20260812 17:42:46.530843 21335 ts_tablet_manager.cc:1428] T 67fec8fe103742f193a77e3cc81794ee P b9d22a3008d1419b99bec15d92182662: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260812 17:42:46.531261 21369 ts_tablet_manager.cc:1939] T 09df4e8a60f946e2b3025bf9c12b2b4c P b9d22a3008d1419b99bec15d92182662: Deleting consensus metadata
I20260812 17:42:46.532068 21336 tablet_bootstrap.cc:654] T 67fec8fe103742f193a77e3cc81794ee P a3814529c7a6441b8170b45625b5211c: Neither blocks nor log segments found. Creating new log.
I20260812 17:42:46.533352 20423 catalog_manager.cc:4841] TS b9d22a3008d1419b99bec15d92182662 (127.17.255.3:41941): tablet 09df4e8a60f946e2b3025bf9c12b2b4c (table test-table [id=656b286194e44385945e2c61eb1c5e44]) successfully deleted
I20260812 17:42:46.534214 21336 tablet_bootstrap.cc:492] T 67fec8fe103742f193a77e3cc81794ee P a3814529c7a6441b8170b45625b5211c: No bootstrap required, opened a new log
I20260812 17:42:46.534353 21336 ts_tablet_manager.cc:1397] T 67fec8fe103742f193a77e3cc81794ee P a3814529c7a6441b8170b45625b5211c: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260812 17:42:46.535346 21336 raft_consensus.cc:348] T 67fec8fe103742f193a77e3cc81794ee P a3814529c7a6441b8170b45625b5211c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "999f555d85d24dbfafce7efa54da39e8" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 36463 } } peers { permanent_uuid: "a3814529c7a6441b8170b45625b5211c" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 34425 } } peers { permanent_uuid: "b9d22a3008d1419b99bec15d92182662" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41941 } }
I20260812 17:42:46.535497 21336 raft_consensus.cc:374] T 67fec8fe103742f193a77e3cc81794ee P a3814529c7a6441b8170b45625b5211c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:42:46.535537 21336 raft_consensus.cc:729] T 67fec8fe103742f193a77e3cc81794ee P a3814529c7a6441b8170b45625b5211c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3814529c7a6441b8170b45625b5211c, State: Initialized, Role: FOLLOWER
I20260812 17:42:46.535622 21334 tablet_bootstrap.cc:492] T 67fec8fe103742f193a77e3cc81794ee P 999f555d85d24dbfafce7efa54da39e8: No bootstrap required, opened a new log
I20260812 17:42:46.535730 21334 ts_tablet_manager.cc:1397] T 67fec8fe103742f193a77e3cc81794ee P 999f555d85d24dbfafce7efa54da39e8: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20260812 17:42:46.535702 21336 consensus_queue.cc:260] T 67fec8fe103742f193a77e3cc81794ee P a3814529c7a6441b8170b45625b5211c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "999f555d85d24dbfafce7efa54da39e8" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 36463 } } peers { permanent_uuid: "a3814529c7a6441b8170b45625b5211c" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 34425 } } peers { permanent_uuid: "b9d22a3008d1419b99bec15d92182662" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41941 } }
I20260812 17:42:46.536262 21336 ts_tablet_manager.cc:1428] T 67fec8fe103742f193a77e3cc81794ee P a3814529c7a6441b8170b45625b5211c: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260812 17:42:46.536552 21334 raft_consensus.cc:348] T 67fec8fe103742f193a77e3cc81794ee P 999f555d85d24dbfafce7efa54da39e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "999f555d85d24dbfafce7efa54da39e8" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 36463 } } peers { permanent_uuid: "a3814529c7a6441b8170b45625b5211c" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 34425 } } peers { permanent_uuid: "b9d22a3008d1419b99bec15d92182662" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41941 } }
I20260812 17:42:46.536747 21334 raft_consensus.cc:374] T 67fec8fe103742f193a77e3cc81794ee P 999f555d85d24dbfafce7efa54da39e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:42:46.536798 21334 raft_consensus.cc:729] T 67fec8fe103742f193a77e3cc81794ee P 999f555d85d24dbfafce7efa54da39e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 999f555d85d24dbfafce7efa54da39e8, State: Initialized, Role: FOLLOWER
I20260812 17:42:46.536959 21334 consensus_queue.cc:260] T 67fec8fe103742f193a77e3cc81794ee P 999f555d85d24dbfafce7efa54da39e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "999f555d85d24dbfafce7efa54da39e8" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 36463 } } peers { permanent_uuid: "a3814529c7a6441b8170b45625b5211c" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 34425 } } peers { permanent_uuid: "b9d22a3008d1419b99bec15d92182662" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41941 } }
I20260812 17:42:46.537375 21334 ts_tablet_manager.cc:1428] T 67fec8fe103742f193a77e3cc81794ee P 999f555d85d24dbfafce7efa54da39e8: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 17:42:46.687881 21345 raft_consensus.cc:482] T 67fec8fe103742f193a77e3cc81794ee P a3814529c7a6441b8170b45625b5211c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:42:46.688128 21345 raft_consensus.cc:504] T 67fec8fe103742f193a77e3cc81794ee P a3814529c7a6441b8170b45625b5211c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "999f555d85d24dbfafce7efa54da39e8" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 36463 } } peers { permanent_uuid: "a3814529c7a6441b8170b45625b5211c" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 34425 } } peers { permanent_uuid: "b9d22a3008d1419b99bec15d92182662" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41941 } }
I20260812 17:42:46.689390 21345 leader_election.cc:288] T 67fec8fe103742f193a77e3cc81794ee P a3814529c7a6441b8170b45625b5211c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 999f555d85d24dbfafce7efa54da39e8 (127.17.255.1:36463), b9d22a3008d1419b99bec15d92182662 (127.17.255.3:41941)
I20260812 17:42:46.695552 21328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:46.689821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:34545 (local address 127.17.255.3:41941)
0812 17:42:46.690072 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:46.690078 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:46.690264 (+ 186us) server_negotiation.cc:407] Connection header received
0812 17:42:46.690595 (+ 331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:46.690598 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:46.690643 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:46.690729 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:42:46.691293 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.691815 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.693667 (+ 1852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.694350 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.694540 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:46.694675 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:46.695298 (+ 623us) server_negotiation.cc:299] Negotiation successful
0812 17:42:46.695397 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154}
I20260812 17:42:46.695801 21379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:46.689678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.3:41941 (local address 127.17.255.2:34545)
0812 17:42:46.690094 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:46.690112 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:46.690409 (+ 297us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:46.690837 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:46.690840 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:46.690855 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:42:46.691119 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:46.691130 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.691949 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.691952 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:46.693499 (+ 1547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:46.693512 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.694676 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.694681 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:46.694908 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:46.694934 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 17:42:46.695277 (+ 343us) client_negotiation.cc:240] Negotiation successful
0812 17:42:46.695384 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":347,"spinlock_wait_cycles":87680,"thread_start_us":111,"threads_started":1}
I20260812 17:42:46.696213 21325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:46.690236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:56357 (local address 127.17.255.1:36463)
0812 17:42:46.690470 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:46.690475 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:46.690492 (+ 17us) server_negotiation.cc:407] Connection header received
0812 17:42:46.690553 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:46.690556 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:46.690620 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:46.690710 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:42:46.691219 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.692416 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.694080 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.694707 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.694885 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:46.694956 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:46.695543 (+ 587us) server_negotiation.cc:299] Negotiation successful
0812 17:42:46.695710 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260812 17:42:46.696554 21380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:46.689697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:36463 (local address 127.17.255.2:56357)
0812 17:42:46.690213 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:46.690233 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:46.690409 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:46.690741 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:46.690744 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:46.690763 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:42:46.691050 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:46.691068 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.692602 (+ 1534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.692606 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:46.693937 (+ 1331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:46.693946 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.694916 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.694920 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:46.695250 (+ 330us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:46.695305 (+ 55us) client_negotiation.cc:769] Sending connection context
0812 17:42:46.696210 (+ 905us) client_negotiation.cc:240] Negotiation successful
0812 17:42:46.696310 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":428,"spinlock_wait_cycles":27648,"thread_start_us":108,"threads_started":1}
I20260812 17:42:46.696619 21199 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67fec8fe103742f193a77e3cc81794ee" candidate_uuid: "a3814529c7a6441b8170b45625b5211c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d22a3008d1419b99bec15d92182662" is_pre_election: true
I20260812 17:42:46.696990 21199 raft_consensus.cc:2454] T 67fec8fe103742f193a77e3cc81794ee P b9d22a3008d1419b99bec15d92182662 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3814529c7a6441b8170b45625b5211c in term 0.
I20260812 17:42:46.697569 20726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67fec8fe103742f193a77e3cc81794ee" candidate_uuid: "a3814529c7a6441b8170b45625b5211c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "999f555d85d24dbfafce7efa54da39e8" is_pre_election: true
I20260812 17:42:46.697901 20726 raft_consensus.cc:2454] T 67fec8fe103742f193a77e3cc81794ee P 999f555d85d24dbfafce7efa54da39e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3814529c7a6441b8170b45625b5211c in term 0.
I20260812 17:42:46.697896 20862 leader_election.cc:302] T 67fec8fe103742f193a77e3cc81794ee P a3814529c7a6441b8170b45625b5211c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a3814529c7a6441b8170b45625b5211c, b9d22a3008d1419b99bec15d92182662; no voters:
I20260812 17:42:46.698299 21345 raft_consensus.cc:2781] T 67fec8fe103742f193a77e3cc81794ee P a3814529c7a6441b8170b45625b5211c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 17:42:46.698436 21345 raft_consensus.cc:482] T 67fec8fe103742f193a77e3cc81794ee P a3814529c7a6441b8170b45625b5211c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 17:42:46.698498 21345 raft_consensus.cc:3037] T 67fec8fe103742f193a77e3cc81794ee P a3814529c7a6441b8170b45625b5211c [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:42:46.699895 21345 raft_consensus.cc:504] T 67fec8fe103742f193a77e3cc81794ee P a3814529c7a6441b8170b45625b5211c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "999f555d85d24dbfafce7efa54da39e8" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 36463 } } peers { permanent_uuid: "a3814529c7a6441b8170b45625b5211c" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 34425 } } peers { permanent_uuid: "b9d22a3008d1419b99bec15d92182662" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41941 } }
I20260812 17:42:46.700341 21345 leader_election.cc:288] T 67fec8fe103742f193a77e3cc81794ee P a3814529c7a6441b8170b45625b5211c [CANDIDATE]: Term 1 election: Requested vote from peers 999f555d85d24dbfafce7efa54da39e8 (127.17.255.1:36463), b9d22a3008d1419b99bec15d92182662 (127.17.255.3:41941)
I20260812 17:42:46.700768 21199 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67fec8fe103742f193a77e3cc81794ee" candidate_uuid: "a3814529c7a6441b8170b45625b5211c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d22a3008d1419b99bec15d92182662"
I20260812 17:42:46.700947 21199 raft_consensus.cc:3037] T 67fec8fe103742f193a77e3cc81794ee P b9d22a3008d1419b99bec15d92182662 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:42:46.700924 20726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67fec8fe103742f193a77e3cc81794ee" candidate_uuid: "a3814529c7a6441b8170b45625b5211c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "999f555d85d24dbfafce7efa54da39e8"
I20260812 17:42:46.701058 20726 raft_consensus.cc:3037] T 67fec8fe103742f193a77e3cc81794ee P 999f555d85d24dbfafce7efa54da39e8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:42:46.702704 21199 raft_consensus.cc:2454] T 67fec8fe103742f193a77e3cc81794ee P b9d22a3008d1419b99bec15d92182662 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3814529c7a6441b8170b45625b5211c in term 1.
I20260812 17:42:46.702688 20726 raft_consensus.cc:2454] T 67fec8fe103742f193a77e3cc81794ee P 999f555d85d24dbfafce7efa54da39e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3814529c7a6441b8170b45625b5211c in term 1.
I20260812 17:42:46.703078 20862 leader_election.cc:302] T 67fec8fe103742f193a77e3cc81794ee P a3814529c7a6441b8170b45625b5211c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a3814529c7a6441b8170b45625b5211c, b9d22a3008d1419b99bec15d92182662; no voters:
I20260812 17:42:46.703306 21345 raft_consensus.cc:2781] T 67fec8fe103742f193a77e3cc81794ee P a3814529c7a6441b8170b45625b5211c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:42:46.703577 21345 raft_consensus.cc:686] T 67fec8fe103742f193a77e3cc81794ee P a3814529c7a6441b8170b45625b5211c [term 1 LEADER]: Becoming Leader. State: Replica: a3814529c7a6441b8170b45625b5211c, State: Running, Role: LEADER
I20260812 17:42:46.703907 21345 consensus_queue.cc:237] T 67fec8fe103742f193a77e3cc81794ee P a3814529c7a6441b8170b45625b5211c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "999f555d85d24dbfafce7efa54da39e8" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 36463 } } peers { permanent_uuid: "a3814529c7a6441b8170b45625b5211c" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 34425 } } peers { permanent_uuid: "b9d22a3008d1419b99bec15d92182662" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41941 } }
I20260812 17:42:46.706362 20447 catalog_manager.cc:5495] T 67fec8fe103742f193a77e3cc81794ee P a3814529c7a6441b8170b45625b5211c reported cstate change: term changed from 0 to 1, leader changed from <none> to a3814529c7a6441b8170b45625b5211c (127.17.255.2). New cstate: current_term: 1 leader_uuid: "a3814529c7a6441b8170b45625b5211c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "999f555d85d24dbfafce7efa54da39e8" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 36463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3814529c7a6441b8170b45625b5211c" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 34425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9d22a3008d1419b99bec15d92182662" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41941 } health_report { overall_health: UNKNOWN } } }
W20260812 17:42:46.739538 20813 tablet.cc:2369] T 67fec8fe103742f193a77e3cc81794ee P 999f555d85d24dbfafce7efa54da39e8: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 12 17:42:46 dist-test-slave-tk9z krb5kdc[20360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556565, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:42:46.775326 21395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:46.764671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:39007 (local address 127.0.0.1:39210)
0812 17:42:46.765125 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:46.765138 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:46.765267 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:46.765585 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:46.765588 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:46.766077 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:42:46.766551 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:46.766570 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.767507 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.767510 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:46.768124 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:46.768133 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.768658 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.768661 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:46.768729 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:46.769474 (+ 745us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:42:46.769487 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:42:46.771188 (+ 1701us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:42:46.773441 (+ 2253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:46.773454 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:46.773461 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:46.773826 (+ 365us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:46.774153 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:46.774156 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:46.774157 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:46.774282 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:46.774800 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:42:46.774809 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:42:46.774927 (+ 118us) client_negotiation.cc:769] Sending connection context
0812 17:42:46.775028 (+ 101us) client_negotiation.cc:240] Negotiation successful
0812 17:42:46.775154 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":223,"threads_started":1}
I20260812 17:42:46.775329 20536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:46.764753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39210 (local address 127.17.255.62:39007)
0812 17:42:46.764973 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:46.764980 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:46.765279 (+ 299us) server_negotiation.cc:407] Connection header received
0812 17:42:46.765370 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:46.765372 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:46.765419 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:46.765510 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:42:46.766779 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.767316 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.768259 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.768487 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.768636 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:46.771352 (+ 2716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:42:46.771356 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:42:46.771359 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:42:46.771386 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:42:46.773296 (+ 1910us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:46.773950 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:46.773953 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:46.773955 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:46.774045 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:46.774480 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:46.774483 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:46.774485 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:46.774690 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:42:46.774777 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:46.775102 (+ 325us) server_negotiation.cc:299] Negotiation successful
0812 17:42:46.775209 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 17:42:46.780295 20447 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:39210:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 17:42:46.781286 20447 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 17:42:46.787390 20689 tablet_service.cc:1467] Processing CreateTablet for tablet d44d558927e844bfbd7374d464dff5bf (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=45e7b9bc250e4cb597769e9d7a8577d3]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 17:42:46.787613 21151 tablet_service.cc:1467] Processing CreateTablet for tablet d44d558927e844bfbd7374d464dff5bf (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=45e7b9bc250e4cb597769e9d7a8577d3]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 17:42:46.787560 20938 tablet_service.cc:1467] Processing CreateTablet for tablet d44d558927e844bfbd7374d464dff5bf (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=45e7b9bc250e4cb597769e9d7a8577d3]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 17:42:46.787853 20689 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d44d558927e844bfbd7374d464dff5bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:42:46.787997 20938 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d44d558927e844bfbd7374d464dff5bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:42:46.787997 21151 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d44d558927e844bfbd7374d464dff5bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:42:46.790815 21334 tablet_bootstrap.cc:492] T d44d558927e844bfbd7374d464dff5bf P 999f555d85d24dbfafce7efa54da39e8: Bootstrap starting.
I20260812 17:42:46.791546 21335 tablet_bootstrap.cc:492] T d44d558927e844bfbd7374d464dff5bf P b9d22a3008d1419b99bec15d92182662: Bootstrap starting.
I20260812 17:42:46.791801 21334 tablet_bootstrap.cc:654] T d44d558927e844bfbd7374d464dff5bf P 999f555d85d24dbfafce7efa54da39e8: Neither blocks nor log segments found. Creating new log.
I20260812 17:42:46.792965 21336 tablet_bootstrap.cc:492] T d44d558927e844bfbd7374d464dff5bf P a3814529c7a6441b8170b45625b5211c: Bootstrap starting.
I20260812 17:42:46.793196 21334 tablet_bootstrap.cc:492] T d44d558927e844bfbd7374d464dff5bf P 999f555d85d24dbfafce7efa54da39e8: No bootstrap required, opened a new log
I20260812 17:42:46.793237 21335 tablet_bootstrap.cc:654] T d44d558927e844bfbd7374d464dff5bf P b9d22a3008d1419b99bec15d92182662: Neither blocks nor log segments found. Creating new log.
I20260812 17:42:46.793285 21334 ts_tablet_manager.cc:1397] T d44d558927e844bfbd7374d464dff5bf P 999f555d85d24dbfafce7efa54da39e8: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 17:42:46.794040 21334 raft_consensus.cc:348] T d44d558927e844bfbd7374d464dff5bf P 999f555d85d24dbfafce7efa54da39e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "999f555d85d24dbfafce7efa54da39e8" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 36463 } } peers { permanent_uuid: "a3814529c7a6441b8170b45625b5211c" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 34425 } } peers { permanent_uuid: "b9d22a3008d1419b99bec15d92182662" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41941 } }
I20260812 17:42:46.794278 21334 raft_consensus.cc:374] T d44d558927e844bfbd7374d464dff5bf P 999f555d85d24dbfafce7efa54da39e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:42:46.794324 21334 raft_consensus.cc:729] T d44d558927e844bfbd7374d464dff5bf P 999f555d85d24dbfafce7efa54da39e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 999f555d85d24dbfafce7efa54da39e8, State: Initialized, Role: FOLLOWER
I20260812 17:42:46.794554 21334 consensus_queue.cc:260] T d44d558927e844bfbd7374d464dff5bf P 999f555d85d24dbfafce7efa54da39e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "999f555d85d24dbfafce7efa54da39e8" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 36463 } } peers { permanent_uuid: "a3814529c7a6441b8170b45625b5211c" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 34425 } } peers { permanent_uuid: "b9d22a3008d1419b99bec15d92182662" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41941 } }
I20260812 17:42:46.794785 21336 tablet_bootstrap.cc:654] T d44d558927e844bfbd7374d464dff5bf P a3814529c7a6441b8170b45625b5211c: Neither blocks nor log segments found. Creating new log.
I20260812 17:42:46.794909 21334 ts_tablet_manager.cc:1428] T d44d558927e844bfbd7374d464dff5bf P 999f555d85d24dbfafce7efa54da39e8: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260812 17:42:46.795279 21335 tablet_bootstrap.cc:492] T d44d558927e844bfbd7374d464dff5bf P b9d22a3008d1419b99bec15d92182662: No bootstrap required, opened a new log
I20260812 17:42:46.795424 21335 ts_tablet_manager.cc:1397] T d44d558927e844bfbd7374d464dff5bf P b9d22a3008d1419b99bec15d92182662: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260812 17:42:46.796191 21335 raft_consensus.cc:348] T d44d558927e844bfbd7374d464dff5bf P b9d22a3008d1419b99bec15d92182662 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "999f555d85d24dbfafce7efa54da39e8" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 36463 } } peers { permanent_uuid: "a3814529c7a6441b8170b45625b5211c" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 34425 } } peers { permanent_uuid: "b9d22a3008d1419b99bec15d92182662" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41941 } }
I20260812 17:42:46.796317 21335 raft_consensus.cc:374] T d44d558927e844bfbd7374d464dff5bf P b9d22a3008d1419b99bec15d92182662 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:42:46.796355 21335 raft_consensus.cc:729] T d44d558927e844bfbd7374d464dff5bf P b9d22a3008d1419b99bec15d92182662 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d22a3008d1419b99bec15d92182662, State: Initialized, Role: FOLLOWER
I20260812 17:42:46.796234 21363 tablet_replica.cc:439] T d44d558927e844bfbd7374d464dff5bf P 999f555d85d24dbfafce7efa54da39e8: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "999f555d85d24dbfafce7efa54da39e8" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 36463 } } peers { permanent_uuid: "a3814529c7a6441b8170b45625b5211c" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 34425 } } peers { permanent_uuid: "b9d22a3008d1419b99bec15d92182662" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41941 } } }
I20260812 17:42:46.796486 21363 tablet_replica.cc:442] T d44d558927e844bfbd7374d464dff5bf P 999f555d85d24dbfafce7efa54da39e8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 17:42:46.796489 21335 consensus_queue.cc:260] T d44d558927e844bfbd7374d464dff5bf P b9d22a3008d1419b99bec15d92182662 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "999f555d85d24dbfafce7efa54da39e8" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 36463 } } peers { permanent_uuid: "a3814529c7a6441b8170b45625b5211c" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 34425 } } peers { permanent_uuid: "b9d22a3008d1419b99bec15d92182662" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41941 } }
I20260812 17:42:46.796793 21335 ts_tablet_manager.cc:1428] T d44d558927e844bfbd7374d464dff5bf P b9d22a3008d1419b99bec15d92182662: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260812 17:42:46.796815 21341 tablet_replica.cc:439] T d44d558927e844bfbd7374d464dff5bf P b9d22a3008d1419b99bec15d92182662: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "999f555d85d24dbfafce7efa54da39e8" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 36463 } } peers { permanent_uuid: "a3814529c7a6441b8170b45625b5211c" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 34425 } } peers { permanent_uuid: "b9d22a3008d1419b99bec15d92182662" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41941 } } }
I20260812 17:42:46.797230 21341 tablet_replica.cc:442] T d44d558927e844bfbd7374d464dff5bf P b9d22a3008d1419b99bec15d92182662: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 17:42:46.797546 21336 tablet_bootstrap.cc:492] T d44d558927e844bfbd7374d464dff5bf P a3814529c7a6441b8170b45625b5211c: No bootstrap required, opened a new log
I20260812 17:42:46.797658 21336 ts_tablet_manager.cc:1397] T d44d558927e844bfbd7374d464dff5bf P a3814529c7a6441b8170b45625b5211c: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.001s
I20260812 17:42:46.798388 21336 raft_consensus.cc:348] T d44d558927e844bfbd7374d464dff5bf P a3814529c7a6441b8170b45625b5211c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "999f555d85d24dbfafce7efa54da39e8" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 36463 } } peers { permanent_uuid: "a3814529c7a6441b8170b45625b5211c" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 34425 } } peers { permanent_uuid: "b9d22a3008d1419b99bec15d92182662" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41941 } }
I20260812 17:42:46.798538 21336 raft_consensus.cc:374] T d44d558927e844bfbd7374d464dff5bf P a3814529c7a6441b8170b45625b5211c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:42:46.798580 21336 raft_consensus.cc:729] T d44d558927e844bfbd7374d464dff5bf P a3814529c7a6441b8170b45625b5211c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3814529c7a6441b8170b45625b5211c, State: Initialized, Role: FOLLOWER
I20260812 17:42:46.798722 21336 consensus_queue.cc:260] T d44d558927e844bfbd7374d464dff5bf P a3814529c7a6441b8170b45625b5211c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "999f555d85d24dbfafce7efa54da39e8" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 36463 } } peers { permanent_uuid: "a3814529c7a6441b8170b45625b5211c" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 34425 } } peers { permanent_uuid: "b9d22a3008d1419b99bec15d92182662" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41941 } }
I20260812 17:42:46.799029 21336 ts_tablet_manager.cc:1428] T d44d558927e844bfbd7374d464dff5bf P a3814529c7a6441b8170b45625b5211c: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260812 17:42:46.799239 21345 tablet_replica.cc:439] T d44d558927e844bfbd7374d464dff5bf P a3814529c7a6441b8170b45625b5211c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "999f555d85d24dbfafce7efa54da39e8" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 36463 } } peers { permanent_uuid: "a3814529c7a6441b8170b45625b5211c" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 34425 } } peers { permanent_uuid: "b9d22a3008d1419b99bec15d92182662" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41941 } } }
I20260812 17:42:46.799394 21345 tablet_replica.cc:442] T d44d558927e844bfbd7374d464dff5bf P a3814529c7a6441b8170b45625b5211c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 17:42:46.886763 21363 raft_consensus.cc:482] T d44d558927e844bfbd7374d464dff5bf P 999f555d85d24dbfafce7efa54da39e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:42:46.886942 21363 raft_consensus.cc:504] T d44d558927e844bfbd7374d464dff5bf P 999f555d85d24dbfafce7efa54da39e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "999f555d85d24dbfafce7efa54da39e8" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 36463 } } peers { permanent_uuid: "a3814529c7a6441b8170b45625b5211c" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 34425 } } peers { permanent_uuid: "b9d22a3008d1419b99bec15d92182662" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41941 } }
I20260812 17:42:46.887480 21363 leader_election.cc:288] T d44d558927e844bfbd7374d464dff5bf P 999f555d85d24dbfafce7efa54da39e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3814529c7a6441b8170b45625b5211c (127.17.255.2:34425), b9d22a3008d1419b99bec15d92182662 (127.17.255.3:41941)
I20260812 17:42:46.888181 21199 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d44d558927e844bfbd7374d464dff5bf" candidate_uuid: "999f555d85d24dbfafce7efa54da39e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d22a3008d1419b99bec15d92182662" is_pre_election: true
I20260812 17:42:46.888338 20970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d44d558927e844bfbd7374d464dff5bf" candidate_uuid: "999f555d85d24dbfafce7efa54da39e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3814529c7a6441b8170b45625b5211c" is_pre_election: true
I20260812 17:42:46.888449 21199 raft_consensus.cc:2454] T d44d558927e844bfbd7374d464dff5bf P b9d22a3008d1419b99bec15d92182662 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 999f555d85d24dbfafce7efa54da39e8 in term 0.
I20260812 17:42:46.888497 20970 raft_consensus.cc:2454] T d44d558927e844bfbd7374d464dff5bf P a3814529c7a6441b8170b45625b5211c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 999f555d85d24dbfafce7efa54da39e8 in term 0.
I20260812 17:42:46.888928 20613 leader_election.cc:302] T d44d558927e844bfbd7374d464dff5bf P 999f555d85d24dbfafce7efa54da39e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 999f555d85d24dbfafce7efa54da39e8, a3814529c7a6441b8170b45625b5211c, b9d22a3008d1419b99bec15d92182662; no voters:
I20260812 17:42:46.889241 21363 raft_consensus.cc:2781] T d44d558927e844bfbd7374d464dff5bf P 999f555d85d24dbfafce7efa54da39e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 17:42:46.889340 21363 raft_consensus.cc:482] T d44d558927e844bfbd7374d464dff5bf P 999f555d85d24dbfafce7efa54da39e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 17:42:46.889393 21363 raft_consensus.cc:3037] T d44d558927e844bfbd7374d464dff5bf P 999f555d85d24dbfafce7efa54da39e8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:42:46.890735 21363 raft_consensus.cc:504] T d44d558927e844bfbd7374d464dff5bf P 999f555d85d24dbfafce7efa54da39e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "999f555d85d24dbfafce7efa54da39e8" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 36463 } } peers { permanent_uuid: "a3814529c7a6441b8170b45625b5211c" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 34425 } } peers { permanent_uuid: "b9d22a3008d1419b99bec15d92182662" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41941 } }
I20260812 17:42:46.891188 21363 leader_election.cc:288] T d44d558927e844bfbd7374d464dff5bf P 999f555d85d24dbfafce7efa54da39e8 [CANDIDATE]: Term 1 election: Requested vote from peers a3814529c7a6441b8170b45625b5211c (127.17.255.2:34425), b9d22a3008d1419b99bec15d92182662 (127.17.255.3:41941)
I20260812 17:42:46.891650 20970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d44d558927e844bfbd7374d464dff5bf" candidate_uuid: "999f555d85d24dbfafce7efa54da39e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3814529c7a6441b8170b45625b5211c"
I20260812 17:42:46.891702 21199 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d44d558927e844bfbd7374d464dff5bf" candidate_uuid: "999f555d85d24dbfafce7efa54da39e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d22a3008d1419b99bec15d92182662"
I20260812 17:42:46.891827 21199 raft_consensus.cc:3037] T d44d558927e844bfbd7374d464dff5bf P b9d22a3008d1419b99bec15d92182662 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:42:46.891829 20970 raft_consensus.cc:3037] T d44d558927e844bfbd7374d464dff5bf P a3814529c7a6441b8170b45625b5211c [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:42:46.893268 21199 raft_consensus.cc:2454] T d44d558927e844bfbd7374d464dff5bf P b9d22a3008d1419b99bec15d92182662 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 999f555d85d24dbfafce7efa54da39e8 in term 1.
I20260812 17:42:46.893606 20970 raft_consensus.cc:2454] T d44d558927e844bfbd7374d464dff5bf P a3814529c7a6441b8170b45625b5211c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 999f555d85d24dbfafce7efa54da39e8 in term 1.
I20260812 17:42:46.893716 20614 leader_election.cc:302] T d44d558927e844bfbd7374d464dff5bf P 999f555d85d24dbfafce7efa54da39e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 999f555d85d24dbfafce7efa54da39e8, b9d22a3008d1419b99bec15d92182662; no voters:
I20260812 17:42:46.894073 21363 raft_consensus.cc:2781] T d44d558927e844bfbd7374d464dff5bf P 999f555d85d24dbfafce7efa54da39e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:42:46.894199 21363 raft_consensus.cc:686] T d44d558927e844bfbd7374d464dff5bf P 999f555d85d24dbfafce7efa54da39e8 [term 1 LEADER]: Becoming Leader. State: Replica: 999f555d85d24dbfafce7efa54da39e8, State: Running, Role: LEADER
I20260812 17:42:46.894459 21363 consensus_queue.cc:237] T d44d558927e844bfbd7374d464dff5bf P 999f555d85d24dbfafce7efa54da39e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "999f555d85d24dbfafce7efa54da39e8" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 36463 } } peers { permanent_uuid: "a3814529c7a6441b8170b45625b5211c" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 34425 } } peers { permanent_uuid: "b9d22a3008d1419b99bec15d92182662" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41941 } }
I20260812 17:42:46.895749 21350 tablet_replica.cc:439] T d44d558927e844bfbd7374d464dff5bf P 999f555d85d24dbfafce7efa54da39e8: TxnStatusTablet state changed. Reason: New leader 999f555d85d24dbfafce7efa54da39e8. Latest consensus state: current_term: 1 leader_uuid: "999f555d85d24dbfafce7efa54da39e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "999f555d85d24dbfafce7efa54da39e8" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 36463 } } peers { permanent_uuid: "a3814529c7a6441b8170b45625b5211c" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 34425 } } peers { permanent_uuid: "b9d22a3008d1419b99bec15d92182662" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41941 } } }
I20260812 17:42:46.895949 21350 tablet_replica.cc:442] T d44d558927e844bfbd7374d464dff5bf P 999f555d85d24dbfafce7efa54da39e8: This TxnStatusTablet replica's current role is: LEADER
I20260812 17:42:46.896414 21405 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 17:42:46.896651 21405 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 17:42:46.897138 20446 catalog_manager.cc:5495] T d44d558927e844bfbd7374d464dff5bf P 999f555d85d24dbfafce7efa54da39e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 999f555d85d24dbfafce7efa54da39e8 (127.17.255.1). New cstate: current_term: 1 leader_uuid: "999f555d85d24dbfafce7efa54da39e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "999f555d85d24dbfafce7efa54da39e8" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 36463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3814529c7a6441b8170b45625b5211c" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 34425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9d22a3008d1419b99bec15d92182662" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41941 } health_report { overall_health: UNKNOWN } } }
I20260812 17:42:46.926718 21325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:46.922961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53406 (local address 127.17.255.1:36463)
0812 17:42:46.923122 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:46.923127 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:46.923274 (+ 147us) server_negotiation.cc:407] Connection header received
0812 17:42:46.923530 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:46.923536 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:46.923593 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:46.923679 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:42:46.923948 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.924465 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.925508 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.925733 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.925849 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:46.926153 (+ 304us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:42:46.926266 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:42:46.926353 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:46.926505 (+ 152us) server_negotiation.cc:299] Negotiation successful
0812 17:42:46.926564 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 17:42:46.926718 21395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:46.922851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:36463 (local address 127.0.0.1:53406)
0812 17:42:46.923197 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:46.923210 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:46.923398 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:46.923705 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:46.923708 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:46.923716 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 17:42:46.923837 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:46.923843 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.924580 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.924584 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:46.925373 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:46.925390 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.925852 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.925856 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:46.925947 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:46.926007 (+ 60us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 17:42:46.926396 (+ 389us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 17:42:46.926420 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 17:42:46.926481 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 17:42:46.926573 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225}
I20260812 17:42:46.930022 20970 raft_consensus.cc:1261] T d44d558927e844bfbd7374d464dff5bf P a3814529c7a6441b8170b45625b5211c [term 1 FOLLOWER]: Refusing update from remote peer 999f555d85d24dbfafce7efa54da39e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:42:46.930029 21199 raft_consensus.cc:1261] T d44d558927e844bfbd7374d464dff5bf P b9d22a3008d1419b99bec15d92182662 [term 1 FOLLOWER]: Refusing update from remote peer 999f555d85d24dbfafce7efa54da39e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:42:46.930511 21350 consensus_queue.cc:1035] T d44d558927e844bfbd7374d464dff5bf P 999f555d85d24dbfafce7efa54da39e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d22a3008d1419b99bec15d92182662" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:42:46.930668 21363 consensus_queue.cc:1035] T d44d558927e844bfbd7374d464dff5bf P 999f555d85d24dbfafce7efa54da39e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3814529c7a6441b8170b45625b5211c" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 34425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:42:46.932221 21345 tablet_replica.cc:439] T d44d558927e844bfbd7374d464dff5bf P a3814529c7a6441b8170b45625b5211c: TxnStatusTablet state changed. Reason: New leader 999f555d85d24dbfafce7efa54da39e8. Latest consensus state: current_term: 1 leader_uuid: "999f555d85d24dbfafce7efa54da39e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "999f555d85d24dbfafce7efa54da39e8" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 36463 } } peers { permanent_uuid: "a3814529c7a6441b8170b45625b5211c" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 34425 } } peers { permanent_uuid: "b9d22a3008d1419b99bec15d92182662" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41941 } } }
I20260812 17:42:46.932361 21345 tablet_replica.cc:442] T d44d558927e844bfbd7374d464dff5bf P a3814529c7a6441b8170b45625b5211c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 17:42:46.932492 21341 tablet_replica.cc:439] T d44d558927e844bfbd7374d464dff5bf P b9d22a3008d1419b99bec15d92182662: TxnStatusTablet state changed. Reason: New leader 999f555d85d24dbfafce7efa54da39e8. Latest consensus state: current_term: 1 leader_uuid: "999f555d85d24dbfafce7efa54da39e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "999f555d85d24dbfafce7efa54da39e8" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 36463 } } peers { permanent_uuid: "a3814529c7a6441b8170b45625b5211c" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 34425 } } peers { permanent_uuid: "b9d22a3008d1419b99bec15d92182662" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41941 } } }
I20260812 17:42:46.932611 21341 tablet_replica.cc:442] T d44d558927e844bfbd7374d464dff5bf P b9d22a3008d1419b99bec15d92182662: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 17:42:46.935143 21363 tablet_replica.cc:439] T d44d558927e844bfbd7374d464dff5bf P 999f555d85d24dbfafce7efa54da39e8: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "999f555d85d24dbfafce7efa54da39e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "999f555d85d24dbfafce7efa54da39e8" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 36463 } } peers { permanent_uuid: "a3814529c7a6441b8170b45625b5211c" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 34425 } } peers { permanent_uuid: "b9d22a3008d1419b99bec15d92182662" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41941 } } }
I20260812 17:42:46.935271 21363 tablet_replica.cc:442] T d44d558927e844bfbd7374d464dff5bf P 999f555d85d24dbfafce7efa54da39e8: This TxnStatusTablet replica's current role is: LEADER
I20260812 17:42:46.936103 21345 tablet_replica.cc:439] T d44d558927e844bfbd7374d464dff5bf P a3814529c7a6441b8170b45625b5211c: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "999f555d85d24dbfafce7efa54da39e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "999f555d85d24dbfafce7efa54da39e8" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 36463 } } peers { permanent_uuid: "a3814529c7a6441b8170b45625b5211c" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 34425 } } peers { permanent_uuid: "b9d22a3008d1419b99bec15d92182662" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41941 } } }
I20260812 17:42:46.936223 21345 tablet_replica.cc:442] T d44d558927e844bfbd7374d464dff5bf P a3814529c7a6441b8170b45625b5211c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 17:42:46.939179 21350 tablet_replica.cc:439] T d44d558927e844bfbd7374d464dff5bf P 999f555d85d24dbfafce7efa54da39e8: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "999f555d85d24dbfafce7efa54da39e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "999f555d85d24dbfafce7efa54da39e8" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 36463 } } peers { permanent_uuid: "a3814529c7a6441b8170b45625b5211c" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 34425 } } peers { permanent_uuid: "b9d22a3008d1419b99bec15d92182662" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41941 } } }
I20260812 17:42:46.939301 21350 tablet_replica.cc:442] T d44d558927e844bfbd7374d464dff5bf P 999f555d85d24dbfafce7efa54da39e8: This TxnStatusTablet replica's current role is: LEADER
I20260812 17:42:46.939836 21341 tablet_replica.cc:439] T d44d558927e844bfbd7374d464dff5bf P b9d22a3008d1419b99bec15d92182662: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "999f555d85d24dbfafce7efa54da39e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "999f555d85d24dbfafce7efa54da39e8" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 36463 } } peers { permanent_uuid: "a3814529c7a6441b8170b45625b5211c" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 34425 } } peers { permanent_uuid: "b9d22a3008d1419b99bec15d92182662" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41941 } } }
I20260812 17:42:46.939966 21341 tablet_replica.cc:442] T d44d558927e844bfbd7374d464dff5bf P b9d22a3008d1419b99bec15d92182662: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 17:42:46.946326 21414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:46.941924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49672 (local address 127.17.255.2:34425)
0812 17:42:46.942432 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:46.942470 (+ 38us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:46.942483 (+ 13us) server_negotiation.cc:407] Connection header received
0812 17:42:46.942556 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:46.942559 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:46.942612 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:46.942739 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:42:46.943052 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.943646 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.944818 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.945057 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.945140 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:46.945421 (+ 281us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:42:46.945919 (+ 498us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:42:46.946011 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:46.946108 (+ 97us) server_negotiation.cc:299] Negotiation successful
0812 17:42:46.946156 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":189,"threads_started":1}
I20260812 17:42:46.960556 21325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:46.955961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:41799 (local address 127.17.255.1:36463)
0812 17:42:46.956142 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:46.956147 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:46.956469 (+ 322us) server_negotiation.cc:407] Connection header received
0812 17:42:46.956643 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:46.956646 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:46.956701 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:46.956787 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:42:46.957255 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.957765 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.959385 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.959628 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.959726 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:46.960095 (+ 369us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:42:46.960178 (+ 83us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:42:46.960240 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:46.960371 (+ 131us) server_negotiation.cc:299] Negotiation successful
0812 17:42:46.960431 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 17:42:46.961046 21422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:46.955706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:36463 (local address 127.17.255.2:41799)
0812 17:42:46.956335 (+ 629us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:46.956352 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:46.956489 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:46.956823 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:46.956826 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:46.956835 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 17:42:46.957105 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:46.957114 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.957889 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.957893 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:46.959232 (+ 1339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:46.959246 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:46.959755 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:46.959759 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:46.959862 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:46.959937 (+ 75us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 17:42:46.960266 (+ 329us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 17:42:46.960273 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 17:42:46.960340 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 17:42:46.960429 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":244,"threads_started":1}
I20260812 17:42:46.969573 21199 raft_consensus.cc:1261] T 67fec8fe103742f193a77e3cc81794ee P b9d22a3008d1419b99bec15d92182662 [term 1 FOLLOWER]: Refusing update from remote peer a3814529c7a6441b8170b45625b5211c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:42:46.969801 20726 raft_consensus.cc:1261] T 67fec8fe103742f193a77e3cc81794ee P 999f555d85d24dbfafce7efa54da39e8 [term 1 FOLLOWER]: Refusing update from remote peer a3814529c7a6441b8170b45625b5211c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:42:46.970278 21383 consensus_queue.cc:1035] T 67fec8fe103742f193a77e3cc81794ee P a3814529c7a6441b8170b45625b5211c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d22a3008d1419b99bec15d92182662" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:42:46.970512 21345 consensus_queue.cc:1035] T 67fec8fe103742f193a77e3cc81794ee P a3814529c7a6441b8170b45625b5211c [LEADER]: Connected to new peer: Peer: permanent_uuid: "999f555d85d24dbfafce7efa54da39e8" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 36463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:42:46.974715 21354 mvcc.cc:205] Tried to move back new op lower bound from 7317735698301763584 to 7317735697222209536. Current Snapshot: MvccSnapshot[applied={T|T < 7317735698301763584}]
I20260812 17:42:46.980438 21353 mvcc.cc:205] Tried to move back new op lower bound from 7317735698301763584 to 7317735697222209536. Current Snapshot: MvccSnapshot[applied={T|T < 7317735698301763584}]
I20260812 17:42:47.008692 21414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:47.003578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:37155 (local address 127.17.255.2:34425)
0812 17:42:47.003988 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:47.003993 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:47.004391 (+ 398us) server_negotiation.cc:407] Connection header received
0812 17:42:47.004603 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:47.004607 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:47.004660 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:47.004705 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:42:47.005154 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:47.005923 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:47.007352 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:47.007721 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:47.007838 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:47.008189 (+ 351us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:42:47.008282 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:42:47.008354 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:47.008499 (+ 145us) server_negotiation.cc:299] Negotiation successful
0812 17:42:47.008559 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314}
I20260812 17:42:47.009524 21429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:47.003474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:34425 (local address 127.17.255.1:37155)
0812 17:42:47.004282 (+ 808us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:47.004299 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:47.004481 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:47.004846 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:47.004849 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:47.004857 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 17:42:47.005027 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:47.005035 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:47.006135 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:47.006138 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:47.007214 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:47.007227 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:47.007854 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:47.007859 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:47.007959 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:47.008027 (+ 68us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 17:42:47.008381 (+ 354us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 17:42:47.008389 (+ 8us) client_negotiation.cc:769] Sending connection context
0812 17:42:47.008465 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 17:42:47.009381 (+ 916us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":220,"threads_started":1}
I20260812 17:42:47.039276 20447 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39194:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:42:47.039549 20447 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39194:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:42:47.042773 20447 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9152398953ab47c6b332e0e97a99728b: Sending DeleteTablet for 3 replicas of tablet 67fec8fe103742f193a77e3cc81794ee
I20260812 17:42:47.043900 21151 tablet_service.cc:1514] Processing DeleteTablet for tablet 67fec8fe103742f193a77e3cc81794ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:42:47 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:43286
I20260812 17:42:47.044358 21439 tablet_replica.cc:330] T 67fec8fe103742f193a77e3cc81794ee P b9d22a3008d1419b99bec15d92182662: stopping tablet replica
I20260812 17:42:47.044574 21439 raft_consensus.cc:2229] T 67fec8fe103742f193a77e3cc81794ee P b9d22a3008d1419b99bec15d92182662 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:42:47.044710 21439 raft_consensus.cc:2258] T 67fec8fe103742f193a77e3cc81794ee P b9d22a3008d1419b99bec15d92182662 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:42:47.044787 20689 tablet_service.cc:1514] Processing DeleteTablet for tablet 67fec8fe103742f193a77e3cc81794ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:42:47 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:53378
I20260812 17:42:47.045351 21440 tablet_replica.cc:330] T 67fec8fe103742f193a77e3cc81794ee P 999f555d85d24dbfafce7efa54da39e8: stopping tablet replica
I20260812 17:42:47.045496 21440 raft_consensus.cc:2229] T 67fec8fe103742f193a77e3cc81794ee P 999f555d85d24dbfafce7efa54da39e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:42:47.045658 21440 raft_consensus.cc:2258] T 67fec8fe103742f193a77e3cc81794ee P 999f555d85d24dbfafce7efa54da39e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:42:47.046196 20938 tablet_service.cc:1514] Processing DeleteTablet for tablet 67fec8fe103742f193a77e3cc81794ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:42:47 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:49660
I20260812 17:42:47.046746 21440 ts_tablet_manager.cc:1905] T 67fec8fe103742f193a77e3cc81794ee P 999f555d85d24dbfafce7efa54da39e8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:42:47.048637 21439 ts_tablet_manager.cc:1905] T 67fec8fe103742f193a77e3cc81794ee P b9d22a3008d1419b99bec15d92182662: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:42:47.052742 21439 ts_tablet_manager.cc:1918] T 67fec8fe103742f193a77e3cc81794ee P b9d22a3008d1419b99bec15d92182662: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 17:42:47.052861 21439 log.cc:1196] T 67fec8fe103742f193a77e3cc81794ee P b9d22a3008d1419b99bec15d92182662: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-2/wal/wals/67fec8fe103742f193a77e3cc81794ee
I20260812 17:42:47.053151 21439 ts_tablet_manager.cc:1939] T 67fec8fe103742f193a77e3cc81794ee P b9d22a3008d1419b99bec15d92182662: Deleting consensus metadata
I20260812 17:42:47.054018 20423 catalog_manager.cc:4841] TS b9d22a3008d1419b99bec15d92182662 (127.17.255.3:41941): tablet 67fec8fe103742f193a77e3cc81794ee (table test-table [id=63fb6d9036ed440db74e660489db4e4c]) successfully deleted
I20260812 17:42:47.054692 21441 tablet_replica.cc:330] T 67fec8fe103742f193a77e3cc81794ee P a3814529c7a6441b8170b45625b5211c: stopping tablet replica
I20260812 17:42:47.054922 21441 raft_consensus.cc:2229] T 67fec8fe103742f193a77e3cc81794ee P a3814529c7a6441b8170b45625b5211c [term 1 LEADER]: Raft consensus shutting down.
I20260812 17:42:47.055328 21441 raft_consensus.cc:2258] T 67fec8fe103742f193a77e3cc81794ee P a3814529c7a6441b8170b45625b5211c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:42:47.056231 21441 ts_tablet_manager.cc:1905] T 67fec8fe103742f193a77e3cc81794ee P a3814529c7a6441b8170b45625b5211c: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 12 17:42:47 dist-test-slave-tk9z krb5kdc[20360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556566, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.255.1@KRBTEST.COM
I20260812 17:42:47.057996 21440 ts_tablet_manager.cc:1918] T 67fec8fe103742f193a77e3cc81794ee P 999f555d85d24dbfafce7efa54da39e8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 17:42:47.058132 21440 log.cc:1196] T 67fec8fe103742f193a77e3cc81794ee P 999f555d85d24dbfafce7efa54da39e8: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-0/wal/wals/67fec8fe103742f193a77e3cc81794ee
I20260812 17:42:47.058472 21440 ts_tablet_manager.cc:1939] T 67fec8fe103742f193a77e3cc81794ee P 999f555d85d24dbfafce7efa54da39e8: Deleting consensus metadata
I20260812 17:42:47.059476 20419 catalog_manager.cc:4841] TS 999f555d85d24dbfafce7efa54da39e8 (127.17.255.1:36463): tablet 67fec8fe103742f193a77e3cc81794ee (table test-table [id=63fb6d9036ed440db74e660489db4e4c]) successfully deleted
I20260812 17:42:47.064251 21441 ts_tablet_manager.cc:1918] T 67fec8fe103742f193a77e3cc81794ee P a3814529c7a6441b8170b45625b5211c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 17:42:47.064355 21441 log.cc:1196] T 67fec8fe103742f193a77e3cc81794ee P a3814529c7a6441b8170b45625b5211c: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786556557564181-18428-0/minicluster-data/ts-1/wal/wals/67fec8fe103742f193a77e3cc81794ee
I20260812 17:42:47.064366 21325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:47.048561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53412 (local address 127.17.255.1:36463)
0812 17:42:47.048689 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:47.048695 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:47.049666 (+ 971us) server_negotiation.cc:407] Connection header received
0812 17:42:47.049869 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:47.049872 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:47.049931 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:47.049984 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:42:47.051265 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:47.051988 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:47.053543 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:47.053840 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:47.053936 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:47.058751 (+ 4815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:42:47.058765 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:42:47.058784 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:42:47.058817 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:42:47.061694 (+ 2877us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:47.062299 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:47.062306 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:47.062308 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:47.062481 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:47.062849 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:47.062852 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:47.062854 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:47.063244 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:42:47.063508 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:47.064026 (+ 518us) server_negotiation.cc:299] Negotiation successful
0812 17:42:47.064186 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 17:42:47.064749 21441 ts_tablet_manager.cc:1939] T 67fec8fe103742f193a77e3cc81794ee P a3814529c7a6441b8170b45625b5211c: Deleting consensus metadata
W20260812 17:42:47.065446 20801 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53412
I20260812 17:42:47.065927 20421 catalog_manager.cc:4841] TS a3814529c7a6441b8170b45625b5211c (127.17.255.2:34425): tablet 67fec8fe103742f193a77e3cc81794ee (table test-table [id=63fb6d9036ed440db74e660489db4e4c]) successfully deleted
I20260812 17:42:47.076488 20536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:47.067922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39214 (local address 127.17.255.62:39007)
0812 17:42:47.068056 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:47.068061 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:47.068073 (+ 12us) server_negotiation.cc:407] Connection header received
0812 17:42:47.068114 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:47.068116 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:47.068154 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:47.068255 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:42:47.069004 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:47.069567 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:47.070531 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:47.070760 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:47.070885 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:47.072792 (+ 1907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:42:47.072798 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:42:47.072829 (+ 31us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:42:47.072861 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:42:47.074731 (+ 1870us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:47.075162 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:47.075166 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:47.075168 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:47.075261 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:47.075555 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:47.075558 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:47.075560 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:47.075766 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:42:47.075918 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:47.076170 (+ 252us) server_negotiation.cc:299] Negotiation successful
0812 17:42:47.076295 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
W20260812 17:42:47.076903 20447 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39214
I20260812 17:42:47.078841 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 20584
I20260812 17:42:47.094290 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 20830
I20260812 17:42:47.109462 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 21052
I20260812 17:42:47.129156 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 20389
2026-08-12T17:42:47Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (3401 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:42:47 dist-test-slave-tk9z krb5kdc[21450](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:42:47 dist-test-slave-tk9z krb5kdc[21450](info): set up 2 sockets
Aug 12 17:42:47 dist-test-slave-tk9z krb5kdc[21450](info): commencing operation
krb5kdc: starting...
W20260812 17:42:48.480290 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.312s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:42:48 dist-test-slave-tk9z krb5kdc[21450](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556568, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:42:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:42:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.255.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
I20260812 17:42:48.625290 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:40627
--webserver_interface=127.17.255.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:43157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:40627
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:42:48.746816 21478 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:42:48.747172 21478 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:42:48.747268 21478 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:42:48.751483 21478 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:42:48.751588 21478 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 17:42:48.751619 21478 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:42:48.751665 21478 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:42:48.751704 21478 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:42:48.751760 21478 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:42:48.758034 21478 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:43157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:40627
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:40627
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21478
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:42:48.759363 21478 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:42:48.760536 21478 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:42:48.770008 21488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:42:48.770005 21494 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:42:48.770043 21486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:42:48.770810 21478 server_base.cc:1034] running on GCE node
I20260812 17:42:48.771515 21478 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:42:48.772933 21478 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:42:48.774168 21478 hybrid_clock.cc:648] HybridClock initialized: now 1786556568774153 us; error 47 us; skew 500 ppm
Aug 12 17:42:48 dist-test-slave-tk9z krb5kdc[21450](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556568, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:42:48.781323 21478 init.cc:377] Logged in from keytab as kudu/127.17.255.62@KRBTEST.COM (short username kudu)
I20260812 17:42:48.782725 21478 webserver.cc:460] Webserver started at http://127.17.255.62:40985/ using document root <none> and password file <none>
I20260812 17:42:48.783422 21478 fs_manager.cc:359] Metadata directory not provided
I20260812 17:42:48.783526 21478 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:42:48.783784 21478 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:42:48.786147 21478 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "5d6ff83821404879969adb68e2c4e4da"
format_stamp: "Formatted at 2026-08-12 17:42:48 on dist-test-slave-tk9z"
server_key: "67fbb3280b1e883edc613a15fe9c0290"
server_key_iv: "098560a5b7d4faabdba9d9f4c5c0edf1"
server_key_version: "encryptionkey@0"
I20260812 17:42:48.786942 21478 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "5d6ff83821404879969adb68e2c4e4da"
format_stamp: "Formatted at 2026-08-12 17:42:48 on dist-test-slave-tk9z"
server_key: "67fbb3280b1e883edc613a15fe9c0290"
server_key_iv: "098560a5b7d4faabdba9d9f4c5c0edf1"
server_key_version: "encryptionkey@0"
I20260812 17:42:48.791369 21478 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 17:42:48.794193 21505 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:48.795765 21478 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:42:48.795953 21478 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "5d6ff83821404879969adb68e2c4e4da"
format_stamp: "Formatted at 2026-08-12 17:42:48 on dist-test-slave-tk9z"
server_key: "67fbb3280b1e883edc613a15fe9c0290"
server_key_iv: "098560a5b7d4faabdba9d9f4c5c0edf1"
server_key_version: "encryptionkey@0"
I20260812 17:42:48.796099 21478 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:42:48.813649 21478 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:42:48.817427 21478 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:42:48.817667 21478 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:42:48.827085 21478 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:40627
I20260812 17:42:48.827092 21610 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:40627 every 8 connection(s)
I20260812 17:42:48.828154 21478 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:42:48.831382 21611 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:42:48.833760 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 21478
I20260812 17:42:48.833905 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:42:48.834198 18428 external_mini_cluster.cc:1428] Setting key 4dd199022134a214f64b103fd4b628ba
I20260812 17:42:48.837898 21611 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d6ff83821404879969adb68e2c4e4da: Bootstrap starting.
I20260812 17:42:48.840224 21611 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5d6ff83821404879969adb68e2c4e4da: Neither blocks nor log segments found. Creating new log.
I20260812 17:42:48.841164 21611 log.cc:824] T 00000000000000000000000000000000 P 5d6ff83821404879969adb68e2c4e4da: Log is configured to *not* fsync() on all Append() calls
Aug 12 17:42:48 dist-test-slave-tk9z krb5kdc[21450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556568, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:42:48.843623 21611 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d6ff83821404879969adb68e2c4e4da: No bootstrap required, opened a new log
I20260812 17:42:48.848546 21611 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5d6ff83821404879969adb68e2c4e4da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d6ff83821404879969adb68e2c4e4da" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40627 } }
I20260812 17:42:48.848898 21611 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5d6ff83821404879969adb68e2c4e4da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:42:48.848959 21611 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5d6ff83821404879969adb68e2c4e4da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d6ff83821404879969adb68e2c4e4da, State: Initialized, Role: FOLLOWER
I20260812 17:42:48.849535 21611 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5d6ff83821404879969adb68e2c4e4da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d6ff83821404879969adb68e2c4e4da" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40627 } }
I20260812 17:42:48.849735 21611 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5d6ff83821404879969adb68e2c4e4da [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:42:48.849797 21611 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d6ff83821404879969adb68e2c4e4da [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:42:48.849898 21611 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5d6ff83821404879969adb68e2c4e4da [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:42:48.850356 21615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:48.835748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56604 (local address 127.17.255.62:40627)
0812 17:42:48.836222 (+ 474us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:48.836238 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:48.836276 (+ 38us) server_negotiation.cc:407] Connection header received
0812 17:42:48.836986 (+ 710us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:48.837005 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:48.837351 (+ 346us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:48.837703 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:42:48.838584 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:48.839594 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:48.840543 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:48.841271 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:48.841455 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:48.844367 (+ 2912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:42:48.844377 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:42:48.844395 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:42:48.844434 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:42:48.846739 (+ 2305us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:48.847278 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:48.847285 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:48.847291 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:48.847451 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:48.847780 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:48.847784 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:48.847786 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:48.848367 (+ 581us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:42:48.848583 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:48.848892 (+ 309us) server_negotiation.cc:299] Negotiation successful
0812 17:42:48.849243 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":325,"thread_start_us":141,"threads_started":1}
I20260812 17:42:48.851210 21611 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d6ff83821404879969adb68e2c4e4da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d6ff83821404879969adb68e2c4e4da" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40627 } }
I20260812 17:42:48.851608 21611 leader_election.cc:302] T 00000000000000000000000000000000 P 5d6ff83821404879969adb68e2c4e4da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5d6ff83821404879969adb68e2c4e4da; no voters:
I20260812 17:42:48.852010 21611 leader_election.cc:288] T 00000000000000000000000000000000 P 5d6ff83821404879969adb68e2c4e4da [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:42:48.852092 21619 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5d6ff83821404879969adb68e2c4e4da [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:42:48.852304 21619 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5d6ff83821404879969adb68e2c4e4da [term 1 LEADER]: Becoming Leader. State: Replica: 5d6ff83821404879969adb68e2c4e4da, State: Running, Role: LEADER
I20260812 17:42:48.852684 21619 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5d6ff83821404879969adb68e2c4e4da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d6ff83821404879969adb68e2c4e4da" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40627 } }
I20260812 17:42:48.853435 21611 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5d6ff83821404879969adb68e2c4e4da [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:42:48.854650 21621 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d6ff83821404879969adb68e2c4e4da [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5d6ff83821404879969adb68e2c4e4da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d6ff83821404879969adb68e2c4e4da" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40627 } } }
I20260812 17:42:48.854679 21623 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d6ff83821404879969adb68e2c4e4da [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5d6ff83821404879969adb68e2c4e4da. Latest consensus state: current_term: 1 leader_uuid: "5d6ff83821404879969adb68e2c4e4da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d6ff83821404879969adb68e2c4e4da" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40627 } } }
I20260812 17:42:48.854831 21621 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d6ff83821404879969adb68e2c4e4da [sys.catalog]: This master's current role is: LEADER
I20260812 17:42:48.854887 21623 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d6ff83821404879969adb68e2c4e4da [sys.catalog]: This master's current role is: LEADER
I20260812 17:42:48.855274 21637 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:42:48.858975 21637 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:42:48.865127 21637 catalog_manager.cc:1347] Generated new cluster ID: 569639bbe8f04857b7566e850d3f99b6
I20260812 17:42:48.865207 21637 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:42:48.876611 21637 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:42:48.877794 21637 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:42:48.885273 21637 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5d6ff83821404879969adb68e2c4e4da: Generated new TSK 0
I20260812 17:42:48.886070 21637 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.255.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab.
Entry for principal kudu/127.17.255.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab.
I20260812 17:42:48.935789 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.1:0
--local_ip_for_outbound_sockets=127.17.255.1
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:40627
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:43157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:42:49.060793 21656 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:42:49.061116 21656 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:42:49.061167 21656 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:42:49.065493 21656 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:42:49.065557 21656 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:42:49.065598 21656 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 17:42:49.065659 21656 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 17:42:49.065725 21656 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.1
I20260812 17:42:49.071166 21656 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:43157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.255.1
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.255.62:40627
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21656
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.1
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:42:49.072359 21656 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:42:49.073499 21656 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:42:49.084358 21664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:42:49.084365 21662 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:42:49.084334 21667 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:42:49.084734 21656 server_base.cc:1034] running on GCE node
I20260812 17:42:49.085345 21656 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:42:49.086179 21656 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:42:49.087414 21656 hybrid_clock.cc:648] HybridClock initialized: now 1786556569087380 us; error 48 us; skew 500 ppm
Aug 12 17:42:49 dist-test-slave-tk9z krb5kdc[21450](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556569, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:42:49.090739 21656 init.cc:377] Logged in from keytab as kudu/127.17.255.1@KRBTEST.COM (short username kudu)
I20260812 17:42:49.091827 21656 webserver.cc:460] Webserver started at http://127.17.255.1:41281/ using document root <none> and password file <none>
I20260812 17:42:49.092469 21656 fs_manager.cc:359] Metadata directory not provided
I20260812 17:42:49.092536 21656 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:42:49.092768 21656 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:42:49.095105 21656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-0/data/instance:
uuid: "5983b40f0e604b9a997d9fcb66d1ee62"
format_stamp: "Formatted at 2026-08-12 17:42:49 on dist-test-slave-tk9z"
server_key: "ad692b74e990eb0b95f7ae199bca5cc8"
server_key_iv: "d29e8948de6ff3fa731af79fe20bc7a1"
server_key_version: "encryptionkey@0"
I20260812 17:42:49.095728 21656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance:
uuid: "5983b40f0e604b9a997d9fcb66d1ee62"
format_stamp: "Formatted at 2026-08-12 17:42:49 on dist-test-slave-tk9z"
server_key: "ad692b74e990eb0b95f7ae199bca5cc8"
server_key_iv: "d29e8948de6ff3fa731af79fe20bc7a1"
server_key_version: "encryptionkey@0"
I20260812 17:42:49.099992 21656 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 17:42:49.103204 21681 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:49.104720 21656 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 17:42:49.104890 21656 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-0/wal
uuid: "5983b40f0e604b9a997d9fcb66d1ee62"
format_stamp: "Formatted at 2026-08-12 17:42:49 on dist-test-slave-tk9z"
server_key: "ad692b74e990eb0b95f7ae199bca5cc8"
server_key_iv: "d29e8948de6ff3fa731af79fe20bc7a1"
server_key_version: "encryptionkey@0"
I20260812 17:42:49.105020 21656 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:42:49.120426 21656 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:42:49.124398 21656 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:42:49.124670 21656 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:42:49.126466 21656 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:42:49.126547 21656 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:49.126619 21656 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:42:49.126664 21656 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 17:42:49 dist-test-slave-tk9z krb5kdc[21450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556569, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:42:49.138608 21656 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.1:35505
I20260812 17:42:49.138980 21879 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.1:35505 every 8 connection(s)
I20260812 17:42:49.139837 21656 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
I20260812 17:42:49.142356 21615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:49.127592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:58165 (local address 127.17.255.62:40627)
0812 17:42:49.127773 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:49.127779 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:49.128679 (+ 900us) server_negotiation.cc:407] Connection header received
0812 17:42:49.129885 (+ 1206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:49.129889 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:49.129962 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:49.130072 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:42:49.131986 (+ 1914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.132909 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.134810 (+ 1901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.135189 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.135316 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:49.138178 (+ 2862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:42:49.138182 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:42:49.138185 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:42:49.138243 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:42:49.140026 (+ 1783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:49.140687 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:49.140692 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:49.140693 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:49.140797 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:49.141239 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:49.141243 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:49.141244 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:49.141480 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:42:49.141582 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:49.142081 (+ 499us) server_negotiation.cc:299] Negotiation successful
0812 17:42:49.142221 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 17:42:49.143260 21694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:49.128001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40627 (local address 127.17.255.1:58165)
0812 17:42:49.128491 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:49.128545 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:49.129595 (+ 1050us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:49.130297 (+ 702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:49.130306 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:49.130920 (+ 614us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:42:49.131775 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:49.131800 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.133087 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.133091 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:49.134669 (+ 1578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:49.134680 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.135368 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.135372 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:49.135577 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:49.136310 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:42:49.136336 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:42:49.137967 (+ 1631us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:42:49.140164 (+ 2197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:49.140171 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:49.140187 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:49.140551 (+ 364us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:49.140916 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:49.140920 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:49.140922 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:49.141109 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:49.141591 (+ 482us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:42:49.141597 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:42:49.141846 (+ 249us) client_negotiation.cc:769] Sending connection context
0812 17:42:49.142014 (+ 168us) client_negotiation.cc:240] Negotiation successful
0812 17:42:49.142284 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":127,"threads_started":1}
I20260812 17:42:49.144399 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 21656
I20260812 17:42:49.144533 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance
I20260812 17:42:49.144825 18428 external_mini_cluster.cc:1428] Setting key 8743015ec3bac121bfdd8433b1e076e2
I20260812 17:42:49.147289 21880 heartbeater.cc:347] Connected to a master server at 127.17.255.62:40627
I20260812 17:42:49.147481 21880 heartbeater.cc:464] Registering TS with master...
I20260812 17:42:49.148068 21880 heartbeater.cc:511] Master 127.17.255.62:40627 requested a full tablet report, sending...
I20260812 17:42:49.149883 21532 ts_manager.cc:194] Registered new tserver with Master: 5983b40f0e604b9a997d9fcb66d1ee62 (127.17.255.1:35505)
I20260812 17:42:49.151338 21532 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.1@KRBTEST.COM'} at 127.17.255.1:58165
WARNING: no policy specified for kudu/127.17.255.2@KRBTEST.COM; defaulting to no policy
I20260812 17:42:49.160729 21615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:49.147606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:52439 (local address 127.17.255.62:40627)
0812 17:42:49.147734 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:49.147740 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:49.148999 (+ 1259us) server_negotiation.cc:407] Connection header received
0812 17:42:49.149170 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:49.149173 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:49.149223 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:49.149315 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:42:49.149979 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.150770 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.154653 (+ 3883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.154909 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.155073 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:49.156719 (+ 1646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:42:49.156723 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:42:49.156725 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:42:49.156752 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:42:49.158752 (+ 2000us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:49.159352 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:49.159355 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:49.159357 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:49.159457 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:49.159796 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:49.159800 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:49.159801 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:49.160028 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:42:49.160131 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:49.160484 (+ 353us) server_negotiation.cc:299] Negotiation successful
0812 17:42:49.160605 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 17:42:49.160733 21893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:49.147536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40627 (local address 127.17.255.1:52439)
0812 17:42:49.148909 (+ 1373us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:49.148929 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:49.149052 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:49.149371 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:49.149376 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:49.149660 (+ 284us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:42:49.149828 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:49.149838 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.150943 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.150950 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:49.152159 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:49.152175 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.155114 (+ 2939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.155119 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:49.155244 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:49.155944 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:42:49.155969 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:42:49.156533 (+ 564us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:42:49.158899 (+ 2366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:49.158902 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:49.158904 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:49.159168 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:49.159567 (+ 399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:49.159570 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:49.159572 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:49.159673 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:49.160158 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:42:49.160161 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:42:49.160266 (+ 105us) client_negotiation.cc:769] Sending connection context
0812 17:42:49.160398 (+ 132us) client_negotiation.cc:240] Negotiation successful
0812 17:42:49.160548 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1260,"thread_start_us":93,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab.
Entry for principal kudu/127.17.255.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab.
I20260812 17:42:49.183601 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.2:0
--local_ip_for_outbound_sockets=127.17.255.2
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:40627
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:43157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:42:49.304972 21896 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:42:49.305238 21896 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:42:49.305285 21896 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:42:49.309437 21896 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:42:49.309504 21896 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:42:49.309566 21896 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 17:42:49.309599 21896 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 17:42:49.309655 21896 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.2
I20260812 17:42:49.315028 21896 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:43157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.255.2
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.255.62:40627
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21896
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.2
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:42:49.316088 21896 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:42:49.317085 21896 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:42:49.327127 21912 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:42:49.327140 21908 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:42:49.327127 21905 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:42:49.327502 21896 server_base.cc:1034] running on GCE node
I20260812 17:42:49.327960 21896 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:42:49.328663 21896 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:42:49.329887 21896 hybrid_clock.cc:648] HybridClock initialized: now 1786556569329872 us; error 30 us; skew 500 ppm
Aug 12 17:42:49 dist-test-slave-tk9z krb5kdc[21450](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556569, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:42:49.333045 21896 init.cc:377] Logged in from keytab as kudu/127.17.255.2@KRBTEST.COM (short username kudu)
I20260812 17:42:49.334018 21896 webserver.cc:460] Webserver started at http://127.17.255.2:45605/ using document root <none> and password file <none>
I20260812 17:42:49.334657 21896 fs_manager.cc:359] Metadata directory not provided
I20260812 17:42:49.334722 21896 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:42:49.334903 21896 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:42:49.336977 21896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-1/data/instance:
uuid: "1edda66438b64b72b9cb7207bba19be3"
format_stamp: "Formatted at 2026-08-12 17:42:49 on dist-test-slave-tk9z"
server_key: "2666b152fd426f6d2269f3f27b275bcd"
server_key_iv: "1fe51b542129c56a3caf79bc96f8a578"
server_key_version: "encryptionkey@0"
I20260812 17:42:49.337523 21896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance:
uuid: "1edda66438b64b72b9cb7207bba19be3"
format_stamp: "Formatted at 2026-08-12 17:42:49 on dist-test-slave-tk9z"
server_key: "2666b152fd426f6d2269f3f27b275bcd"
server_key_iv: "1fe51b542129c56a3caf79bc96f8a578"
server_key_version: "encryptionkey@0"
I20260812 17:42:49.341495 21896 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260812 17:42:49.344384 21925 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:49.345860 21896 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 17:42:49.345983 21896 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-1/wal
uuid: "1edda66438b64b72b9cb7207bba19be3"
format_stamp: "Formatted at 2026-08-12 17:42:49 on dist-test-slave-tk9z"
server_key: "2666b152fd426f6d2269f3f27b275bcd"
server_key_iv: "1fe51b542129c56a3caf79bc96f8a578"
server_key_version: "encryptionkey@0"
I20260812 17:42:49.346093 21896 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:42:49.364966 21896 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:42:49.368469 21896 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:42:49.368637 21896 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:42:49.370218 21896 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:42:49.370293 21896 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:49.370340 21896 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:42:49.370441 21896 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
Aug 12 17:42:49 dist-test-slave-tk9z krb5kdc[21450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556569, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:42:49.383641 21896 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.2:38853
I20260812 17:42:49.383692 22142 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.2:38853 every 8 connection(s)
I20260812 17:42:49.384795 21896 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
I20260812 17:42:49.386080 21615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:49.371237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:49915 (local address 127.17.255.62:40627)
0812 17:42:49.371407 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:49.371412 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:49.372348 (+ 936us) server_negotiation.cc:407] Connection header received
0812 17:42:49.373438 (+ 1090us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:49.373444 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:49.373508 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:49.373557 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:42:49.375186 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.375773 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.377280 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.377572 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.377686 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:49.381711 (+ 4025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:42:49.381717 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:42:49.381720 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:42:49.381755 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:42:49.383519 (+ 1764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:49.384239 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:49.384243 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:49.384244 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:49.384354 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:49.384723 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:49.384727 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:49.384729 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:49.385014 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:42:49.385132 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:49.385777 (+ 645us) server_negotiation.cc:299] Negotiation successful
0812 17:42:49.385919 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 17:42:49.387092 21941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:49.371665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40627 (local address 127.17.255.2:49915)
0812 17:42:49.372157 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:49.372211 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:49.373132 (+ 921us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:49.373957 (+ 825us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:49.373965 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:49.374342 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:42:49.375008 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:49.375033 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.375914 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.375917 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:49.377114 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:49.377146 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.377738 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.377742 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:49.377983 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:49.378732 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:42:49.378756 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:42:49.381490 (+ 2734us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:42:49.383676 (+ 2186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:49.383688 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:49.383702 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:49.384111 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:49.384452 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:49.384456 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:49.384458 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:49.384615 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:49.385130 (+ 515us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:42:49.385138 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:42:49.385484 (+ 346us) client_negotiation.cc:769] Sending connection context
0812 17:42:49.385724 (+ 240us) client_negotiation.cc:240] Negotiation successful
0812 17:42:49.386087 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":139,"threads_started":1}
I20260812 17:42:49.388319 22143 heartbeater.cc:347] Connected to a master server at 127.17.255.62:40627
I20260812 17:42:49.388505 22143 heartbeater.cc:464] Registering TS with master...
I20260812 17:42:49.389199 22143 heartbeater.cc:511] Master 127.17.255.62:40627 requested a full tablet report, sending...
I20260812 17:42:49.390630 21531 ts_manager.cc:194] Registered new tserver with Master: 1edda66438b64b72b9cb7207bba19be3 (127.17.255.2:38853)
I20260812 17:42:49.391486 21531 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.2@KRBTEST.COM'} at 127.17.255.2:49915
I20260812 17:42:49.391705 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 21896
I20260812 17:42:49.391870 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance
I20260812 17:42:49.392248 18428 external_mini_cluster.cc:1428] Setting key 0c4c9b78d76845470843d9d8510d71e7
I20260812 17:42:49.402653 21615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:49.391330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:34141 (local address 127.17.255.62:40627)
0812 17:42:49.391456 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:49.391461 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:49.392939 (+ 1478us) server_negotiation.cc:407] Connection header received
0812 17:42:49.393107 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:49.393110 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:49.393165 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:49.393261 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:42:49.394726 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.395264 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.396469 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.396938 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.397098 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:49.398455 (+ 1357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:42:49.398463 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:42:49.398470 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:42:49.398510 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:42:49.400541 (+ 2031us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:49.401207 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:49.401211 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:49.401213 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:49.401315 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:49.401639 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:49.401643 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:49.401645 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:49.401905 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:42:49.402028 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:49.402321 (+ 293us) server_negotiation.cc:299] Negotiation successful
0812 17:42:49.402479 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 17:42:49.402667 22155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:49.391180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40627 (local address 127.17.255.2:34141)
0812 17:42:49.392832 (+ 1652us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:49.392850 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:49.392993 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:49.393310 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:49.393314 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:49.393596 (+ 282us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:42:49.394530 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:49.394549 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.395422 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.395430 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:49.396304 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:49.396316 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.397111 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.397114 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:49.397205 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:49.397852 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:42:49.397865 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:42:49.398242 (+ 377us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:42:49.400740 (+ 2498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:49.400745 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:49.400748 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:49.401058 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:49.401422 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:49.401425 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:49.401427 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:49.401531 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:49.402017 (+ 486us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:42:49.402020 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:42:49.402133 (+ 113us) client_negotiation.cc:769] Sending connection context
0812 17:42:49.402248 (+ 115us) client_negotiation.cc:240] Negotiation successful
0812 17:42:49.402463 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1515,"mutex_wait_us":27,"thread_start_us":108,"threads_started":1}
WARNING: no policy specified for kudu/127.17.255.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab.
Entry for principal kudu/127.17.255.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab.
I20260812 17:42:49.428587 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.3:0
--local_ip_for_outbound_sockets=127.17.255.3
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:40627
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:43157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:42:49.550722 22161 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:42:49.551047 22161 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:42:49.551124 22161 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:42:49.555452 22161 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:42:49.555542 22161 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:42:49.555617 22161 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 17:42:49.555660 22161 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 17:42:49.555721 22161 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.3
I20260812 17:42:49.561254 22161 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:43157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.255.3
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.255.62:40627
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22161
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.3
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:42:49.562498 22161 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:42:49.563601 22161 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 17:42:49.574123 22161 server_base.cc:1034] running on GCE node
W20260812 17:42:49.574055 22166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:42:49.574076 22167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:42:49.574083 22172 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:42:49.574855 22161 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:42:49.575490 22161 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:42:49.576736 22161 hybrid_clock.cc:648] HybridClock initialized: now 1786556569576668 us; error 56 us; skew 500 ppm
Aug 12 17:42:49 dist-test-slave-tk9z krb5kdc[21450](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556569, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:42:49.579945 22161 init.cc:377] Logged in from keytab as kudu/127.17.255.3@KRBTEST.COM (short username kudu)
I20260812 17:42:49.580940 22161 webserver.cc:460] Webserver started at http://127.17.255.3:36731/ using document root <none> and password file <none>
I20260812 17:42:49.581544 22161 fs_manager.cc:359] Metadata directory not provided
I20260812 17:42:49.581640 22161 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:42:49.581892 22161 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:42:49.584065 22161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-2/data/instance:
uuid: "1a084a7c37184bf6a819f5abf483f363"
format_stamp: "Formatted at 2026-08-12 17:42:49 on dist-test-slave-tk9z"
server_key: "1306f28b71d44b02b22e8f0f3db1cd20"
server_key_iv: "7f5af03f7a6c99d262d220cea17f2b65"
server_key_version: "encryptionkey@0"
I20260812 17:42:49.584657 22161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance:
uuid: "1a084a7c37184bf6a819f5abf483f363"
format_stamp: "Formatted at 2026-08-12 17:42:49 on dist-test-slave-tk9z"
server_key: "1306f28b71d44b02b22e8f0f3db1cd20"
server_key_iv: "7f5af03f7a6c99d262d220cea17f2b65"
server_key_version: "encryptionkey@0"
I20260812 17:42:49.588860 22161 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260812 17:42:49.591579 22181 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:49.593004 22161 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 17:42:49.593114 22161 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-2/wal
uuid: "1a084a7c37184bf6a819f5abf483f363"
format_stamp: "Formatted at 2026-08-12 17:42:49 on dist-test-slave-tk9z"
server_key: "1306f28b71d44b02b22e8f0f3db1cd20"
server_key_iv: "7f5af03f7a6c99d262d220cea17f2b65"
server_key_version: "encryptionkey@0"
I20260812 17:42:49.593214 22161 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:42:49.609092 22161 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:42:49.612733 22161 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:42:49.612920 22161 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:42:49.614648 22161 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:42:49.614735 22161 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:49.614817 22161 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:42:49.614861 22161 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 17:42:49 dist-test-slave-tk9z krb5kdc[21450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556569, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:42:49.627305 22161 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.3:36677
I20260812 17:42:49.627586 22372 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.3:36677 every 8 connection(s)
I20260812 17:42:49.628592 22161 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
I20260812 17:42:49.631307 21615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:49.615665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:49993 (local address 127.17.255.62:40627)
0812 17:42:49.615817 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:49.615821 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:49.617085 (+ 1264us) server_negotiation.cc:407] Connection header received
0812 17:42:49.618437 (+ 1352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:49.618441 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:49.618515 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:49.618632 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:42:49.620425 (+ 1793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.621143 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.622814 (+ 1671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.623157 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.623300 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:49.626768 (+ 3468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:42:49.626773 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:42:49.626775 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:42:49.626809 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:42:49.628667 (+ 1858us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:49.629482 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:49.629486 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:49.629488 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:49.629599 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:49.629988 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:49.629991 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:49.629993 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:49.630216 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:42:49.630353 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:49.630991 (+ 638us) server_negotiation.cc:299] Negotiation successful
0812 17:42:49.631139 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 17:42:49.632297 22198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:49.616302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40627 (local address 127.17.255.3:49993)
0812 17:42:49.616898 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:49.616949 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:49.618087 (+ 1138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:49.618850 (+ 763us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:49.618876 (+ 26us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:49.619382 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:42:49.620207 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:49.620226 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.621304 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.621308 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:49.622634 (+ 1326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:49.622650 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.623374 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.623379 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:49.623634 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:49.624421 (+ 787us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:42:49.624442 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:42:49.626499 (+ 2057us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:42:49.628908 (+ 2409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:49.628916 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:49.628934 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:49.629295 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:49.629691 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:49.629695 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:49.629697 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:49.629868 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:49.630349 (+ 481us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:42:49.630356 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:42:49.630715 (+ 359us) client_negotiation.cc:769] Sending connection context
0812 17:42:49.630932 (+ 217us) client_negotiation.cc:240] Negotiation successful
0812 17:42:49.631317 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":155,"threads_started":1}
I20260812 17:42:49.633719 22373 heartbeater.cc:347] Connected to a master server at 127.17.255.62:40627
I20260812 17:42:49.633934 22373 heartbeater.cc:464] Registering TS with master...
I20260812 17:42:49.634667 22373 heartbeater.cc:511] Master 127.17.255.62:40627 requested a full tablet report, sending...
I20260812 17:42:49.635953 21532 ts_manager.cc:194] Registered new tserver with Master: 1a084a7c37184bf6a819f5abf483f363 (127.17.255.3:36677)
I20260812 17:42:49.636829 21532 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.3@KRBTEST.COM'} at 127.17.255.3:49993
I20260812 17:42:49.636948 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 22161
I20260812 17:42:49.637082 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance
I20260812 17:42:49.637387 18428 external_mini_cluster.cc:1428] Setting key 392cd8a15bfe61289804a525179be70a
I20260812 17:42:49.639585 18428 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 17:42:49.644827 21615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:49.636180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:42031 (local address 127.17.255.62:40627)
0812 17:42:49.636322 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:49.636327 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:49.636521 (+ 194us) server_negotiation.cc:407] Connection header received
0812 17:42:49.636678 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:49.636681 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:49.636737 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:49.636824 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:42:49.637546 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.638267 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.639434 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.639665 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.639785 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:49.641170 (+ 1385us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:42:49.641173 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:42:49.641175 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:42:49.641200 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:42:49.642851 (+ 1651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:49.643317 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:49.643321 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:49.643323 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:49.643409 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:49.643900 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:49.643903 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:49.643904 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:49.644110 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:42:49.644229 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:49.644529 (+ 300us) server_negotiation.cc:299] Negotiation successful
0812 17:42:49.644644 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 17:42:49.644858 22385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:49.636059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40627 (local address 127.17.255.3:42031)
0812 17:42:49.636423 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:49.636439 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:49.636550 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:49.636869 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:49.636873 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:49.637192 (+ 319us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:42:49.637353 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:49.637362 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.638437 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.638440 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:49.639308 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:49.639318 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.639798 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.639802 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:49.639908 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:49.640470 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:42:49.640491 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:42:49.641016 (+ 525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:42:49.642975 (+ 1959us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:49.642979 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:49.642981 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:49.643207 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:49.643516 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:49.643519 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:49.643521 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:49.643618 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:49.644239 (+ 621us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:42:49.644245 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:42:49.644353 (+ 108us) client_negotiation.cc:769] Sending connection context
0812 17:42:49.644467 (+ 114us) client_negotiation.cc:240] Negotiation successful
0812 17:42:49.644644 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"mutex_wait_us":1,"thread_start_us":105,"threads_started":1}
Aug 12 17:42:49 dist-test-slave-tk9z krb5kdc[21450](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556569, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 17:42:49 dist-test-slave-tk9z krb5kdc[21450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556569, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:42:49.671517 21615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:49.661332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56616 (local address 127.17.255.62:40627)
0812 17:42:49.661468 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:49.661472 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:49.661485 (+ 13us) server_negotiation.cc:407] Connection header received
0812 17:42:49.661531 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:49.661533 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:49.661576 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:49.661649 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:42:49.662508 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.663121 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.664358 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.664599 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.664694 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:49.667553 (+ 2859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:42:49.667558 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:42:49.667560 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:42:49.667594 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:42:49.669191 (+ 1597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:49.669729 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:49.669734 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:49.669735 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:49.669842 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:49.670300 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:49.670303 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:49.670305 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:49.670632 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:42:49.670759 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:49.671091 (+ 332us) server_negotiation.cc:299] Negotiation successful
0812 17:42:49.671267 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 17:42:49.675259 21532 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56616:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 17:42:49.678560 21532 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 17:42:49.695333 22411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:49.688728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43934 (local address 127.17.255.2:38853)
0812 17:42:49.689298 (+ 570us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:49.689315 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:49.689922 (+ 607us) server_negotiation.cc:407] Connection header received
0812 17:42:49.690604 (+ 682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:49.690610 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:49.690839 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:49.690970 (+ 131us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:42:49.691433 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.692542 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.693938 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.694615 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.694741 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:49.694932 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:49.695068 (+ 136us) server_negotiation.cc:299] Negotiation successful
0812 17:42:49.695168 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":431,"thread_start_us":147,"threads_started":1}
I20260812 17:42:49.695322 22410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:49.688581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:38853 (local address 127.0.0.1:43934)
0812 17:42:49.689623 (+ 1042us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:49.689684 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:49.690420 (+ 736us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:49.691119 (+ 699us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:49.691121 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:49.691137 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:42:49.691223 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:49.691227 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.692670 (+ 1443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.692675 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:49.693796 (+ 1121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:49.693803 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.694743 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.694746 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:49.694865 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:49.694906 (+ 41us) client_negotiation.cc:769] Sending connection context
0812 17:42:49.695036 (+ 130us) client_negotiation.cc:240] Negotiation successful
0812 17:42:49.695169 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":833,"thread_start_us":101,"threads_started":1}
I20260812 17:42:49.695914 22416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:49.689988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50690 (local address 127.17.255.1:35505)
0812 17:42:49.690467 (+ 479us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:49.690474 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:49.690496 (+ 22us) server_negotiation.cc:407] Connection header received
0812 17:42:49.690572 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:49.690576 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:49.690748 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:49.690909 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:42:49.691336 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.692186 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.693883 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.694769 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.694887 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:49.695046 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:49.695662 (+ 616us) server_negotiation.cc:299] Negotiation successful
0812 17:42:49.695771 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":97,"threads_started":1}
I20260812 17:42:49.696251 22413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:49.689087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59830 (local address 127.17.255.3:36677)
0812 17:42:49.689481 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:49.689801 (+ 320us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:49.689830 (+ 29us) server_negotiation.cc:407] Connection header received
0812 17:42:49.690033 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:49.690040 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:49.690301 (+ 261us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:49.690498 (+ 197us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:42:49.690888 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.692065 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.693815 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.694758 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.694892 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:49.695071 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:49.696016 (+ 945us) server_negotiation.cc:299] Negotiation successful
0812 17:42:49.696115 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":104,"threads_started":1}
I20260812 17:42:49.696290 22414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:49.689506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:35505 (local address 127.0.0.1:50690)
0812 17:42:49.690103 (+ 597us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:49.690117 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:49.690210 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:49.691061 (+ 851us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:49.691064 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:49.691081 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:42:49.691189 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:49.691195 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.692319 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.692323 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:49.693767 (+ 1444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:49.693778 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.695139 (+ 1361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.695143 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:49.695418 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:49.695476 (+ 58us) client_negotiation.cc:769] Sending connection context
0812 17:42:49.695555 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 17:42:49.696146 (+ 591us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":520,"mutex_wait_us":671,"thread_start_us":94,"threads_started":1}
I20260812 17:42:49.696759 22409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:49.688707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.3:36677 (local address 127.0.0.1:59830)
0812 17:42:49.689622 (+ 915us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:49.689683 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:49.689823 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:49.690526 (+ 703us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:49.690536 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:49.690566 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:42:49.690740 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:49.690748 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.692200 (+ 1452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.692204 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:49.693673 (+ 1469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:49.693684 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.695139 (+ 1455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.695143 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:49.695421 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:49.695473 (+ 52us) client_negotiation.cc:769] Sending connection context
0812 17:42:49.695555 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 17:42:49.695661 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":841,"mutex_wait_us":156,"thread_start_us":134,"threads_started":1}
I20260812 17:42:49.698855 22022 tablet_service.cc:1467] Processing CreateTablet for tablet da3e044eb24d487ca6d8949184aed27c (DEFAULT_TABLE table=test-table [id=80ff98c1784541c8b21be8c81b438d02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:42:49.699470 22263 tablet_service.cc:1467] Processing CreateTablet for tablet da3e044eb24d487ca6d8949184aed27c (DEFAULT_TABLE table=test-table [id=80ff98c1784541c8b21be8c81b438d02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:42:49.699466 21772 tablet_service.cc:1467] Processing CreateTablet for tablet da3e044eb24d487ca6d8949184aed27c (DEFAULT_TABLE table=test-table [id=80ff98c1784541c8b21be8c81b438d02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:42:49.700068 22022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da3e044eb24d487ca6d8949184aed27c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:42:49.700702 21772 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da3e044eb24d487ca6d8949184aed27c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:42:49.700712 22263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da3e044eb24d487ca6d8949184aed27c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:42:49.708894 22417 tablet_bootstrap.cc:492] T da3e044eb24d487ca6d8949184aed27c P 1edda66438b64b72b9cb7207bba19be3: Bootstrap starting.
I20260812 17:42:49.710223 22423 tablet_bootstrap.cc:492] T da3e044eb24d487ca6d8949184aed27c P 1a084a7c37184bf6a819f5abf483f363: Bootstrap starting.
I20260812 17:42:49.711272 22417 tablet_bootstrap.cc:654] T da3e044eb24d487ca6d8949184aed27c P 1edda66438b64b72b9cb7207bba19be3: Neither blocks nor log segments found. Creating new log.
I20260812 17:42:49.712050 22417 log.cc:824] T da3e044eb24d487ca6d8949184aed27c P 1edda66438b64b72b9cb7207bba19be3: Log is configured to *not* fsync() on all Append() calls
I20260812 17:42:49.712244 22423 tablet_bootstrap.cc:654] T da3e044eb24d487ca6d8949184aed27c P 1a084a7c37184bf6a819f5abf483f363: Neither blocks nor log segments found. Creating new log.
I20260812 17:42:49.712743 22421 tablet_bootstrap.cc:492] T da3e044eb24d487ca6d8949184aed27c P 5983b40f0e604b9a997d9fcb66d1ee62: Bootstrap starting.
I20260812 17:42:49.713172 22423 log.cc:824] T da3e044eb24d487ca6d8949184aed27c P 1a084a7c37184bf6a819f5abf483f363: Log is configured to *not* fsync() on all Append() calls
I20260812 17:42:49.714607 22417 tablet_bootstrap.cc:492] T da3e044eb24d487ca6d8949184aed27c P 1edda66438b64b72b9cb7207bba19be3: No bootstrap required, opened a new log
I20260812 17:42:49.714871 22417 ts_tablet_manager.cc:1397] T da3e044eb24d487ca6d8949184aed27c P 1edda66438b64b72b9cb7207bba19be3: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260812 17:42:49.715199 22421 tablet_bootstrap.cc:654] T da3e044eb24d487ca6d8949184aed27c P 5983b40f0e604b9a997d9fcb66d1ee62: Neither blocks nor log segments found. Creating new log.
I20260812 17:42:49.715760 22423 tablet_bootstrap.cc:492] T da3e044eb24d487ca6d8949184aed27c P 1a084a7c37184bf6a819f5abf483f363: No bootstrap required, opened a new log
I20260812 17:42:49.716002 22423 ts_tablet_manager.cc:1397] T da3e044eb24d487ca6d8949184aed27c P 1a084a7c37184bf6a819f5abf483f363: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 17:42:49.716059 22421 log.cc:824] T da3e044eb24d487ca6d8949184aed27c P 5983b40f0e604b9a997d9fcb66d1ee62: Log is configured to *not* fsync() on all Append() calls
I20260812 17:42:49.718243 22421 tablet_bootstrap.cc:492] T da3e044eb24d487ca6d8949184aed27c P 5983b40f0e604b9a997d9fcb66d1ee62: No bootstrap required, opened a new log
I20260812 17:42:49.718472 22421 ts_tablet_manager.cc:1397] T da3e044eb24d487ca6d8949184aed27c P 5983b40f0e604b9a997d9fcb66d1ee62: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260812 17:42:49.718990 22417 raft_consensus.cc:348] T da3e044eb24d487ca6d8949184aed27c P 1edda66438b64b72b9cb7207bba19be3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } } peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } }
I20260812 17:42:49.719310 22417 raft_consensus.cc:374] T da3e044eb24d487ca6d8949184aed27c P 1edda66438b64b72b9cb7207bba19be3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:42:49.719393 22417 raft_consensus.cc:729] T da3e044eb24d487ca6d8949184aed27c P 1edda66438b64b72b9cb7207bba19be3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1edda66438b64b72b9cb7207bba19be3, State: Initialized, Role: FOLLOWER
I20260812 17:42:49.719470 22423 raft_consensus.cc:348] T da3e044eb24d487ca6d8949184aed27c P 1a084a7c37184bf6a819f5abf483f363 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } } peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } }
I20260812 17:42:49.719738 22423 raft_consensus.cc:374] T da3e044eb24d487ca6d8949184aed27c P 1a084a7c37184bf6a819f5abf483f363 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:42:49.719803 22423 raft_consensus.cc:729] T da3e044eb24d487ca6d8949184aed27c P 1a084a7c37184bf6a819f5abf483f363 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a084a7c37184bf6a819f5abf483f363, State: Initialized, Role: FOLLOWER
I20260812 17:42:49.719964 22417 consensus_queue.cc:260] T da3e044eb24d487ca6d8949184aed27c P 1edda66438b64b72b9cb7207bba19be3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } } peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } }
I20260812 17:42:49.720295 22423 consensus_queue.cc:260] T da3e044eb24d487ca6d8949184aed27c P 1a084a7c37184bf6a819f5abf483f363 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } } peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } }
I20260812 17:42:49.720871 22143 heartbeater.cc:503] Master 127.17.255.62:40627 was elected leader, sending a full tablet report...
I20260812 17:42:49.721135 22417 ts_tablet_manager.cc:1428] T da3e044eb24d487ca6d8949184aed27c P 1edda66438b64b72b9cb7207bba19be3: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260812 17:42:49.721305 22423 ts_tablet_manager.cc:1428] T da3e044eb24d487ca6d8949184aed27c P 1a084a7c37184bf6a819f5abf483f363: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260812 17:42:49.721666 22373 heartbeater.cc:503] Master 127.17.255.62:40627 was elected leader, sending a full tablet report...
I20260812 17:42:49.723167 22421 raft_consensus.cc:348] T da3e044eb24d487ca6d8949184aed27c P 5983b40f0e604b9a997d9fcb66d1ee62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } } peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } }
I20260812 17:42:49.723449 22421 raft_consensus.cc:374] T da3e044eb24d487ca6d8949184aed27c P 5983b40f0e604b9a997d9fcb66d1ee62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:42:49.723538 22421 raft_consensus.cc:729] T da3e044eb24d487ca6d8949184aed27c P 5983b40f0e604b9a997d9fcb66d1ee62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5983b40f0e604b9a997d9fcb66d1ee62, State: Initialized, Role: FOLLOWER
I20260812 17:42:49.724063 22421 consensus_queue.cc:260] T da3e044eb24d487ca6d8949184aed27c P 5983b40f0e604b9a997d9fcb66d1ee62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } } peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } }
I20260812 17:42:49.725112 22421 ts_tablet_manager.cc:1428] T da3e044eb24d487ca6d8949184aed27c P 5983b40f0e604b9a997d9fcb66d1ee62: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260812 17:42:49.725473 21880 heartbeater.cc:503] Master 127.17.255.62:40627 was elected leader, sending a full tablet report...
I20260812 17:42:49.794032 22431 raft_consensus.cc:482] T da3e044eb24d487ca6d8949184aed27c P 5983b40f0e604b9a997d9fcb66d1ee62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:42:49.794288 22431 raft_consensus.cc:504] T da3e044eb24d487ca6d8949184aed27c P 5983b40f0e604b9a997d9fcb66d1ee62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } } peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } }
I20260812 17:42:49.795679 22431 leader_election.cc:288] T da3e044eb24d487ca6d8949184aed27c P 5983b40f0e604b9a997d9fcb66d1ee62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1edda66438b64b72b9cb7207bba19be3 (127.17.255.2:38853), 1a084a7c37184bf6a819f5abf483f363 (127.17.255.3:36677)
I20260812 17:42:49.800102 22411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:49.796157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:59027 (local address 127.17.255.2:38853)
0812 17:42:49.796387 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:49.796394 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:49.796602 (+ 208us) server_negotiation.cc:407] Connection header received
0812 17:42:49.796787 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:49.796795 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:49.796836 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:49.796922 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:42:49.797223 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.797821 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.799049 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.799475 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.799609 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:49.799669 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:49.799872 (+ 203us) server_negotiation.cc:299] Negotiation successful
0812 17:42:49.799952 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260812 17:42:49.800171 22435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:49.796009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:38853 (local address 127.17.255.1:59027)
0812 17:42:49.796500 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:49.796514 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:49.796668 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:49.796943 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:49.796946 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:49.796963 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:42:49.797105 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:49.797111 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.797954 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.797958 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:49.798922 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:49.798932 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.799610 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.799613 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:49.799717 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:49.799740 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 17:42:49.799840 (+ 100us) client_negotiation.cc:240] Negotiation successful
0812 17:42:49.799936 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":415,"mutex_wait_us":22,"thread_start_us":152,"threads_started":1}
I20260812 17:42:49.800163 22413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:49.796189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:54261 (local address 127.17.255.3:36677)
0812 17:42:49.796402 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:49.796409 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:49.796678 (+ 269us) server_negotiation.cc:407] Connection header received
0812 17:42:49.796874 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:49.796877 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:49.796917 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:49.797005 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:42:49.797321 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.797868 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.799048 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.799519 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.799653 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:49.799714 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:49.799943 (+ 229us) server_negotiation.cc:299] Negotiation successful
0812 17:42:49.800017 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 17:42:49.800390 22437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:49.796008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.3:36677 (local address 127.17.255.1:54261)
0812 17:42:49.796566 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:49.796580 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:49.796726 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:49.797018 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:49.797021 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:49.797037 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:42:49.797175 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:49.797180 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.797988 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.797993 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:49.798924 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:49.798933 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.799643 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.799647 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:49.799763 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:49.799784 (+ 21us) client_negotiation.cc:769] Sending connection context
0812 17:42:49.799924 (+ 140us) client_negotiation.cc:240] Negotiation successful
0812 17:42:49.799999 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"mutex_wait_us":266,"thread_start_us":126,"threads_started":1}
I20260812 17:42:49.801061 22068 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da3e044eb24d487ca6d8949184aed27c" candidate_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edda66438b64b72b9cb7207bba19be3" is_pre_election: true
I20260812 17:42:49.801095 22295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da3e044eb24d487ca6d8949184aed27c" candidate_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a084a7c37184bf6a819f5abf483f363" is_pre_election: true
I20260812 17:42:49.801451 22295 raft_consensus.cc:2454] T da3e044eb24d487ca6d8949184aed27c P 1a084a7c37184bf6a819f5abf483f363 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5983b40f0e604b9a997d9fcb66d1ee62 in term 0.
I20260812 17:42:49.801451 22068 raft_consensus.cc:2454] T da3e044eb24d487ca6d8949184aed27c P 1edda66438b64b72b9cb7207bba19be3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5983b40f0e604b9a997d9fcb66d1ee62 in term 0.
I20260812 17:42:49.802057 21685 leader_election.cc:302] T da3e044eb24d487ca6d8949184aed27c P 5983b40f0e604b9a997d9fcb66d1ee62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1a084a7c37184bf6a819f5abf483f363, 1edda66438b64b72b9cb7207bba19be3, 5983b40f0e604b9a997d9fcb66d1ee62; no voters:
I20260812 17:42:49.802390 22431 raft_consensus.cc:2781] T da3e044eb24d487ca6d8949184aed27c P 5983b40f0e604b9a997d9fcb66d1ee62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 17:42:49.802510 22431 raft_consensus.cc:482] T da3e044eb24d487ca6d8949184aed27c P 5983b40f0e604b9a997d9fcb66d1ee62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 17:42:49.802610 22431 raft_consensus.cc:3037] T da3e044eb24d487ca6d8949184aed27c P 5983b40f0e604b9a997d9fcb66d1ee62 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:42:49.803817 22431 raft_consensus.cc:504] T da3e044eb24d487ca6d8949184aed27c P 5983b40f0e604b9a997d9fcb66d1ee62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } } peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } }
I20260812 17:42:49.804265 22431 leader_election.cc:288] T da3e044eb24d487ca6d8949184aed27c P 5983b40f0e604b9a997d9fcb66d1ee62 [CANDIDATE]: Term 1 election: Requested vote from peers 1edda66438b64b72b9cb7207bba19be3 (127.17.255.2:38853), 1a084a7c37184bf6a819f5abf483f363 (127.17.255.3:36677)
I20260812 17:42:49.804973 22068 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da3e044eb24d487ca6d8949184aed27c" candidate_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edda66438b64b72b9cb7207bba19be3"
I20260812 17:42:49.804973 22295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da3e044eb24d487ca6d8949184aed27c" candidate_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a084a7c37184bf6a819f5abf483f363"
I20260812 17:42:49.805141 22295 raft_consensus.cc:3037] T da3e044eb24d487ca6d8949184aed27c P 1a084a7c37184bf6a819f5abf483f363 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:42:49.805141 22068 raft_consensus.cc:3037] T da3e044eb24d487ca6d8949184aed27c P 1edda66438b64b72b9cb7207bba19be3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:42:49.806857 22295 raft_consensus.cc:2454] T da3e044eb24d487ca6d8949184aed27c P 1a084a7c37184bf6a819f5abf483f363 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5983b40f0e604b9a997d9fcb66d1ee62 in term 1.
I20260812 17:42:49.807318 22068 raft_consensus.cc:2454] T da3e044eb24d487ca6d8949184aed27c P 1edda66438b64b72b9cb7207bba19be3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5983b40f0e604b9a997d9fcb66d1ee62 in term 1.
I20260812 17:42:49.807348 21684 leader_election.cc:302] T da3e044eb24d487ca6d8949184aed27c P 5983b40f0e604b9a997d9fcb66d1ee62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a084a7c37184bf6a819f5abf483f363, 5983b40f0e604b9a997d9fcb66d1ee62; no voters:
I20260812 17:42:49.807612 22431 raft_consensus.cc:2781] T da3e044eb24d487ca6d8949184aed27c P 5983b40f0e604b9a997d9fcb66d1ee62 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:42:49.807920 22431 raft_consensus.cc:686] T da3e044eb24d487ca6d8949184aed27c P 5983b40f0e604b9a997d9fcb66d1ee62 [term 1 LEADER]: Becoming Leader. State: Replica: 5983b40f0e604b9a997d9fcb66d1ee62, State: Running, Role: LEADER
I20260812 17:42:49.808430 22431 consensus_queue.cc:237] T da3e044eb24d487ca6d8949184aed27c P 5983b40f0e604b9a997d9fcb66d1ee62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } } peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } }
I20260812 17:42:49.812608 21532 catalog_manager.cc:5495] T da3e044eb24d487ca6d8949184aed27c P 5983b40f0e604b9a997d9fcb66d1ee62 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5983b40f0e604b9a997d9fcb66d1ee62 (127.17.255.1). New cstate: current_term: 1 leader_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } health_report { overall_health: HEALTHY } } }
Aug 12 17:42:49 dist-test-slave-tk9z krb5kdc[21450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556568, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:42:49.854235 22451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:49.844395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40627 (local address 127.0.0.1:56628)
0812 17:42:49.844835 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:49.844850 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:49.844962 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:49.845218 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:49.845220 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:49.845648 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:42:49.845776 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:49.845809 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.846703 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.846706 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:49.847297 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:49.847306 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.847869 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.847872 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:49.847971 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:49.848656 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:42:49.848676 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:42:49.850601 (+ 1925us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:42:49.852340 (+ 1739us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:49.852350 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:49.852357 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:49.852647 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:49.852984 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:49.852987 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:49.852988 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:49.853127 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:49.853576 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:42:49.853582 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:42:49.853710 (+ 128us) client_negotiation.cc:769] Sending connection context
0812 17:42:49.853825 (+ 115us) client_negotiation.cc:240] Negotiation successful
0812 17:42:49.854016 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":148,"threads_started":1}
I20260812 17:42:49.854314 21615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:49.844458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56628 (local address 127.17.255.62:40627)
0812 17:42:49.844615 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:49.844643 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:49.844914 (+ 271us) server_negotiation.cc:407] Connection header received
0812 17:42:49.845051 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:49.845053 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:49.845099 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:49.845176 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:42:49.845917 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.846582 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.847478 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.847735 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.847854 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:49.850799 (+ 2945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:42:49.850803 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:42:49.850805 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:42:49.850828 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:42:49.852207 (+ 1379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:49.852757 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:49.852761 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:49.852762 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:49.852848 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:49.853221 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:49.853225 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:49.853226 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:49.853440 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:42:49.853536 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:49.853950 (+ 414us) server_negotiation.cc:299] Negotiation successful
0812 17:42:49.854149 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":59}
I20260812 17:42:49.859134 21532 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:56628:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 17:42:49.859987 21532 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 17:42:49.865332 22022 tablet_service.cc:1467] Processing CreateTablet for tablet 63b0fb7e8a6044f4bf6ef2637743b0dd (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=403c1e730e24441792ede56e00333012]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 17:42:49.865334 21772 tablet_service.cc:1467] Processing CreateTablet for tablet 63b0fb7e8a6044f4bf6ef2637743b0dd (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=403c1e730e24441792ede56e00333012]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 17:42:49.865597 22263 tablet_service.cc:1467] Processing CreateTablet for tablet 63b0fb7e8a6044f4bf6ef2637743b0dd (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=403c1e730e24441792ede56e00333012]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 17:42:49.866210 22263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63b0fb7e8a6044f4bf6ef2637743b0dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:42:49.866210 21772 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63b0fb7e8a6044f4bf6ef2637743b0dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:42:49.866218 22022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63b0fb7e8a6044f4bf6ef2637743b0dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:42:49.869660 22423 tablet_bootstrap.cc:492] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1a084a7c37184bf6a819f5abf483f363: Bootstrap starting.
I20260812 17:42:49.870559 22417 tablet_bootstrap.cc:492] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1edda66438b64b72b9cb7207bba19be3: Bootstrap starting.
I20260812 17:42:49.870623 22421 tablet_bootstrap.cc:492] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 5983b40f0e604b9a997d9fcb66d1ee62: Bootstrap starting.
I20260812 17:42:49.871229 22423 tablet_bootstrap.cc:654] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1a084a7c37184bf6a819f5abf483f363: Neither blocks nor log segments found. Creating new log.
I20260812 17:42:49.871531 22417 tablet_bootstrap.cc:654] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1edda66438b64b72b9cb7207bba19be3: Neither blocks nor log segments found. Creating new log.
I20260812 17:42:49.872243 22421 tablet_bootstrap.cc:654] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 5983b40f0e604b9a997d9fcb66d1ee62: Neither blocks nor log segments found. Creating new log.
I20260812 17:42:49.873523 22423 tablet_bootstrap.cc:492] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1a084a7c37184bf6a819f5abf483f363: No bootstrap required, opened a new log
I20260812 17:42:49.873623 22417 tablet_bootstrap.cc:492] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1edda66438b64b72b9cb7207bba19be3: No bootstrap required, opened a new log
I20260812 17:42:49.873679 22423 ts_tablet_manager.cc:1397] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1a084a7c37184bf6a819f5abf483f363: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260812 17:42:49.873729 22417 ts_tablet_manager.cc:1397] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1edda66438b64b72b9cb7207bba19be3: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 17:42:49.874421 22417 raft_consensus.cc:348] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1edda66438b64b72b9cb7207bba19be3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } }
I20260812 17:42:49.874580 22417 raft_consensus.cc:374] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1edda66438b64b72b9cb7207bba19be3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:42:49.874528 22423 raft_consensus.cc:348] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1a084a7c37184bf6a819f5abf483f363 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } }
I20260812 17:42:49.874624 22417 raft_consensus.cc:729] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1edda66438b64b72b9cb7207bba19be3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1edda66438b64b72b9cb7207bba19be3, State: Initialized, Role: FOLLOWER
I20260812 17:42:49.874663 22423 raft_consensus.cc:374] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1a084a7c37184bf6a819f5abf483f363 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:42:49.874698 22423 raft_consensus.cc:729] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1a084a7c37184bf6a819f5abf483f363 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a084a7c37184bf6a819f5abf483f363, State: Initialized, Role: FOLLOWER
I20260812 17:42:49.874784 22417 consensus_queue.cc:260] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1edda66438b64b72b9cb7207bba19be3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } }
I20260812 17:42:49.874855 22423 consensus_queue.cc:260] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1a084a7c37184bf6a819f5abf483f363 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } }
I20260812 17:42:49.875083 22417 ts_tablet_manager.cc:1428] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1edda66438b64b72b9cb7207bba19be3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 17:42:49.875175 22423 ts_tablet_manager.cc:1428] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1a084a7c37184bf6a819f5abf483f363: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260812 17:42:49.875159 22429 tablet_replica.cc:439] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1edda66438b64b72b9cb7207bba19be3: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } } }
I20260812 17:42:49.875219 22430 tablet_replica.cc:439] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1a084a7c37184bf6a819f5abf483f363: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } } }
I20260812 17:42:49.875335 22429 tablet_replica.cc:442] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1edda66438b64b72b9cb7207bba19be3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 17:42:49.875389 22430 tablet_replica.cc:442] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1a084a7c37184bf6a819f5abf483f363: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 17:42:49.875662 22421 tablet_bootstrap.cc:492] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 5983b40f0e604b9a997d9fcb66d1ee62: No bootstrap required, opened a new log
I20260812 17:42:49.875757 22421 ts_tablet_manager.cc:1397] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 5983b40f0e604b9a997d9fcb66d1ee62: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 17:42:49.876696 22421 raft_consensus.cc:348] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 5983b40f0e604b9a997d9fcb66d1ee62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } }
I20260812 17:42:49.876824 22421 raft_consensus.cc:374] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 5983b40f0e604b9a997d9fcb66d1ee62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:42:49.876864 22421 raft_consensus.cc:729] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 5983b40f0e604b9a997d9fcb66d1ee62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5983b40f0e604b9a997d9fcb66d1ee62, State: Initialized, Role: FOLLOWER
I20260812 17:42:49.877070 22421 consensus_queue.cc:260] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 5983b40f0e604b9a997d9fcb66d1ee62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } }
I20260812 17:42:49.877405 22421 ts_tablet_manager.cc:1428] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 5983b40f0e604b9a997d9fcb66d1ee62: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 17:42:49.877475 22431 tablet_replica.cc:439] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 5983b40f0e604b9a997d9fcb66d1ee62: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } } }
I20260812 17:42:49.877653 22431 tablet_replica.cc:442] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 5983b40f0e604b9a997d9fcb66d1ee62: This TxnStatusTablet replica's current role is: FOLLOWER
W20260812 17:42:49.879851 22377 tablet.cc:2369] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1a084a7c37184bf6a819f5abf483f363: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 17:42:49.886080 22144 tablet.cc:2369] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1edda66438b64b72b9cb7207bba19be3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 17:42:49.892813 21882 tablet.cc:2369] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 5983b40f0e604b9a997d9fcb66d1ee62: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 17:42:49.966477 22429 raft_consensus.cc:482] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1edda66438b64b72b9cb7207bba19be3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:42:49.966661 22429 raft_consensus.cc:504] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1edda66438b64b72b9cb7207bba19be3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } }
I20260812 17:42:49.968137 22429 leader_election.cc:288] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1edda66438b64b72b9cb7207bba19be3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5983b40f0e604b9a997d9fcb66d1ee62 (127.17.255.1:35505), 1a084a7c37184bf6a819f5abf483f363 (127.17.255.3:36677)
I20260812 17:42:49.972743 22416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:49.968650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:39183 (local address 127.17.255.1:35505)
0812 17:42:49.968786 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:49.968792 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:49.969077 (+ 285us) server_negotiation.cc:407] Connection header received
0812 17:42:49.969255 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:49.969262 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:49.969328 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:49.969413 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:42:49.969762 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.970566 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.971683 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.972113 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.972246 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:49.972302 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:49.972525 (+ 223us) server_negotiation.cc:299] Negotiation successful
0812 17:42:49.972641 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 17:42:49.972790 22457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:49.968536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:35505 (local address 127.17.255.2:39183)
0812 17:42:49.968961 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:49.968974 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:49.969123 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:49.969430 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:49.969436 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:49.969459 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:42:49.969635 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:49.969642 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.970679 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.970683 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:49.971549 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:49.971558 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.972240 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.972244 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:49.972390 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:49.972412 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 17:42:49.972506 (+ 94us) client_negotiation.cc:240] Negotiation successful
0812 17:42:49.972583 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":359,"mutex_wait_us":32,"thread_start_us":153,"threads_started":1}
I20260812 17:42:49.972803 22413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:49.968687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:59979 (local address 127.17.255.3:36677)
0812 17:42:49.968827 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:49.968832 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:49.969134 (+ 302us) server_negotiation.cc:407] Connection header received
0812 17:42:49.969337 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:49.969341 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:49.969397 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:49.969469 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:42:49.969973 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.970605 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.971765 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.972152 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.972281 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:49.972336 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:49.972604 (+ 268us) server_negotiation.cc:299] Negotiation successful
0812 17:42:49.972676 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 17:42:49.973027 22458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:49.968536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.3:36677 (local address 127.17.255.2:59979)
0812 17:42:49.969039 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:49.969055 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:49.969167 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:49.969583 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:49.969586 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:49.969603 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:42:49.969832 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:49.969841 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.970721 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.970725 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:49.971629 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:49.971639 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:49.972281 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:49.972285 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:49.972472 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:49.972492 (+ 20us) client_negotiation.cc:769] Sending connection context
0812 17:42:49.972585 (+ 93us) client_negotiation.cc:240] Negotiation successful
0812 17:42:49.972659 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":433,"mutex_wait_us":270,"thread_start_us":61,"threads_started":1}
I20260812 17:42:49.973446 21801 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63b0fb7e8a6044f4bf6ef2637743b0dd" candidate_uuid: "1edda66438b64b72b9cb7207bba19be3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" is_pre_election: true
I20260812 17:42:49.973544 22295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63b0fb7e8a6044f4bf6ef2637743b0dd" candidate_uuid: "1edda66438b64b72b9cb7207bba19be3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a084a7c37184bf6a819f5abf483f363" is_pre_election: true
I20260812 17:42:49.973765 22295 raft_consensus.cc:2454] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1a084a7c37184bf6a819f5abf483f363 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1edda66438b64b72b9cb7207bba19be3 in term 0.
I20260812 17:42:49.973762 21801 raft_consensus.cc:2454] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 5983b40f0e604b9a997d9fcb66d1ee62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1edda66438b64b72b9cb7207bba19be3 in term 0.
I20260812 17:42:49.974289 21928 leader_election.cc:302] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1edda66438b64b72b9cb7207bba19be3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1a084a7c37184bf6a819f5abf483f363, 1edda66438b64b72b9cb7207bba19be3, 5983b40f0e604b9a997d9fcb66d1ee62; no voters:
I20260812 17:42:49.974684 22429 raft_consensus.cc:2781] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1edda66438b64b72b9cb7207bba19be3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 17:42:49.974745 22429 raft_consensus.cc:482] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1edda66438b64b72b9cb7207bba19be3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 17:42:49.974773 22429 raft_consensus.cc:3037] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1edda66438b64b72b9cb7207bba19be3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:42:49.975955 22429 raft_consensus.cc:504] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1edda66438b64b72b9cb7207bba19be3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } }
I20260812 17:42:49.976385 22429 leader_election.cc:288] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1edda66438b64b72b9cb7207bba19be3 [CANDIDATE]: Term 1 election: Requested vote from peers 5983b40f0e604b9a997d9fcb66d1ee62 (127.17.255.1:35505), 1a084a7c37184bf6a819f5abf483f363 (127.17.255.3:36677)
I20260812 17:42:49.976790 22295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63b0fb7e8a6044f4bf6ef2637743b0dd" candidate_uuid: "1edda66438b64b72b9cb7207bba19be3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a084a7c37184bf6a819f5abf483f363"
I20260812 17:42:49.976791 21801 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63b0fb7e8a6044f4bf6ef2637743b0dd" candidate_uuid: "1edda66438b64b72b9cb7207bba19be3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5983b40f0e604b9a997d9fcb66d1ee62"
I20260812 17:42:49.976928 22295 raft_consensus.cc:3037] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1a084a7c37184bf6a819f5abf483f363 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:42:49.976928 21801 raft_consensus.cc:3037] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 5983b40f0e604b9a997d9fcb66d1ee62 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:42:49.978248 22295 raft_consensus.cc:2454] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1a084a7c37184bf6a819f5abf483f363 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1edda66438b64b72b9cb7207bba19be3 in term 1.
I20260812 17:42:49.978248 21801 raft_consensus.cc:2454] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 5983b40f0e604b9a997d9fcb66d1ee62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1edda66438b64b72b9cb7207bba19be3 in term 1.
I20260812 17:42:49.978618 21929 leader_election.cc:302] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1edda66438b64b72b9cb7207bba19be3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1edda66438b64b72b9cb7207bba19be3, 5983b40f0e604b9a997d9fcb66d1ee62; no voters:
I20260812 17:42:49.978909 22429 raft_consensus.cc:2781] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1edda66438b64b72b9cb7207bba19be3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:42:49.979142 22429 raft_consensus.cc:686] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1edda66438b64b72b9cb7207bba19be3 [term 1 LEADER]: Becoming Leader. State: Replica: 1edda66438b64b72b9cb7207bba19be3, State: Running, Role: LEADER
I20260812 17:42:49.979529 22429 consensus_queue.cc:237] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1edda66438b64b72b9cb7207bba19be3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } }
I20260812 17:42:49.981899 22461 tablet_replica.cc:439] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1edda66438b64b72b9cb7207bba19be3: TxnStatusTablet state changed. Reason: New leader 1edda66438b64b72b9cb7207bba19be3. Latest consensus state: current_term: 1 leader_uuid: "1edda66438b64b72b9cb7207bba19be3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } } }
I20260812 17:42:49.982025 22461 tablet_replica.cc:442] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1edda66438b64b72b9cb7207bba19be3: This TxnStatusTablet replica's current role is: LEADER
I20260812 17:42:49.982487 22463 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 17:42:49.982750 22463 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 17:42:49.983574 21527 catalog_manager.cc:5495] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1edda66438b64b72b9cb7207bba19be3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1edda66438b64b72b9cb7207bba19be3 (127.17.255.2). New cstate: current_term: 1 leader_uuid: "1edda66438b64b72b9cb7207bba19be3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } health_report { overall_health: UNKNOWN } } }
I20260812 17:42:50.008569 22411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:50.003177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43944 (local address 127.17.255.2:38853)
0812 17:42:50.003352 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:50.003357 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:50.003397 (+ 40us) server_negotiation.cc:407] Connection header received
0812 17:42:50.003482 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:50.003485 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:50.003553 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:50.003664 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:42:50.004025 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:50.004910 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:50.006018 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:50.006489 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:50.006639 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:50.007029 (+ 390us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:42:50.007955 (+ 926us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:42:50.008097 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:50.008328 (+ 231us) server_negotiation.cc:299] Negotiation successful
0812 17:42:50.008407 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 17:42:50.008697 22451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:50.002714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:38853 (local address 127.0.0.1:43944)
0812 17:42:50.003124 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:50.003145 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:50.003294 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:50.003771 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:50.003774 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:50.003782 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 17:42:50.003892 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:50.003897 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:50.005106 (+ 1209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:50.005109 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:50.005845 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:50.005857 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:50.006686 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:50.006690 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:50.006776 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:50.006840 (+ 64us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 17:42:50.008103 (+ 1263us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 17:42:50.008129 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 17:42:50.008310 (+ 181us) client_negotiation.cc:240] Negotiation successful
0812 17:42:50.008515 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175}
I20260812 17:42:50.015976 21801 raft_consensus.cc:1261] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 5983b40f0e604b9a997d9fcb66d1ee62 [term 1 FOLLOWER]: Refusing update from remote peer 1edda66438b64b72b9cb7207bba19be3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:42:50.015976 22295 raft_consensus.cc:1261] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1a084a7c37184bf6a819f5abf483f363 [term 1 FOLLOWER]: Refusing update from remote peer 1edda66438b64b72b9cb7207bba19be3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:42:50.016758 22461 consensus_queue.cc:1035] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1edda66438b64b72b9cb7207bba19be3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:42:50.017267 22461 consensus_queue.cc:1035] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1edda66438b64b72b9cb7207bba19be3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:42:50.022261 22431 tablet_replica.cc:439] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 5983b40f0e604b9a997d9fcb66d1ee62: TxnStatusTablet state changed. Reason: New leader 1edda66438b64b72b9cb7207bba19be3. Latest consensus state: current_term: 1 leader_uuid: "1edda66438b64b72b9cb7207bba19be3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } } }
I20260812 17:42:50.022464 22431 tablet_replica.cc:442] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 5983b40f0e604b9a997d9fcb66d1ee62: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 17:42:50.025431 22430 tablet_replica.cc:439] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1a084a7c37184bf6a819f5abf483f363: TxnStatusTablet state changed. Reason: New leader 1edda66438b64b72b9cb7207bba19be3. Latest consensus state: current_term: 1 leader_uuid: "1edda66438b64b72b9cb7207bba19be3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } } }
I20260812 17:42:50.025600 22430 tablet_replica.cc:442] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1a084a7c37184bf6a819f5abf483f363: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 17:42:50.029007 22461 tablet_replica.cc:439] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1edda66438b64b72b9cb7207bba19be3: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1edda66438b64b72b9cb7207bba19be3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } } }
I20260812 17:42:50.029174 22461 tablet_replica.cc:442] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1edda66438b64b72b9cb7207bba19be3: This TxnStatusTablet replica's current role is: LEADER
I20260812 17:42:50.029338 22461 tablet_replica.cc:439] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1edda66438b64b72b9cb7207bba19be3: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1edda66438b64b72b9cb7207bba19be3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } } }
I20260812 17:42:50.029452 22461 tablet_replica.cc:442] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1edda66438b64b72b9cb7207bba19be3: This TxnStatusTablet replica's current role is: LEADER
I20260812 17:42:50.029673 22430 tablet_replica.cc:439] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1a084a7c37184bf6a819f5abf483f363: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1edda66438b64b72b9cb7207bba19be3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } } }
I20260812 17:42:50.029786 22430 tablet_replica.cc:442] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 1a084a7c37184bf6a819f5abf483f363: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 17:42:50.029992 22431 tablet_replica.cc:439] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 5983b40f0e604b9a997d9fcb66d1ee62: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1edda66438b64b72b9cb7207bba19be3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } } }
I20260812 17:42:50.030157 22431 tablet_replica.cc:442] T 63b0fb7e8a6044f4bf6ef2637743b0dd P 5983b40f0e604b9a997d9fcb66d1ee62: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 17:42:50.030540 22472 mvcc.cc:205] Tried to move back new op lower bound from 7317735710776528896 to 7317735710638862336. Current Snapshot: MvccSnapshot[applied={T|T < 7317735710776528896}]
I20260812 17:42:50.031039 22468 mvcc.cc:205] Tried to move back new op lower bound from 7317735710776528896 to 7317735710638862336. Current Snapshot: MvccSnapshot[applied={T|T < 7317735710776528896}]
I20260812 17:42:50.043607 22416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:50.038797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50696 (local address 127.17.255.1:35505)
0812 17:42:50.038937 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:50.038942 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:50.038960 (+ 18us) server_negotiation.cc:407] Connection header received
0812 17:42:50.039057 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:50.039060 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:50.039126 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:50.039251 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:42:50.039566 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:50.040085 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:50.041555 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:50.041903 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:50.042009 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:50.042529 (+ 520us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:42:50.043103 (+ 574us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:42:50.043214 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:50.043349 (+ 135us) server_negotiation.cc:299] Negotiation successful
0812 17:42:50.043419 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 17:42:50.058326 22411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:50.053735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:44263 (local address 127.17.255.2:38853)
0812 17:42:50.053932 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:50.053938 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:50.054296 (+ 358us) server_negotiation.cc:407] Connection header received
0812 17:42:50.054558 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:50.054560 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:50.054638 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:50.054742 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:42:50.055207 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:50.055859 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:50.057036 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:50.057267 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:50.057389 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:50.057807 (+ 418us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:42:50.057896 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:42:50.057980 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:50.058077 (+ 97us) server_negotiation.cc:299] Negotiation successful
0812 17:42:50.058133 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 17:42:50.058478 22491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:50.053653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:38853 (local address 127.17.255.1:44263)
0812 17:42:50.054207 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:50.054224 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:50.054454 (+ 230us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:50.054758 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:50.054762 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:50.054769 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 17:42:50.055077 (+ 308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:50.055092 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:50.055989 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:50.055993 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:50.056899 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:50.056910 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:50.057399 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:50.057402 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:50.057558 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:50.057615 (+ 57us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 17:42:50.057990 (+ 375us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 17:42:50.057998 (+ 8us) client_negotiation.cc:769] Sending connection context
0812 17:42:50.058066 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 17:42:50.058155 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":192,"threads_started":1}
I20260812 17:42:50.067965 22295 raft_consensus.cc:1261] T da3e044eb24d487ca6d8949184aed27c P 1a084a7c37184bf6a819f5abf483f363 [term 1 FOLLOWER]: Refusing update from remote peer 5983b40f0e604b9a997d9fcb66d1ee62: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:42:50.068245 22068 raft_consensus.cc:1261] T da3e044eb24d487ca6d8949184aed27c P 1edda66438b64b72b9cb7207bba19be3 [term 1 FOLLOWER]: Refusing update from remote peer 5983b40f0e604b9a997d9fcb66d1ee62: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:42:50.068652 22439 consensus_queue.cc:1035] T da3e044eb24d487ca6d8949184aed27c P 5983b40f0e604b9a997d9fcb66d1ee62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:42:50.069453 22439 consensus_queue.cc:1035] T da3e044eb24d487ca6d8949184aed27c P 5983b40f0e604b9a997d9fcb66d1ee62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:42:50.082991 22467 mvcc.cc:205] Tried to move back new op lower bound from 7317735710992064512 to 7317735709939171328. Current Snapshot: MvccSnapshot[applied={T|T < 7317735710992064512}]
I20260812 17:42:50.098949 22416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:50.094004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:47727 (local address 127.17.255.1:35505)
0812 17:42:50.094137 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:50.094142 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:50.094160 (+ 18us) server_negotiation.cc:407] Connection header received
0812 17:42:50.094404 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:50.094408 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:50.094470 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:50.094525 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:42:50.095258 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:50.095788 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:50.097346 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:50.097733 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:50.097905 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:50.098355 (+ 450us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:42:50.098477 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:42:50.098524 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:50.098689 (+ 165us) server_negotiation.cc:299] Negotiation successful
0812 17:42:50.098757 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 17:42:50.099376 22506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:50.093503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:35505 (local address 127.17.255.2:47727)
0812 17:42:50.094081 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:50.094099 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:50.094204 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:50.094679 (+ 475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:50.094682 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:50.094690 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 17:42:50.095144 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:50.095157 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:50.095907 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:50.095911 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:50.097193 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:50.097206 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:50.098036 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:50.098039 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:50.098132 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:50.098192 (+ 60us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 17:42:50.098590 (+ 398us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 17:42:50.098596 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 17:42:50.099127 (+ 531us) client_negotiation.cc:240] Negotiation successful
0812 17:42:50.099223 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":176,"threads_started":1}
I20260812 17:42:50.136294 21527 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56616:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:42:50.136561 21527 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56616:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:42:50.143541 21527 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5d6ff83821404879969adb68e2c4e4da: Sending DeleteTablet for 3 replicas of tablet da3e044eb24d487ca6d8949184aed27c
I20260812 17:42:50.144832 22022 tablet_service.cc:1514] Processing DeleteTablet for tablet da3e044eb24d487ca6d8949184aed27c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:42:50 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:43934
I20260812 17:42:50.145062 21772 tablet_service.cc:1514] Processing DeleteTablet for tablet da3e044eb24d487ca6d8949184aed27c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:42:50 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:50690
I20260812 17:42:50.145701 22263 tablet_service.cc:1514] Processing DeleteTablet for tablet da3e044eb24d487ca6d8949184aed27c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:42:50 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:59830
I20260812 17:42:50.146531 22516 tablet_replica.cc:330] T da3e044eb24d487ca6d8949184aed27c P 1a084a7c37184bf6a819f5abf483f363: stopping tablet replica
I20260812 17:42:50.146971 22516 raft_consensus.cc:2229] T da3e044eb24d487ca6d8949184aed27c P 1a084a7c37184bf6a819f5abf483f363 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:42:50.146962 21527 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56616:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 17:42:50.147550 21527 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 17:42:50.147594 22516 raft_consensus.cc:2258] T da3e044eb24d487ca6d8949184aed27c P 1a084a7c37184bf6a819f5abf483f363 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:42:50.153988 22513 tablet_replica.cc:330] T da3e044eb24d487ca6d8949184aed27c P 5983b40f0e604b9a997d9fcb66d1ee62: stopping tablet replica
I20260812 17:42:50.154488 22513 raft_consensus.cc:2229] T da3e044eb24d487ca6d8949184aed27c P 5983b40f0e604b9a997d9fcb66d1ee62 [term 1 LEADER]: Raft consensus shutting down.
I20260812 17:42:50.154807 21772 tablet_service.cc:1467] Processing CreateTablet for tablet 385fc9f4fd39404f99c4e37125b93fe4 (DEFAULT_TABLE table=test-table [id=d8eceb84df514e70bcbc25cb12d554f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:42:50.154966 22513 raft_consensus.cc:2258] T da3e044eb24d487ca6d8949184aed27c P 5983b40f0e604b9a997d9fcb66d1ee62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:42:50.154959 22022 tablet_service.cc:1467] Processing CreateTablet for tablet 385fc9f4fd39404f99c4e37125b93fe4 (DEFAULT_TABLE table=test-table [id=d8eceb84df514e70bcbc25cb12d554f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:42:50.155149 21772 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 385fc9f4fd39404f99c4e37125b93fe4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:42:50.155409 22022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 385fc9f4fd39404f99c4e37125b93fe4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:42:50.156690 22513 ts_tablet_manager.cc:1905] T da3e044eb24d487ca6d8949184aed27c P 5983b40f0e604b9a997d9fcb66d1ee62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:42:50.159343 22417 tablet_bootstrap.cc:492] T 385fc9f4fd39404f99c4e37125b93fe4 P 1edda66438b64b72b9cb7207bba19be3: Bootstrap starting.
I20260812 17:42:50.159541 22263 tablet_service.cc:1467] Processing CreateTablet for tablet 385fc9f4fd39404f99c4e37125b93fe4 (DEFAULT_TABLE table=test-table [id=d8eceb84df514e70bcbc25cb12d554f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:42:50.159919 22263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 385fc9f4fd39404f99c4e37125b93fe4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:42:50.161842 22417 tablet_bootstrap.cc:654] T 385fc9f4fd39404f99c4e37125b93fe4 P 1edda66438b64b72b9cb7207bba19be3: Neither blocks nor log segments found. Creating new log.
I20260812 17:42:50.164356 22423 tablet_bootstrap.cc:492] T 385fc9f4fd39404f99c4e37125b93fe4 P 1a084a7c37184bf6a819f5abf483f363: Bootstrap starting.
I20260812 17:42:50.166075 22423 tablet_bootstrap.cc:654] T 385fc9f4fd39404f99c4e37125b93fe4 P 1a084a7c37184bf6a819f5abf483f363: Neither blocks nor log segments found. Creating new log.
I20260812 17:42:50.166659 22512 tablet_replica.cc:330] T da3e044eb24d487ca6d8949184aed27c P 1edda66438b64b72b9cb7207bba19be3: stopping tablet replica
I20260812 17:42:50.167194 22512 raft_consensus.cc:2229] T da3e044eb24d487ca6d8949184aed27c P 1edda66438b64b72b9cb7207bba19be3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:42:50.167446 22512 raft_consensus.cc:2258] T da3e044eb24d487ca6d8949184aed27c P 1edda66438b64b72b9cb7207bba19be3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:42:50.168620 22421 tablet_bootstrap.cc:492] T 385fc9f4fd39404f99c4e37125b93fe4 P 5983b40f0e604b9a997d9fcb66d1ee62: Bootstrap starting.
I20260812 17:42:50.169047 22417 tablet_bootstrap.cc:492] T 385fc9f4fd39404f99c4e37125b93fe4 P 1edda66438b64b72b9cb7207bba19be3: No bootstrap required, opened a new log
I20260812 17:42:50.169148 22417 ts_tablet_manager.cc:1397] T 385fc9f4fd39404f99c4e37125b93fe4 P 1edda66438b64b72b9cb7207bba19be3: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.004s
I20260812 17:42:50.169888 22513 ts_tablet_manager.cc:1918] T da3e044eb24d487ca6d8949184aed27c P 5983b40f0e604b9a997d9fcb66d1ee62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 17:42:50.169981 22421 tablet_bootstrap.cc:654] T 385fc9f4fd39404f99c4e37125b93fe4 P 5983b40f0e604b9a997d9fcb66d1ee62: Neither blocks nor log segments found. Creating new log.
I20260812 17:42:50.170012 22513 log.cc:1196] T da3e044eb24d487ca6d8949184aed27c P 5983b40f0e604b9a997d9fcb66d1ee62: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-0/wal/wals/da3e044eb24d487ca6d8949184aed27c
I20260812 17:42:50.170431 22513 ts_tablet_manager.cc:1939] T da3e044eb24d487ca6d8949184aed27c P 5983b40f0e604b9a997d9fcb66d1ee62: Deleting consensus metadata
I20260812 17:42:50.171375 22417 raft_consensus.cc:348] T 385fc9f4fd39404f99c4e37125b93fe4 P 1edda66438b64b72b9cb7207bba19be3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } }
I20260812 17:42:50.171653 22417 raft_consensus.cc:374] T 385fc9f4fd39404f99c4e37125b93fe4 P 1edda66438b64b72b9cb7207bba19be3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:42:50.171711 22417 raft_consensus.cc:729] T 385fc9f4fd39404f99c4e37125b93fe4 P 1edda66438b64b72b9cb7207bba19be3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1edda66438b64b72b9cb7207bba19be3, State: Initialized, Role: FOLLOWER
I20260812 17:42:50.171916 22417 consensus_queue.cc:260] T 385fc9f4fd39404f99c4e37125b93fe4 P 1edda66438b64b72b9cb7207bba19be3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } }
I20260812 17:42:50.172009 21510 catalog_manager.cc:4841] TS 5983b40f0e604b9a997d9fcb66d1ee62 (127.17.255.1:35505): tablet da3e044eb24d487ca6d8949184aed27c (table test-table [id=80ff98c1784541c8b21be8c81b438d02]) successfully deleted
I20260812 17:42:50.173177 22516 ts_tablet_manager.cc:1905] T da3e044eb24d487ca6d8949184aed27c P 1a084a7c37184bf6a819f5abf483f363: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:42:50.175398 22417 ts_tablet_manager.cc:1428] T 385fc9f4fd39404f99c4e37125b93fe4 P 1edda66438b64b72b9cb7207bba19be3: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260812 17:42:50.176421 22423 tablet_bootstrap.cc:492] T 385fc9f4fd39404f99c4e37125b93fe4 P 1a084a7c37184bf6a819f5abf483f363: No bootstrap required, opened a new log
I20260812 17:42:50.176529 22423 ts_tablet_manager.cc:1397] T 385fc9f4fd39404f99c4e37125b93fe4 P 1a084a7c37184bf6a819f5abf483f363: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.003s
I20260812 17:42:50.177155 22423 raft_consensus.cc:348] T 385fc9f4fd39404f99c4e37125b93fe4 P 1a084a7c37184bf6a819f5abf483f363 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } }
I20260812 17:42:50.177301 22423 raft_consensus.cc:374] T 385fc9f4fd39404f99c4e37125b93fe4 P 1a084a7c37184bf6a819f5abf483f363 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:42:50.177340 22423 raft_consensus.cc:729] T 385fc9f4fd39404f99c4e37125b93fe4 P 1a084a7c37184bf6a819f5abf483f363 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a084a7c37184bf6a819f5abf483f363, State: Initialized, Role: FOLLOWER
I20260812 17:42:50.177485 22423 consensus_queue.cc:260] T 385fc9f4fd39404f99c4e37125b93fe4 P 1a084a7c37184bf6a819f5abf483f363 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } }
I20260812 17:42:50.177747 22423 ts_tablet_manager.cc:1428] T 385fc9f4fd39404f99c4e37125b93fe4 P 1a084a7c37184bf6a819f5abf483f363: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260812 17:42:50.178730 22421 tablet_bootstrap.cc:492] T 385fc9f4fd39404f99c4e37125b93fe4 P 5983b40f0e604b9a997d9fcb66d1ee62: No bootstrap required, opened a new log
I20260812 17:42:50.178851 22421 ts_tablet_manager.cc:1397] T 385fc9f4fd39404f99c4e37125b93fe4 P 5983b40f0e604b9a997d9fcb66d1ee62: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.001s
I20260812 17:42:50.179464 22421 raft_consensus.cc:348] T 385fc9f4fd39404f99c4e37125b93fe4 P 5983b40f0e604b9a997d9fcb66d1ee62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } }
I20260812 17:42:50.179585 22421 raft_consensus.cc:374] T 385fc9f4fd39404f99c4e37125b93fe4 P 5983b40f0e604b9a997d9fcb66d1ee62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:42:50.179618 22421 raft_consensus.cc:729] T 385fc9f4fd39404f99c4e37125b93fe4 P 5983b40f0e604b9a997d9fcb66d1ee62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5983b40f0e604b9a997d9fcb66d1ee62, State: Initialized, Role: FOLLOWER
I20260812 17:42:50.179764 22421 consensus_queue.cc:260] T 385fc9f4fd39404f99c4e37125b93fe4 P 5983b40f0e604b9a997d9fcb66d1ee62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } }
I20260812 17:42:50.180065 22421 ts_tablet_manager.cc:1428] T 385fc9f4fd39404f99c4e37125b93fe4 P 5983b40f0e604b9a997d9fcb66d1ee62: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260812 17:42:50.182611 22516 ts_tablet_manager.cc:1918] T da3e044eb24d487ca6d8949184aed27c P 1a084a7c37184bf6a819f5abf483f363: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 17:42:50.182787 22516 log.cc:1196] T da3e044eb24d487ca6d8949184aed27c P 1a084a7c37184bf6a819f5abf483f363: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-2/wal/wals/da3e044eb24d487ca6d8949184aed27c
I20260812 17:42:50.183218 22516 ts_tablet_manager.cc:1939] T da3e044eb24d487ca6d8949184aed27c P 1a084a7c37184bf6a819f5abf483f363: Deleting consensus metadata
I20260812 17:42:50.184677 21508 catalog_manager.cc:4841] TS 1a084a7c37184bf6a819f5abf483f363 (127.17.255.3:36677): tablet da3e044eb24d487ca6d8949184aed27c (table test-table [id=80ff98c1784541c8b21be8c81b438d02]) successfully deleted
I20260812 17:42:50.185060 22512 ts_tablet_manager.cc:1905] T da3e044eb24d487ca6d8949184aed27c P 1edda66438b64b72b9cb7207bba19be3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:42:50.188854 22512 ts_tablet_manager.cc:1918] T da3e044eb24d487ca6d8949184aed27c P 1edda66438b64b72b9cb7207bba19be3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 17:42:50.189087 22512 log.cc:1196] T da3e044eb24d487ca6d8949184aed27c P 1edda66438b64b72b9cb7207bba19be3: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-1/wal/wals/da3e044eb24d487ca6d8949184aed27c
I20260812 17:42:50.189524 22512 ts_tablet_manager.cc:1939] T da3e044eb24d487ca6d8949184aed27c P 1edda66438b64b72b9cb7207bba19be3: Deleting consensus metadata
I20260812 17:42:50.191169 21510 catalog_manager.cc:4841] TS 1edda66438b64b72b9cb7207bba19be3 (127.17.255.2:38853): tablet da3e044eb24d487ca6d8949184aed27c (table test-table [id=80ff98c1784541c8b21be8c81b438d02]) successfully deleted
I20260812 17:42:50.422401 22461 raft_consensus.cc:482] T 385fc9f4fd39404f99c4e37125b93fe4 P 1edda66438b64b72b9cb7207bba19be3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:42:50.422572 22461 raft_consensus.cc:504] T 385fc9f4fd39404f99c4e37125b93fe4 P 1edda66438b64b72b9cb7207bba19be3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } }
I20260812 17:42:50.423138 22461 leader_election.cc:288] T 385fc9f4fd39404f99c4e37125b93fe4 P 1edda66438b64b72b9cb7207bba19be3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5983b40f0e604b9a997d9fcb66d1ee62 (127.17.255.1:35505), 1a084a7c37184bf6a819f5abf483f363 (127.17.255.3:36677)
I20260812 17:42:50.423750 22295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "385fc9f4fd39404f99c4e37125b93fe4" candidate_uuid: "1edda66438b64b72b9cb7207bba19be3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a084a7c37184bf6a819f5abf483f363" is_pre_election: true
I20260812 17:42:50.423806 21801 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "385fc9f4fd39404f99c4e37125b93fe4" candidate_uuid: "1edda66438b64b72b9cb7207bba19be3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" is_pre_election: true
I20260812 17:42:50.423950 22295 raft_consensus.cc:2454] T 385fc9f4fd39404f99c4e37125b93fe4 P 1a084a7c37184bf6a819f5abf483f363 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1edda66438b64b72b9cb7207bba19be3 in term 0.
I20260812 17:42:50.424048 21801 raft_consensus.cc:2454] T 385fc9f4fd39404f99c4e37125b93fe4 P 5983b40f0e604b9a997d9fcb66d1ee62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1edda66438b64b72b9cb7207bba19be3 in term 0.
I20260812 17:42:50.424364 21928 leader_election.cc:302] T 385fc9f4fd39404f99c4e37125b93fe4 P 1edda66438b64b72b9cb7207bba19be3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a084a7c37184bf6a819f5abf483f363, 1edda66438b64b72b9cb7207bba19be3; no voters:
I20260812 17:42:50.424603 22461 raft_consensus.cc:2781] T 385fc9f4fd39404f99c4e37125b93fe4 P 1edda66438b64b72b9cb7207bba19be3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 17:42:50.424703 22461 raft_consensus.cc:482] T 385fc9f4fd39404f99c4e37125b93fe4 P 1edda66438b64b72b9cb7207bba19be3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 17:42:50.424765 22461 raft_consensus.cc:3037] T 385fc9f4fd39404f99c4e37125b93fe4 P 1edda66438b64b72b9cb7207bba19be3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:42:50.438743 22461 raft_consensus.cc:504] T 385fc9f4fd39404f99c4e37125b93fe4 P 1edda66438b64b72b9cb7207bba19be3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } }
I20260812 17:42:50.439662 22461 leader_election.cc:288] T 385fc9f4fd39404f99c4e37125b93fe4 P 1edda66438b64b72b9cb7207bba19be3 [CANDIDATE]: Term 1 election: Requested vote from peers 5983b40f0e604b9a997d9fcb66d1ee62 (127.17.255.1:35505), 1a084a7c37184bf6a819f5abf483f363 (127.17.255.3:36677)
I20260812 17:42:50.440229 21801 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "385fc9f4fd39404f99c4e37125b93fe4" candidate_uuid: "1edda66438b64b72b9cb7207bba19be3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5983b40f0e604b9a997d9fcb66d1ee62"
I20260812 17:42:50.440236 22295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "385fc9f4fd39404f99c4e37125b93fe4" candidate_uuid: "1edda66438b64b72b9cb7207bba19be3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a084a7c37184bf6a819f5abf483f363"
I20260812 17:42:50.440443 22295 raft_consensus.cc:3037] T 385fc9f4fd39404f99c4e37125b93fe4 P 1a084a7c37184bf6a819f5abf483f363 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:42:50.440446 21801 raft_consensus.cc:3037] T 385fc9f4fd39404f99c4e37125b93fe4 P 5983b40f0e604b9a997d9fcb66d1ee62 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:42:50.441560 21801 raft_consensus.cc:2454] T 385fc9f4fd39404f99c4e37125b93fe4 P 5983b40f0e604b9a997d9fcb66d1ee62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1edda66438b64b72b9cb7207bba19be3 in term 1.
I20260812 17:42:50.442050 21929 leader_election.cc:302] T 385fc9f4fd39404f99c4e37125b93fe4 P 1edda66438b64b72b9cb7207bba19be3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1edda66438b64b72b9cb7207bba19be3, 5983b40f0e604b9a997d9fcb66d1ee62; no voters:
I20260812 17:42:50.442071 22295 raft_consensus.cc:2454] T 385fc9f4fd39404f99c4e37125b93fe4 P 1a084a7c37184bf6a819f5abf483f363 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1edda66438b64b72b9cb7207bba19be3 in term 1.
I20260812 17:42:50.442293 22461 raft_consensus.cc:2781] T 385fc9f4fd39404f99c4e37125b93fe4 P 1edda66438b64b72b9cb7207bba19be3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:42:50.442538 22461 raft_consensus.cc:686] T 385fc9f4fd39404f99c4e37125b93fe4 P 1edda66438b64b72b9cb7207bba19be3 [term 1 LEADER]: Becoming Leader. State: Replica: 1edda66438b64b72b9cb7207bba19be3, State: Running, Role: LEADER
I20260812 17:42:50.442764 22461 consensus_queue.cc:237] T 385fc9f4fd39404f99c4e37125b93fe4 P 1edda66438b64b72b9cb7207bba19be3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } }
I20260812 17:42:50.444655 21531 catalog_manager.cc:5495] T 385fc9f4fd39404f99c4e37125b93fe4 P 1edda66438b64b72b9cb7207bba19be3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1edda66438b64b72b9cb7207bba19be3 (127.17.255.2). New cstate: current_term: 1 leader_uuid: "1edda66438b64b72b9cb7207bba19be3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } health_report { overall_health: UNKNOWN } } }
I20260812 17:42:50.483031 22411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:50.479614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43954 (local address 127.17.255.2:38853)
0812 17:42:50.479738 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:50.479742 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:50.479756 (+ 14us) server_negotiation.cc:407] Connection header received
0812 17:42:50.479904 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:50.479906 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:50.479951 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:50.480022 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:42:50.480393 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:50.480919 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:50.481820 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:50.482053 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:50.482143 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:50.482478 (+ 335us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:42:50.482571 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:42:50.482634 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:50.482857 (+ 223us) server_negotiation.cc:299] Negotiation successful
0812 17:42:50.482912 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 17:42:50.493449 22506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:50.490446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:38853 (local address 127.17.255.2:60367)
0812 17:42:50.490609 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:50.490633 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:50.490723 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:50.490948 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:50.490950 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:50.490956 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 17:42:50.491046 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:50.491050 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:50.491807 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:50.491809 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:50.492406 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:50.492415 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:50.492852 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:50.492855 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:50.492915 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:50.492942 (+ 27us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 17:42:50.493177 (+ 235us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 17:42:50.493182 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 17:42:50.493230 (+ 48us) client_negotiation.cc:240] Negotiation successful
0812 17:42:50.493298 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260812 17:42:50.493451 22411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:50.490469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:60367 (local address 127.17.255.2:38853)
0812 17:42:50.490595 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:50.490598 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:50.490690 (+ 92us) server_negotiation.cc:407] Connection header received
0812 17:42:50.490804 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:50.490806 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:50.490848 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:50.490922 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:42:50.491135 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:50.491695 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:50.492505 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:50.492750 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:50.492828 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:50.493038 (+ 210us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:42:50.493104 (+ 66us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:42:50.493157 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:50.493236 (+ 79us) server_negotiation.cc:299] Negotiation successful
0812 17:42:50.493283 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":42}
I20260812 17:42:50.499570 21801 raft_consensus.cc:1261] T 385fc9f4fd39404f99c4e37125b93fe4 P 5983b40f0e604b9a997d9fcb66d1ee62 [term 1 FOLLOWER]: Refusing update from remote peer 1edda66438b64b72b9cb7207bba19be3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:42:50.499657 22295 raft_consensus.cc:1261] T 385fc9f4fd39404f99c4e37125b93fe4 P 1a084a7c37184bf6a819f5abf483f363 [term 1 FOLLOWER]: Refusing update from remote peer 1edda66438b64b72b9cb7207bba19be3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:42:50.499989 22461 consensus_queue.cc:1035] T 385fc9f4fd39404f99c4e37125b93fe4 P 1edda66438b64b72b9cb7207bba19be3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:42:50.500177 22429 consensus_queue.cc:1035] T 385fc9f4fd39404f99c4e37125b93fe4 P 1edda66438b64b72b9cb7207bba19be3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 17:42:50.517010 22500 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260812 17:42:52.081305 21532 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56616:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:42:52.081503 21532 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56616:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:42:52.084762 21532 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5d6ff83821404879969adb68e2c4e4da: Sending DeleteTablet for 3 replicas of tablet 385fc9f4fd39404f99c4e37125b93fe4
I20260812 17:42:52.085641 22263 tablet_service.cc:1514] Processing DeleteTablet for tablet 385fc9f4fd39404f99c4e37125b93fe4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:42:52 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:59830
I20260812 17:42:52.085641 21772 tablet_service.cc:1514] Processing DeleteTablet for tablet 385fc9f4fd39404f99c4e37125b93fe4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:42:52 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:50690
I20260812 17:42:52.085728 22020 tablet_service.cc:1514] Processing DeleteTablet for tablet 385fc9f4fd39404f99c4e37125b93fe4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:42:52 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:43934
I20260812 17:42:52.086200 22584 tablet_replica.cc:330] T 385fc9f4fd39404f99c4e37125b93fe4 P 1a084a7c37184bf6a819f5abf483f363: stopping tablet replica
I20260812 17:42:52.086561 22584 raft_consensus.cc:2229] T 385fc9f4fd39404f99c4e37125b93fe4 P 1a084a7c37184bf6a819f5abf483f363 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:42:52.086822 22584 raft_consensus.cc:2258] T 385fc9f4fd39404f99c4e37125b93fe4 P 1a084a7c37184bf6a819f5abf483f363 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:42:52.087487 22583 tablet_replica.cc:330] T 385fc9f4fd39404f99c4e37125b93fe4 P 5983b40f0e604b9a997d9fcb66d1ee62: stopping tablet replica
I20260812 17:42:52.087672 22583 raft_consensus.cc:2229] T 385fc9f4fd39404f99c4e37125b93fe4 P 5983b40f0e604b9a997d9fcb66d1ee62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:42:52.087788 22584 ts_tablet_manager.cc:1905] T 385fc9f4fd39404f99c4e37125b93fe4 P 1a084a7c37184bf6a819f5abf483f363: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:42:52.087848 22583 raft_consensus.cc:2258] T 385fc9f4fd39404f99c4e37125b93fe4 P 5983b40f0e604b9a997d9fcb66d1ee62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:42:52.088068 22587 tablet_replica.cc:330] T 385fc9f4fd39404f99c4e37125b93fe4 P 1edda66438b64b72b9cb7207bba19be3: stopping tablet replica
I20260812 17:42:52.088304 22587 raft_consensus.cc:2229] T 385fc9f4fd39404f99c4e37125b93fe4 P 1edda66438b64b72b9cb7207bba19be3 [term 1 LEADER]: Raft consensus shutting down.
I20260812 17:42:52.088769 22587 raft_consensus.cc:2258] T 385fc9f4fd39404f99c4e37125b93fe4 P 1edda66438b64b72b9cb7207bba19be3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:42:52.088847 22583 ts_tablet_manager.cc:1905] T 385fc9f4fd39404f99c4e37125b93fe4 P 5983b40f0e604b9a997d9fcb66d1ee62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:42:52.091554 22587 ts_tablet_manager.cc:1905] T 385fc9f4fd39404f99c4e37125b93fe4 P 1edda66438b64b72b9cb7207bba19be3: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 12 17:42:52 dist-test-slave-tk9z krb5kdc[21450](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556572, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
I20260812 17:42:52.109354 22584 ts_tablet_manager.cc:1918] T 385fc9f4fd39404f99c4e37125b93fe4 P 1a084a7c37184bf6a819f5abf483f363: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 17:42:52.109488 22584 log.cc:1196] T 385fc9f4fd39404f99c4e37125b93fe4 P 1a084a7c37184bf6a819f5abf483f363: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-2/wal/wals/385fc9f4fd39404f99c4e37125b93fe4
I20260812 17:42:52.109607 22583 ts_tablet_manager.cc:1918] T 385fc9f4fd39404f99c4e37125b93fe4 P 5983b40f0e604b9a997d9fcb66d1ee62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 17:42:52.109704 22583 log.cc:1196] T 385fc9f4fd39404f99c4e37125b93fe4 P 5983b40f0e604b9a997d9fcb66d1ee62: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-0/wal/wals/385fc9f4fd39404f99c4e37125b93fe4
I20260812 17:42:52.109930 22584 ts_tablet_manager.cc:1939] T 385fc9f4fd39404f99c4e37125b93fe4 P 1a084a7c37184bf6a819f5abf483f363: Deleting consensus metadata
I20260812 17:42:52.109998 22583 ts_tablet_manager.cc:1939] T 385fc9f4fd39404f99c4e37125b93fe4 P 5983b40f0e604b9a997d9fcb66d1ee62: Deleting consensus metadata
Aug 12 17:42:52 dist-test-slave-tk9z krb5kdc[21450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556572, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:42:52.123625 22603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:52.110994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60816 (local address 127.17.255.62:40627)
0812 17:42:52.111647 (+ 653us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:52.111659 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:52.111744 (+ 85us) server_negotiation.cc:407] Connection header received
0812 17:42:52.111880 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:52.111883 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:52.111966 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:52.112163 (+ 197us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:42:52.113052 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:52.113753 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:52.115065 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:52.115365 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:52.115481 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:52.118910 (+ 3429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:42:52.118914 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:42:52.118916 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:42:52.118961 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:42:52.120888 (+ 1927us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:52.121549 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:52.121553 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:52.121554 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:52.121664 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:52.122457 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:52.122461 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:52.122463 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:52.122694 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:42:52.122818 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:52.123179 (+ 361us) server_negotiation.cc:299] Negotiation successful
0812 17:42:52.123391 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":533,"thread_start_us":177,"threads_started":1}
I20260812 17:42:52.126969 21532 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60816:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 17:42:52.127450 21532 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 17:42:52.132965 21772 tablet_service.cc:1467] Processing CreateTablet for tablet dfb7f9ea555d41cdb3086135fd2dfa3a (DEFAULT_TABLE table=test-table [id=93f85d5c8f374a9aaba86f43349f8b93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:42:52.132982 22020 tablet_service.cc:1467] Processing CreateTablet for tablet dfb7f9ea555d41cdb3086135fd2dfa3a (DEFAULT_TABLE table=test-table [id=93f85d5c8f374a9aaba86f43349f8b93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:42:52.133327 21772 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfb7f9ea555d41cdb3086135fd2dfa3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:42:52.133608 21508 catalog_manager.cc:4841] TS 1a084a7c37184bf6a819f5abf483f363 (127.17.255.3:36677): tablet 385fc9f4fd39404f99c4e37125b93fe4 (table test-table [id=d8eceb84df514e70bcbc25cb12d554f6]) successfully deleted
I20260812 17:42:52.136196 22606 tablet_bootstrap.cc:492] T dfb7f9ea555d41cdb3086135fd2dfa3a P 5983b40f0e604b9a997d9fcb66d1ee62: Bootstrap starting.
I20260812 17:42:52.136392 22263 tablet_service.cc:1467] Processing CreateTablet for tablet dfb7f9ea555d41cdb3086135fd2dfa3a (DEFAULT_TABLE table=test-table [id=93f85d5c8f374a9aaba86f43349f8b93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:42:52.136713 22263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfb7f9ea555d41cdb3086135fd2dfa3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:42:52.137283 22606 tablet_bootstrap.cc:654] T dfb7f9ea555d41cdb3086135fd2dfa3a P 5983b40f0e604b9a997d9fcb66d1ee62: Neither blocks nor log segments found. Creating new log.
I20260812 17:42:52.138792 22606 tablet_bootstrap.cc:492] T dfb7f9ea555d41cdb3086135fd2dfa3a P 5983b40f0e604b9a997d9fcb66d1ee62: No bootstrap required, opened a new log
I20260812 17:42:52.138899 22606 ts_tablet_manager.cc:1397] T dfb7f9ea555d41cdb3086135fd2dfa3a P 5983b40f0e604b9a997d9fcb66d1ee62: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 17:42:52.139238 22608 tablet_bootstrap.cc:492] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1a084a7c37184bf6a819f5abf483f363: Bootstrap starting.
I20260812 17:42:52.139329 22606 raft_consensus.cc:348] T dfb7f9ea555d41cdb3086135fd2dfa3a P 5983b40f0e604b9a997d9fcb66d1ee62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } }
I20260812 17:42:52.139451 22606 raft_consensus.cc:374] T dfb7f9ea555d41cdb3086135fd2dfa3a P 5983b40f0e604b9a997d9fcb66d1ee62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:42:52.139484 22606 raft_consensus.cc:729] T dfb7f9ea555d41cdb3086135fd2dfa3a P 5983b40f0e604b9a997d9fcb66d1ee62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5983b40f0e604b9a997d9fcb66d1ee62, State: Initialized, Role: FOLLOWER
I20260812 17:42:52.139650 22606 consensus_queue.cc:260] T dfb7f9ea555d41cdb3086135fd2dfa3a P 5983b40f0e604b9a997d9fcb66d1ee62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } }
I20260812 17:42:52.140020 22606 ts_tablet_manager.cc:1428] T dfb7f9ea555d41cdb3086135fd2dfa3a P 5983b40f0e604b9a997d9fcb66d1ee62: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 17:42:52.141032 22608 tablet_bootstrap.cc:654] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1a084a7c37184bf6a819f5abf483f363: Neither blocks nor log segments found. Creating new log.
I20260812 17:42:52.142360 22608 tablet_bootstrap.cc:492] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1a084a7c37184bf6a819f5abf483f363: No bootstrap required, opened a new log
I20260812 17:42:52.142500 22608 ts_tablet_manager.cc:1397] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1a084a7c37184bf6a819f5abf483f363: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 17:42:52.143009 22608 raft_consensus.cc:348] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1a084a7c37184bf6a819f5abf483f363 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } }
I20260812 17:42:52.143143 22608 raft_consensus.cc:374] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1a084a7c37184bf6a819f5abf483f363 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:42:52.143195 22608 raft_consensus.cc:729] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1a084a7c37184bf6a819f5abf483f363 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a084a7c37184bf6a819f5abf483f363, State: Initialized, Role: FOLLOWER
I20260812 17:42:52.143386 22608 consensus_queue.cc:260] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1a084a7c37184bf6a819f5abf483f363 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } }
I20260812 17:42:52.143872 22608 ts_tablet_manager.cc:1428] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1a084a7c37184bf6a819f5abf483f363: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 17:42:52.150132 22587 ts_tablet_manager.cc:1918] T 385fc9f4fd39404f99c4e37125b93fe4 P 1edda66438b64b72b9cb7207bba19be3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 17:42:52.150315 22587 log.cc:1196] T 385fc9f4fd39404f99c4e37125b93fe4 P 1edda66438b64b72b9cb7207bba19be3: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-1/wal/wals/385fc9f4fd39404f99c4e37125b93fe4
I20260812 17:42:52.150754 22587 ts_tablet_manager.cc:1939] T 385fc9f4fd39404f99c4e37125b93fe4 P 1edda66438b64b72b9cb7207bba19be3: Deleting consensus metadata
I20260812 17:42:52.151072 22020 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfb7f9ea555d41cdb3086135fd2dfa3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:42:52.150682 21510 catalog_manager.cc:4841] TS 5983b40f0e604b9a997d9fcb66d1ee62 (127.17.255.1:35505): tablet 385fc9f4fd39404f99c4e37125b93fe4 (table test-table [id=d8eceb84df514e70bcbc25cb12d554f6]) successfully deleted
I20260812 17:42:52.153730 22612 tablet_bootstrap.cc:492] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1edda66438b64b72b9cb7207bba19be3: Bootstrap starting.
I20260812 17:42:52.155284 22612 tablet_bootstrap.cc:654] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1edda66438b64b72b9cb7207bba19be3: Neither blocks nor log segments found. Creating new log.
I20260812 17:42:52.156917 22612 tablet_bootstrap.cc:492] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1edda66438b64b72b9cb7207bba19be3: No bootstrap required, opened a new log
I20260812 17:42:52.157020 22612 ts_tablet_manager.cc:1397] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1edda66438b64b72b9cb7207bba19be3: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260812 17:42:52.157387 22612 raft_consensus.cc:348] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1edda66438b64b72b9cb7207bba19be3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } }
I20260812 17:42:52.157503 22612 raft_consensus.cc:374] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1edda66438b64b72b9cb7207bba19be3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:42:52.157526 22612 raft_consensus.cc:729] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1edda66438b64b72b9cb7207bba19be3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1edda66438b64b72b9cb7207bba19be3, State: Initialized, Role: FOLLOWER
I20260812 17:42:52.157686 22612 consensus_queue.cc:260] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1edda66438b64b72b9cb7207bba19be3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } }
I20260812 17:42:52.158026 22612 ts_tablet_manager.cc:1428] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1edda66438b64b72b9cb7207bba19be3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260812 17:42:52.184842 21510 catalog_manager.cc:4841] TS 1edda66438b64b72b9cb7207bba19be3 (127.17.255.2:38853): tablet 385fc9f4fd39404f99c4e37125b93fe4 (table test-table [id=d8eceb84df514e70bcbc25cb12d554f6]) successfully deleted
I20260812 17:42:52.255592 22611 raft_consensus.cc:482] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1a084a7c37184bf6a819f5abf483f363 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:42:52.255844 22611 raft_consensus.cc:504] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1a084a7c37184bf6a819f5abf483f363 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } }
I20260812 17:42:52.257282 22611 leader_election.cc:288] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1a084a7c37184bf6a819f5abf483f363 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5983b40f0e604b9a997d9fcb66d1ee62 (127.17.255.1:35505), 1edda66438b64b72b9cb7207bba19be3 (127.17.255.2:38853)
I20260812 17:42:52.262297 22618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:52.257877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:45495 (local address 127.17.255.1:35505)
0812 17:42:52.258210 (+ 333us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:52.258220 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:52.258239 (+ 19us) server_negotiation.cc:407] Connection header received
0812 17:42:52.258456 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:52.258459 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:52.258506 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:52.258609 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:42:52.259480 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:52.260032 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:52.261214 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:52.261649 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:52.261785 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:52.261845 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:52.262066 (+ 221us) server_negotiation.cc:299] Negotiation successful
0812 17:42:52.262142 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":250,"thread_start_us":103,"threads_started":1}
I20260812 17:42:52.262313 22617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:52.257672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:35505 (local address 127.17.255.3:45495)
0812 17:42:52.258108 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:52.258121 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:52.258287 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:52.258630 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:52.258634 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:52.258654 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:42:52.259335 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:52.259345 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:52.260157 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:52.260162 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:52.261078 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:52.261088 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:52.261782 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:52.261786 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:52.261931 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:52.261952 (+ 21us) client_negotiation.cc:769] Sending connection context
0812 17:42:52.262047 (+ 95us) client_negotiation.cc:240] Negotiation successful
0812 17:42:52.262122 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":355,"mutex_wait_us":88,"thread_start_us":211,"threads_started":1}
I20260812 17:42:52.262323 22622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:52.258439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:43811 (local address 127.17.255.2:38853)
0812 17:42:52.258744 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:52.258754 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:52.258927 (+ 173us) server_negotiation.cc:407] Connection header received
0812 17:42:52.259090 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:52.259095 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:52.259142 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:52.259239 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:42:52.259575 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:52.260099 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:52.261211 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:52.261667 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:52.261800 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:52.261869 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:52.262108 (+ 239us) server_negotiation.cc:299] Negotiation successful
0812 17:42:52.262185 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":225,"thread_start_us":98,"threads_started":1}
I20260812 17:42:52.262445 22620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:52.258235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:38853 (local address 127.17.255.3:43811)
0812 17:42:52.258783 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:52.258804 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:52.258963 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:52.259249 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:52.259251 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:52.259268 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:42:52.259446 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:52.259453 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:52.260216 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:52.260221 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:52.261074 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:52.261083 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:52.261796 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:52.261800 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:52.261973 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:52.261993 (+ 20us) client_negotiation.cc:769] Sending connection context
0812 17:42:52.262087 (+ 94us) client_negotiation.cc:240] Negotiation successful
0812 17:42:52.262159 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":480,"mutex_wait_us":7,"thread_start_us":202,"threads_started":1}
I20260812 17:42:52.263144 21800 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfb7f9ea555d41cdb3086135fd2dfa3a" candidate_uuid: "1a084a7c37184bf6a819f5abf483f363" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" is_pre_election: true
I20260812 17:42:52.263134 22068 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfb7f9ea555d41cdb3086135fd2dfa3a" candidate_uuid: "1a084a7c37184bf6a819f5abf483f363" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edda66438b64b72b9cb7207bba19be3" is_pre_election: true
I20260812 17:42:52.263335 22068 raft_consensus.cc:2454] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1edda66438b64b72b9cb7207bba19be3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a084a7c37184bf6a819f5abf483f363 in term 0.
I20260812 17:42:52.263329 21800 raft_consensus.cc:2454] T dfb7f9ea555d41cdb3086135fd2dfa3a P 5983b40f0e604b9a997d9fcb66d1ee62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a084a7c37184bf6a819f5abf483f363 in term 0.
I20260812 17:42:52.263806 22187 leader_election.cc:302] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1a084a7c37184bf6a819f5abf483f363 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a084a7c37184bf6a819f5abf483f363, 1edda66438b64b72b9cb7207bba19be3; no voters:
I20260812 17:42:52.264146 22611 raft_consensus.cc:2781] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1a084a7c37184bf6a819f5abf483f363 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 17:42:52.264211 22611 raft_consensus.cc:482] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1a084a7c37184bf6a819f5abf483f363 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 17:42:52.264240 22611 raft_consensus.cc:3037] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1a084a7c37184bf6a819f5abf483f363 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:42:52.265349 22611 raft_consensus.cc:504] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1a084a7c37184bf6a819f5abf483f363 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } }
I20260812 17:42:52.265731 22611 leader_election.cc:288] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1a084a7c37184bf6a819f5abf483f363 [CANDIDATE]: Term 1 election: Requested vote from peers 5983b40f0e604b9a997d9fcb66d1ee62 (127.17.255.1:35505), 1edda66438b64b72b9cb7207bba19be3 (127.17.255.2:38853)
I20260812 17:42:52.266249 22068 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfb7f9ea555d41cdb3086135fd2dfa3a" candidate_uuid: "1a084a7c37184bf6a819f5abf483f363" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edda66438b64b72b9cb7207bba19be3"
I20260812 17:42:52.266255 21800 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfb7f9ea555d41cdb3086135fd2dfa3a" candidate_uuid: "1a084a7c37184bf6a819f5abf483f363" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5983b40f0e604b9a997d9fcb66d1ee62"
I20260812 17:42:52.266430 22068 raft_consensus.cc:3037] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1edda66438b64b72b9cb7207bba19be3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:42:52.266467 21800 raft_consensus.cc:3037] T dfb7f9ea555d41cdb3086135fd2dfa3a P 5983b40f0e604b9a997d9fcb66d1ee62 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:42:52.267671 22068 raft_consensus.cc:2454] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1edda66438b64b72b9cb7207bba19be3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a084a7c37184bf6a819f5abf483f363 in term 1.
I20260812 17:42:52.267778 21800 raft_consensus.cc:2454] T dfb7f9ea555d41cdb3086135fd2dfa3a P 5983b40f0e604b9a997d9fcb66d1ee62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a084a7c37184bf6a819f5abf483f363 in term 1.
I20260812 17:42:52.267971 22187 leader_election.cc:302] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1a084a7c37184bf6a819f5abf483f363 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a084a7c37184bf6a819f5abf483f363, 1edda66438b64b72b9cb7207bba19be3; no voters:
I20260812 17:42:52.268193 22611 raft_consensus.cc:2781] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1a084a7c37184bf6a819f5abf483f363 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:42:52.268445 22611 raft_consensus.cc:686] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1a084a7c37184bf6a819f5abf483f363 [term 1 LEADER]: Becoming Leader. State: Replica: 1a084a7c37184bf6a819f5abf483f363, State: Running, Role: LEADER
I20260812 17:42:52.268738 22611 consensus_queue.cc:237] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1a084a7c37184bf6a819f5abf483f363 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } }
I20260812 17:42:52.271297 21527 catalog_manager.cc:5495] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1a084a7c37184bf6a819f5abf483f363 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a084a7c37184bf6a819f5abf483f363 (127.17.255.3). New cstate: current_term: 1 leader_uuid: "1a084a7c37184bf6a819f5abf483f363" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } health_report { overall_health: HEALTHY } } }
I20260812 17:42:52.312155 22630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:52.307911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45952 (local address 127.17.255.3:36677)
0812 17:42:52.308213 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:52.308220 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:52.308233 (+ 13us) server_negotiation.cc:407] Connection header received
0812 17:42:52.308331 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:52.308333 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:52.308393 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:52.308552 (+ 159us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:42:52.308878 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:52.309512 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:52.310515 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:52.310757 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:52.310876 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:52.311172 (+ 296us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:42:52.311662 (+ 490us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:42:52.311791 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:52.311858 (+ 67us) server_negotiation.cc:299] Negotiation successful
0812 17:42:52.311914 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":228,"thread_start_us":138,"threads_started":1}
I20260812 17:42:52.323726 22634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:52.319854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:38853 (local address 127.17.255.3:40651)
0812 17:42:52.320189 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:52.320203 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:52.320293 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:52.320730 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:52.320733 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:52.320741 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 17:42:52.320866 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:52.320872 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:52.321648 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:52.321651 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:52.322352 (+ 701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:52.322363 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:52.322892 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:52.322896 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:52.323000 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:52.323052 (+ 52us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 17:42:52.323379 (+ 327us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 17:42:52.323388 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 17:42:52.323471 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 17:42:52.323558 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":96,"threads_started":1}
I20260812 17:42:52.323719 22622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:52.320136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:40651 (local address 127.17.255.2:38853)
0812 17:42:52.320267 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:52.320270 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:52.320285 (+ 15us) server_negotiation.cc:407] Connection header received
0812 17:42:52.320403 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:52.320406 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:52.320527 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:52.320598 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:42:52.320992 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:52.321494 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:52.322535 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:52.322764 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:52.322889 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:52.323207 (+ 318us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:42:52.323287 (+ 80us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:42:52.323370 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:52.323497 (+ 127us) server_negotiation.cc:299] Negotiation successful
0812 17:42:52.323558 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 17:42:52.330235 22068 raft_consensus.cc:1261] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1edda66438b64b72b9cb7207bba19be3 [term 1 FOLLOWER]: Refusing update from remote peer 1a084a7c37184bf6a819f5abf483f363: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:42:52.330235 21800 raft_consensus.cc:1261] T dfb7f9ea555d41cdb3086135fd2dfa3a P 5983b40f0e604b9a997d9fcb66d1ee62 [term 1 FOLLOWER]: Refusing update from remote peer 1a084a7c37184bf6a819f5abf483f363: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:42:52.330881 22611 consensus_queue.cc:1035] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1a084a7c37184bf6a819f5abf483f363 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:42:52.331139 22623 consensus_queue.cc:1035] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1a084a7c37184bf6a819f5abf483f363 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:42:52.348829 22630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:52.345341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:39885 (local address 127.17.255.3:36677)
0812 17:42:52.345460 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:52.345465 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:52.345728 (+ 263us) server_negotiation.cc:407] Connection header received
0812 17:42:52.345900 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:52.345902 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:52.345946 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:52.346006 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:42:52.346203 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:52.346782 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:52.347769 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:52.347997 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:52.348111 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:52.348365 (+ 254us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:42:52.348448 (+ 83us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:42:52.348527 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:52.348619 (+ 92us) server_negotiation.cc:299] Negotiation successful
0812 17:42:52.348671 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 17:42:52.348970 22644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:52.345277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.3:36677 (local address 127.17.255.2:39885)
0812 17:42:52.345634 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:52.345651 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:52.345796 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:52.346025 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:52.346026 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:52.346033 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 17:42:52.346133 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:52.346137 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:52.346883 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:52.346886 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:52.347617 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:52.347627 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:52.348110 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:52.348114 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:52.348206 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:52.348242 (+ 36us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 17:42:52.348531 (+ 289us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 17:42:52.348540 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 17:42:52.348608 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 17:42:52.348697 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":131,"threads_started":1}
I20260812 17:42:52.372174 21532 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60816:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:42:52.372421 21532 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60816:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:42:52.375056 21532 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5d6ff83821404879969adb68e2c4e4da: Sending DeleteTablet for 3 replicas of tablet dfb7f9ea555d41cdb3086135fd2dfa3a
I20260812 17:42:52.375919 21772 tablet_service.cc:1514] Processing DeleteTablet for tablet dfb7f9ea555d41cdb3086135fd2dfa3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:42:52 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:50690
I20260812 17:42:52.375936 22263 tablet_service.cc:1514] Processing DeleteTablet for tablet dfb7f9ea555d41cdb3086135fd2dfa3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:42:52 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:59830
I20260812 17:42:52.376130 22583 tablet_replica.cc:330] T dfb7f9ea555d41cdb3086135fd2dfa3a P 5983b40f0e604b9a997d9fcb66d1ee62: stopping tablet replica
I20260812 17:42:52.376153 22584 tablet_replica.cc:330] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1a084a7c37184bf6a819f5abf483f363: stopping tablet replica
I20260812 17:42:52.376258 22583 raft_consensus.cc:2229] T dfb7f9ea555d41cdb3086135fd2dfa3a P 5983b40f0e604b9a997d9fcb66d1ee62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:42:52.376283 22584 raft_consensus.cc:2229] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1a084a7c37184bf6a819f5abf483f363 [term 1 LEADER]: Raft consensus shutting down.
I20260812 17:42:52.376401 22583 raft_consensus.cc:2258] T dfb7f9ea555d41cdb3086135fd2dfa3a P 5983b40f0e604b9a997d9fcb66d1ee62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:42:52.376619 22584 raft_consensus.cc:2258] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1a084a7c37184bf6a819f5abf483f363 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:42:52.376811 22020 tablet_service.cc:1514] Processing DeleteTablet for tablet dfb7f9ea555d41cdb3086135fd2dfa3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:42:52 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:43934
I20260812 17:42:52.377008 22587 tablet_replica.cc:330] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1edda66438b64b72b9cb7207bba19be3: stopping tablet replica
I20260812 17:42:52.377137 22587 raft_consensus.cc:2229] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1edda66438b64b72b9cb7207bba19be3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:42:52.377293 22587 raft_consensus.cc:2258] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1edda66438b64b72b9cb7207bba19be3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:42:52.377521 22583 ts_tablet_manager.cc:1905] T dfb7f9ea555d41cdb3086135fd2dfa3a P 5983b40f0e604b9a997d9fcb66d1ee62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:42:52.377794 22584 ts_tablet_manager.cc:1905] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1a084a7c37184bf6a819f5abf483f363: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:42:52.378048 22587 ts_tablet_manager.cc:1905] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1edda66438b64b72b9cb7207bba19be3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:42:52.380586 22583 ts_tablet_manager.cc:1918] T dfb7f9ea555d41cdb3086135fd2dfa3a P 5983b40f0e604b9a997d9fcb66d1ee62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 17:42:52.380666 22583 log.cc:1196] T dfb7f9ea555d41cdb3086135fd2dfa3a P 5983b40f0e604b9a997d9fcb66d1ee62: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-0/wal/wals/dfb7f9ea555d41cdb3086135fd2dfa3a
I20260812 17:42:52.380654 22584 ts_tablet_manager.cc:1918] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1a084a7c37184bf6a819f5abf483f363: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 17:42:52.380739 22584 log.cc:1196] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1a084a7c37184bf6a819f5abf483f363: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-2/wal/wals/dfb7f9ea555d41cdb3086135fd2dfa3a
I20260812 17:42:52.380954 22583 ts_tablet_manager.cc:1939] T dfb7f9ea555d41cdb3086135fd2dfa3a P 5983b40f0e604b9a997d9fcb66d1ee62: Deleting consensus metadata
I20260812 17:42:52.381031 22587 ts_tablet_manager.cc:1918] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1edda66438b64b72b9cb7207bba19be3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 17:42:52.381070 22584 ts_tablet_manager.cc:1939] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1a084a7c37184bf6a819f5abf483f363: Deleting consensus metadata
I20260812 17:42:52.381114 22587 log.cc:1196] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1edda66438b64b72b9cb7207bba19be3: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-1/wal/wals/dfb7f9ea555d41cdb3086135fd2dfa3a
I20260812 17:42:52.381428 22587 ts_tablet_manager.cc:1939] T dfb7f9ea555d41cdb3086135fd2dfa3a P 1edda66438b64b72b9cb7207bba19be3: Deleting consensus metadata
I20260812 17:42:52.381764 21510 catalog_manager.cc:4841] TS 5983b40f0e604b9a997d9fcb66d1ee62 (127.17.255.1:35505): tablet dfb7f9ea555d41cdb3086135fd2dfa3a (table test-table [id=93f85d5c8f374a9aaba86f43349f8b93]) successfully deleted
I20260812 17:42:52.381901 21508 catalog_manager.cc:4841] TS 1a084a7c37184bf6a819f5abf483f363 (127.17.255.3:36677): tablet dfb7f9ea555d41cdb3086135fd2dfa3a (table test-table [id=93f85d5c8f374a9aaba86f43349f8b93]) successfully deleted
I20260812 17:42:52.382707 21510 catalog_manager.cc:4841] TS 1edda66438b64b72b9cb7207bba19be3 (127.17.255.2:38853): tablet dfb7f9ea555d41cdb3086135fd2dfa3a (table test-table [id=93f85d5c8f374a9aaba86f43349f8b93]) successfully deleted
I20260812 17:42:52.382838 21532 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60816:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 17:42:52.383342 21532 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 17:42:52.388672 22263 tablet_service.cc:1467] Processing CreateTablet for tablet 05ffcfda072348dfb208ba00eaf2ff4b (DEFAULT_TABLE table=test-table [id=5ea1dd71dc2b482f89f35f9d4c28b833]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:42:52.388991 22263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05ffcfda072348dfb208ba00eaf2ff4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:42:52.390998 22020 tablet_service.cc:1467] Processing CreateTablet for tablet 05ffcfda072348dfb208ba00eaf2ff4b (DEFAULT_TABLE table=test-table [id=5ea1dd71dc2b482f89f35f9d4c28b833]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:42:52.391041 21772 tablet_service.cc:1467] Processing CreateTablet for tablet 05ffcfda072348dfb208ba00eaf2ff4b (DEFAULT_TABLE table=test-table [id=5ea1dd71dc2b482f89f35f9d4c28b833]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:42:52.391302 22020 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05ffcfda072348dfb208ba00eaf2ff4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:42:52.391342 21772 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05ffcfda072348dfb208ba00eaf2ff4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:42:52.391716 22608 tablet_bootstrap.cc:492] T 05ffcfda072348dfb208ba00eaf2ff4b P 1a084a7c37184bf6a819f5abf483f363: Bootstrap starting.
I20260812 17:42:52.392789 22608 tablet_bootstrap.cc:654] T 05ffcfda072348dfb208ba00eaf2ff4b P 1a084a7c37184bf6a819f5abf483f363: Neither blocks nor log segments found. Creating new log.
I20260812 17:42:52.393752 22606 tablet_bootstrap.cc:492] T 05ffcfda072348dfb208ba00eaf2ff4b P 5983b40f0e604b9a997d9fcb66d1ee62: Bootstrap starting.
I20260812 17:42:52.393981 22612 tablet_bootstrap.cc:492] T 05ffcfda072348dfb208ba00eaf2ff4b P 1edda66438b64b72b9cb7207bba19be3: Bootstrap starting.
I20260812 17:42:52.394553 22608 tablet_bootstrap.cc:492] T 05ffcfda072348dfb208ba00eaf2ff4b P 1a084a7c37184bf6a819f5abf483f363: No bootstrap required, opened a new log
I20260812 17:42:52.394639 22608 ts_tablet_manager.cc:1397] T 05ffcfda072348dfb208ba00eaf2ff4b P 1a084a7c37184bf6a819f5abf483f363: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 17:42:52.394717 22606 tablet_bootstrap.cc:654] T 05ffcfda072348dfb208ba00eaf2ff4b P 5983b40f0e604b9a997d9fcb66d1ee62: Neither blocks nor log segments found. Creating new log.
I20260812 17:42:52.394892 22612 tablet_bootstrap.cc:654] T 05ffcfda072348dfb208ba00eaf2ff4b P 1edda66438b64b72b9cb7207bba19be3: Neither blocks nor log segments found. Creating new log.
I20260812 17:42:52.395291 22608 raft_consensus.cc:348] T 05ffcfda072348dfb208ba00eaf2ff4b P 1a084a7c37184bf6a819f5abf483f363 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } }
I20260812 17:42:52.395429 22608 raft_consensus.cc:374] T 05ffcfda072348dfb208ba00eaf2ff4b P 1a084a7c37184bf6a819f5abf483f363 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:42:52.395473 22608 raft_consensus.cc:729] T 05ffcfda072348dfb208ba00eaf2ff4b P 1a084a7c37184bf6a819f5abf483f363 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a084a7c37184bf6a819f5abf483f363, State: Initialized, Role: FOLLOWER
I20260812 17:42:52.395632 22608 consensus_queue.cc:260] T 05ffcfda072348dfb208ba00eaf2ff4b P 1a084a7c37184bf6a819f5abf483f363 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } }
I20260812 17:42:52.395898 22608 ts_tablet_manager.cc:1428] T 05ffcfda072348dfb208ba00eaf2ff4b P 1a084a7c37184bf6a819f5abf483f363: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260812 17:42:52.403506 22612 tablet_bootstrap.cc:492] T 05ffcfda072348dfb208ba00eaf2ff4b P 1edda66438b64b72b9cb7207bba19be3: No bootstrap required, opened a new log
I20260812 17:42:52.403623 22612 ts_tablet_manager.cc:1397] T 05ffcfda072348dfb208ba00eaf2ff4b P 1edda66438b64b72b9cb7207bba19be3: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20260812 17:42:52.403738 22606 tablet_bootstrap.cc:492] T 05ffcfda072348dfb208ba00eaf2ff4b P 5983b40f0e604b9a997d9fcb66d1ee62: No bootstrap required, opened a new log
I20260812 17:42:52.403846 22606 ts_tablet_manager.cc:1397] T 05ffcfda072348dfb208ba00eaf2ff4b P 5983b40f0e604b9a997d9fcb66d1ee62: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260812 17:42:52.404062 22612 raft_consensus.cc:348] T 05ffcfda072348dfb208ba00eaf2ff4b P 1edda66438b64b72b9cb7207bba19be3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } }
I20260812 17:42:52.404177 22612 raft_consensus.cc:374] T 05ffcfda072348dfb208ba00eaf2ff4b P 1edda66438b64b72b9cb7207bba19be3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:42:52.404203 22612 raft_consensus.cc:729] T 05ffcfda072348dfb208ba00eaf2ff4b P 1edda66438b64b72b9cb7207bba19be3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1edda66438b64b72b9cb7207bba19be3, State: Initialized, Role: FOLLOWER
I20260812 17:42:52.404322 22612 consensus_queue.cc:260] T 05ffcfda072348dfb208ba00eaf2ff4b P 1edda66438b64b72b9cb7207bba19be3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } }
I20260812 17:42:52.404333 22606 raft_consensus.cc:348] T 05ffcfda072348dfb208ba00eaf2ff4b P 5983b40f0e604b9a997d9fcb66d1ee62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } }
I20260812 17:42:52.404456 22606 raft_consensus.cc:374] T 05ffcfda072348dfb208ba00eaf2ff4b P 5983b40f0e604b9a997d9fcb66d1ee62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:42:52.404488 22606 raft_consensus.cc:729] T 05ffcfda072348dfb208ba00eaf2ff4b P 5983b40f0e604b9a997d9fcb66d1ee62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5983b40f0e604b9a997d9fcb66d1ee62, State: Initialized, Role: FOLLOWER
I20260812 17:42:52.404568 22612 ts_tablet_manager.cc:1428] T 05ffcfda072348dfb208ba00eaf2ff4b P 1edda66438b64b72b9cb7207bba19be3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 17:42:52.404613 22606 consensus_queue.cc:260] T 05ffcfda072348dfb208ba00eaf2ff4b P 5983b40f0e604b9a997d9fcb66d1ee62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } }
I20260812 17:42:52.404874 22606 ts_tablet_manager.cc:1428] T 05ffcfda072348dfb208ba00eaf2ff4b P 5983b40f0e604b9a997d9fcb66d1ee62: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 17:42:52.515956 22609 raft_consensus.cc:482] T 05ffcfda072348dfb208ba00eaf2ff4b P 5983b40f0e604b9a997d9fcb66d1ee62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:42:52.516185 22609 raft_consensus.cc:504] T 05ffcfda072348dfb208ba00eaf2ff4b P 5983b40f0e604b9a997d9fcb66d1ee62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } }
I20260812 17:42:52.516764 22609 leader_election.cc:288] T 05ffcfda072348dfb208ba00eaf2ff4b P 5983b40f0e604b9a997d9fcb66d1ee62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1edda66438b64b72b9cb7207bba19be3 (127.17.255.2:38853), 1a084a7c37184bf6a819f5abf483f363 (127.17.255.3:36677)
I20260812 17:42:52.517411 22066 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05ffcfda072348dfb208ba00eaf2ff4b" candidate_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edda66438b64b72b9cb7207bba19be3" is_pre_election: true
I20260812 17:42:52.517407 22295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05ffcfda072348dfb208ba00eaf2ff4b" candidate_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a084a7c37184bf6a819f5abf483f363" is_pre_election: true
I20260812 17:42:52.517623 22295 raft_consensus.cc:2454] T 05ffcfda072348dfb208ba00eaf2ff4b P 1a084a7c37184bf6a819f5abf483f363 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5983b40f0e604b9a997d9fcb66d1ee62 in term 0.
I20260812 17:42:52.517632 22066 raft_consensus.cc:2454] T 05ffcfda072348dfb208ba00eaf2ff4b P 1edda66438b64b72b9cb7207bba19be3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5983b40f0e604b9a997d9fcb66d1ee62 in term 0.
I20260812 17:42:52.518054 21684 leader_election.cc:302] T 05ffcfda072348dfb208ba00eaf2ff4b P 5983b40f0e604b9a997d9fcb66d1ee62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a084a7c37184bf6a819f5abf483f363, 5983b40f0e604b9a997d9fcb66d1ee62; no voters:
I20260812 17:42:52.518363 22609 raft_consensus.cc:2781] T 05ffcfda072348dfb208ba00eaf2ff4b P 5983b40f0e604b9a997d9fcb66d1ee62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 17:42:52.518463 22609 raft_consensus.cc:482] T 05ffcfda072348dfb208ba00eaf2ff4b P 5983b40f0e604b9a997d9fcb66d1ee62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 17:42:52.518524 22609 raft_consensus.cc:3037] T 05ffcfda072348dfb208ba00eaf2ff4b P 5983b40f0e604b9a997d9fcb66d1ee62 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:42:52.520051 22609 raft_consensus.cc:504] T 05ffcfda072348dfb208ba00eaf2ff4b P 5983b40f0e604b9a997d9fcb66d1ee62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } }
I20260812 17:42:52.520581 22609 leader_election.cc:288] T 05ffcfda072348dfb208ba00eaf2ff4b P 5983b40f0e604b9a997d9fcb66d1ee62 [CANDIDATE]: Term 1 election: Requested vote from peers 1edda66438b64b72b9cb7207bba19be3 (127.17.255.2:38853), 1a084a7c37184bf6a819f5abf483f363 (127.17.255.3:36677)
I20260812 17:42:52.521135 22066 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05ffcfda072348dfb208ba00eaf2ff4b" candidate_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edda66438b64b72b9cb7207bba19be3"
I20260812 17:42:52.521206 22295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05ffcfda072348dfb208ba00eaf2ff4b" candidate_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a084a7c37184bf6a819f5abf483f363"
I20260812 17:42:52.521309 22066 raft_consensus.cc:3037] T 05ffcfda072348dfb208ba00eaf2ff4b P 1edda66438b64b72b9cb7207bba19be3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:42:52.521339 22295 raft_consensus.cc:3037] T 05ffcfda072348dfb208ba00eaf2ff4b P 1a084a7c37184bf6a819f5abf483f363 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:42:52.522749 22295 raft_consensus.cc:2454] T 05ffcfda072348dfb208ba00eaf2ff4b P 1a084a7c37184bf6a819f5abf483f363 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5983b40f0e604b9a997d9fcb66d1ee62 in term 1.
I20260812 17:42:52.522964 22066 raft_consensus.cc:2454] T 05ffcfda072348dfb208ba00eaf2ff4b P 1edda66438b64b72b9cb7207bba19be3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5983b40f0e604b9a997d9fcb66d1ee62 in term 1.
I20260812 17:42:52.523159 21684 leader_election.cc:302] T 05ffcfda072348dfb208ba00eaf2ff4b P 5983b40f0e604b9a997d9fcb66d1ee62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a084a7c37184bf6a819f5abf483f363, 5983b40f0e604b9a997d9fcb66d1ee62; no voters:
I20260812 17:42:52.523415 22609 raft_consensus.cc:2781] T 05ffcfda072348dfb208ba00eaf2ff4b P 5983b40f0e604b9a997d9fcb66d1ee62 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:42:52.523622 22609 raft_consensus.cc:686] T 05ffcfda072348dfb208ba00eaf2ff4b P 5983b40f0e604b9a997d9fcb66d1ee62 [term 1 LEADER]: Becoming Leader. State: Replica: 5983b40f0e604b9a997d9fcb66d1ee62, State: Running, Role: LEADER
I20260812 17:42:52.523787 22609 consensus_queue.cc:237] T 05ffcfda072348dfb208ba00eaf2ff4b P 5983b40f0e604b9a997d9fcb66d1ee62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } }
I20260812 17:42:52.525945 21531 catalog_manager.cc:5495] T 05ffcfda072348dfb208ba00eaf2ff4b P 5983b40f0e604b9a997d9fcb66d1ee62 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5983b40f0e604b9a997d9fcb66d1ee62 (127.17.255.1). New cstate: current_term: 1 leader_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5983b40f0e604b9a997d9fcb66d1ee62" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 } health_report { overall_health: UNKNOWN } } }
I20260812 17:42:52.570421 22618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:52.567220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33480 (local address 127.17.255.1:35505)
0812 17:42:52.567366 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:52.567370 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:52.567383 (+ 13us) server_negotiation.cc:407] Connection header received
0812 17:42:52.567530 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:52.567532 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:52.567579 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:52.567643 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:42:52.567918 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:52.568504 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:52.569338 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:52.569542 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:52.569618 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:52.569896 (+ 278us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:42:52.569975 (+ 79us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:42:52.570046 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:52.570134 (+ 88us) server_negotiation.cc:299] Negotiation successful
0812 17:42:52.570185 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 17:42:52.577793 22295 raft_consensus.cc:1261] T 05ffcfda072348dfb208ba00eaf2ff4b P 1a084a7c37184bf6a819f5abf483f363 [term 1 FOLLOWER]: Refusing update from remote peer 5983b40f0e604b9a997d9fcb66d1ee62: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:42:52.577803 22066 raft_consensus.cc:1261] T 05ffcfda072348dfb208ba00eaf2ff4b P 1edda66438b64b72b9cb7207bba19be3 [term 1 FOLLOWER]: Refusing update from remote peer 5983b40f0e604b9a997d9fcb66d1ee62: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:42:52.578231 22652 consensus_queue.cc:1035] T 05ffcfda072348dfb208ba00eaf2ff4b P 5983b40f0e604b9a997d9fcb66d1ee62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a084a7c37184bf6a819f5abf483f363" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:42:52.578464 22609 consensus_queue.cc:1035] T 05ffcfda072348dfb208ba00eaf2ff4b P 5983b40f0e604b9a997d9fcb66d1ee62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1edda66438b64b72b9cb7207bba19be3" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 17:42:52.592257 22547 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260812 17:42:54.157945 21531 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60816:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:42:54.158118 21531 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60816:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:42:54.161145 21531 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5d6ff83821404879969adb68e2c4e4da: Sending DeleteTablet for 3 replicas of tablet 05ffcfda072348dfb208ba00eaf2ff4b
I20260812 17:42:54.161966 22263 tablet_service.cc:1514] Processing DeleteTablet for tablet 05ffcfda072348dfb208ba00eaf2ff4b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:42:54 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:59830
I20260812 17:42:54.162030 21772 tablet_service.cc:1514] Processing DeleteTablet for tablet 05ffcfda072348dfb208ba00eaf2ff4b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:42:54 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:50690
I20260812 17:42:54.162009 22020 tablet_service.cc:1514] Processing DeleteTablet for tablet 05ffcfda072348dfb208ba00eaf2ff4b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:42:54 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:43934
I20260812 17:42:54.162441 22702 tablet_replica.cc:330] T 05ffcfda072348dfb208ba00eaf2ff4b P 1a084a7c37184bf6a819f5abf483f363: stopping tablet replica
I20260812 17:42:54.162441 22699 tablet_replica.cc:330] T 05ffcfda072348dfb208ba00eaf2ff4b P 5983b40f0e604b9a997d9fcb66d1ee62: stopping tablet replica
I20260812 17:42:54.162540 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 21656
I20260812 17:42:54.162585 22705 tablet_replica.cc:330] T 05ffcfda072348dfb208ba00eaf2ff4b P 1edda66438b64b72b9cb7207bba19be3: stopping tablet replica
I20260812 17:42:54.173285 22705 raft_consensus.cc:2229] T 05ffcfda072348dfb208ba00eaf2ff4b P 1edda66438b64b72b9cb7207bba19be3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:42:54.173516 22705 raft_consensus.cc:2258] T 05ffcfda072348dfb208ba00eaf2ff4b P 1edda66438b64b72b9cb7207bba19be3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:42:54.174167 22702 raft_consensus.cc:2229] T 05ffcfda072348dfb208ba00eaf2ff4b P 1a084a7c37184bf6a819f5abf483f363 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:42:54.174338 22702 raft_consensus.cc:2258] T 05ffcfda072348dfb208ba00eaf2ff4b P 1a084a7c37184bf6a819f5abf483f363 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:42:54.174600 22705 ts_tablet_manager.cc:1905] T 05ffcfda072348dfb208ba00eaf2ff4b P 1edda66438b64b72b9cb7207bba19be3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:42:54.175357 22702 ts_tablet_manager.cc:1905] T 05ffcfda072348dfb208ba00eaf2ff4b P 1a084a7c37184bf6a819f5abf483f363: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:42:54.177255 22705 ts_tablet_manager.cc:1918] T 05ffcfda072348dfb208ba00eaf2ff4b P 1edda66438b64b72b9cb7207bba19be3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 17:42:54.177366 22705 log.cc:1196] T 05ffcfda072348dfb208ba00eaf2ff4b P 1edda66438b64b72b9cb7207bba19be3: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-1/wal/wals/05ffcfda072348dfb208ba00eaf2ff4b
I20260812 17:42:54.177868 22705 ts_tablet_manager.cc:1939] T 05ffcfda072348dfb208ba00eaf2ff4b P 1edda66438b64b72b9cb7207bba19be3: Deleting consensus metadata
I20260812 17:42:54.178761 21510 catalog_manager.cc:4841] TS 1edda66438b64b72b9cb7207bba19be3 (127.17.255.2:38853): tablet 05ffcfda072348dfb208ba00eaf2ff4b (table test-table [id=5ea1dd71dc2b482f89f35f9d4c28b833]) successfully deleted
I20260812 17:42:54.179456 22702 ts_tablet_manager.cc:1918] T 05ffcfda072348dfb208ba00eaf2ff4b P 1a084a7c37184bf6a819f5abf483f363: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 17:42:54.179579 22702 log.cc:1196] T 05ffcfda072348dfb208ba00eaf2ff4b P 1a084a7c37184bf6a819f5abf483f363: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786556557564181-18428-0/minicluster-data/ts-2/wal/wals/05ffcfda072348dfb208ba00eaf2ff4b
I20260812 17:42:54.179956 22702 ts_tablet_manager.cc:1939] T 05ffcfda072348dfb208ba00eaf2ff4b P 1a084a7c37184bf6a819f5abf483f363: Deleting consensus metadata
I20260812 17:42:54.180917 21508 catalog_manager.cc:4841] TS 1a084a7c37184bf6a819f5abf483f363 (127.17.255.3:36677): tablet 05ffcfda072348dfb208ba00eaf2ff4b (table test-table [id=5ea1dd71dc2b482f89f35f9d4c28b833]) successfully deleted
W20260812 17:42:54.184130 21510 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.255.1:35505 (error 108)
I20260812 17:42:54.184412 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 21896
I20260812 17:42:54.195106 22709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:54.193627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:35505 (local address 127.0.0.1:33488)
0812 17:42:54.194763 (+ 1136us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:54.194925 (+ 162us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.1:35505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1005,"thread_start_us":725,"threads_started":1}
W20260812 17:42:54.195360 21510 catalog_manager.cc:4584] TS 5983b40f0e604b9a997d9fcb66d1ee62 (127.17.255.1:35505): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 05ffcfda072348dfb208ba00eaf2ff4b: Network error: Client connection negotiation failed: client connection to 127.17.255.1:35505: connect: Connection refused (error 111)
I20260812 17:42:54.209874 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 22161
I20260812 17:42:54.227247 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 21478
2026-08-12T17:42:54Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (7094 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:42:54 dist-test-slave-tk9z krb5kdc[22713](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:42:54 dist-test-slave-tk9z krb5kdc[22713](info): set up 2 sockets
Aug 12 17:42:54 dist-test-slave-tk9z krb5kdc[22713](info): commencing operation
krb5kdc: starting...
W20260812 17:42:55.546904 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.284s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:42:55 dist-test-slave-tk9z krb5kdc[22713](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556575, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:42:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:42:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.255.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
I20260812 17:42:55.681625 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:41867
--webserver_interface=127.17.255.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:42027
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:41867
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:42:55.801755 22731 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:42:55.802119 22731 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:42:55.802205 22731 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:42:55.806622 22731 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:42:55.806751 22731 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:42:55.806790 22731 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:42:55.806833 22731 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:42:55.806869 22731 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:42:55.812650 22731 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:42027
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:41867
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:41867
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22731
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:42:55.813958 22731 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:42:55.815160 22731 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:42:55.825138 22746 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:42:55.825235 22731 server_base.cc:1034] running on GCE node
W20260812 17:42:55.825169 22741 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:42:55.825155 22742 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:42:55.826210 22731 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:42:55.827525 22731 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:42:55.828704 22731 hybrid_clock.cc:648] HybridClock initialized: now 1786556575828676 us; error 43 us; skew 500 ppm
Aug 12 17:42:55 dist-test-slave-tk9z krb5kdc[22713](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556575, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:42:55.831741 22731 init.cc:377] Logged in from keytab as kudu/127.17.255.62@KRBTEST.COM (short username kudu)
I20260812 17:42:55.832823 22731 webserver.cc:460] Webserver started at http://127.17.255.62:43669/ using document root <none> and password file <none>
I20260812 17:42:55.833396 22731 fs_manager.cc:359] Metadata directory not provided
I20260812 17:42:55.833473 22731 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:42:55.833659 22731 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:42:55.835811 22731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "a8864c2c9d8b4b7fbf2702901152b087"
format_stamp: "Formatted at 2026-08-12 17:42:55 on dist-test-slave-tk9z"
server_key: "604ceb46563c07e8739baf4d5b738f7d"
server_key_iv: "58359800af34abe07db7fe42551d44d1"
server_key_version: "encryptionkey@0"
I20260812 17:42:55.836339 22731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "a8864c2c9d8b4b7fbf2702901152b087"
format_stamp: "Formatted at 2026-08-12 17:42:55 on dist-test-slave-tk9z"
server_key: "604ceb46563c07e8739baf4d5b738f7d"
server_key_iv: "58359800af34abe07db7fe42551d44d1"
server_key_version: "encryptionkey@0"
I20260812 17:42:55.840339 22731 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 17:42:55.843014 22754 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:55.844416 22731 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:42:55.844538 22731 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "a8864c2c9d8b4b7fbf2702901152b087"
format_stamp: "Formatted at 2026-08-12 17:42:55 on dist-test-slave-tk9z"
server_key: "604ceb46563c07e8739baf4d5b738f7d"
server_key_iv: "58359800af34abe07db7fe42551d44d1"
server_key_version: "encryptionkey@0"
I20260812 17:42:55.844642 22731 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:42:55.855456 22731 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:42:55.858847 22731 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:42:55.859016 22731 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:42:55.866492 22731 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:41867
I20260812 17:42:55.866497 22849 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:41867 every 8 connection(s)
I20260812 17:42:55.867559 22731 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:42:55.869580 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 22731
I20260812 17:42:55.869673 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:42:55.870009 18428 external_mini_cluster.cc:1428] Setting key 4a66c16c7c162dc259b185677159a557
I20260812 17:42:55.870994 22853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:42:55.878688 22853 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8864c2c9d8b4b7fbf2702901152b087: Bootstrap starting.
Aug 12 17:42:55 dist-test-slave-tk9z krb5kdc[22713](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556575, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:42:55.881659 22853 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a8864c2c9d8b4b7fbf2702901152b087: Neither blocks nor log segments found. Creating new log.
I20260812 17:42:55.882520 22853 log.cc:824] T 00000000000000000000000000000000 P a8864c2c9d8b4b7fbf2702901152b087: Log is configured to *not* fsync() on all Append() calls
I20260812 17:42:55.884761 22853 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8864c2c9d8b4b7fbf2702901152b087: No bootstrap required, opened a new log
I20260812 17:42:55.886420 22857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:55.871801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34346 (local address 127.17.255.62:41867)
0812 17:42:55.872267 (+ 466us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:55.872289 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:55.872337 (+ 48us) server_negotiation.cc:407] Connection header received
0812 17:42:55.873030 (+ 693us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:55.873049 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:55.873423 (+ 374us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:55.873731 (+ 308us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:42:55.874890 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:55.876064 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:55.877333 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:55.877866 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:55.878019 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:55.881093 (+ 3074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:42:55.881099 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:42:55.881115 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:42:55.881150 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:42:55.883190 (+ 2040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:55.883699 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:55.883705 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:55.883711 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:55.883833 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:55.884139 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:55.884142 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:55.884144 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:55.884581 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:42:55.884782 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:55.885099 (+ 317us) server_negotiation.cc:299] Negotiation successful
0812 17:42:55.885426 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":152,"threads_started":1}
I20260812 17:42:55.888962 22853 raft_consensus.cc:348] T 00000000000000000000000000000000 P a8864c2c9d8b4b7fbf2702901152b087 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8864c2c9d8b4b7fbf2702901152b087" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 41867 } }
I20260812 17:42:55.889195 22853 raft_consensus.cc:374] T 00000000000000000000000000000000 P a8864c2c9d8b4b7fbf2702901152b087 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:42:55.889230 22853 raft_consensus.cc:729] T 00000000000000000000000000000000 P a8864c2c9d8b4b7fbf2702901152b087 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8864c2c9d8b4b7fbf2702901152b087, State: Initialized, Role: FOLLOWER
I20260812 17:42:55.889609 22853 consensus_queue.cc:260] T 00000000000000000000000000000000 P a8864c2c9d8b4b7fbf2702901152b087 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8864c2c9d8b4b7fbf2702901152b087" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 41867 } }
I20260812 17:42:55.889729 22853 raft_consensus.cc:388] T 00000000000000000000000000000000 P a8864c2c9d8b4b7fbf2702901152b087 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:42:55.889767 22853 raft_consensus.cc:482] T 00000000000000000000000000000000 P a8864c2c9d8b4b7fbf2702901152b087 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:42:55.889834 22853 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a8864c2c9d8b4b7fbf2702901152b087 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:42:55.891178 22853 raft_consensus.cc:504] T 00000000000000000000000000000000 P a8864c2c9d8b4b7fbf2702901152b087 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8864c2c9d8b4b7fbf2702901152b087" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 41867 } }
I20260812 17:42:55.891657 22853 leader_election.cc:302] T 00000000000000000000000000000000 P a8864c2c9d8b4b7fbf2702901152b087 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a8864c2c9d8b4b7fbf2702901152b087; no voters:
I20260812 17:42:55.892050 22853 leader_election.cc:288] T 00000000000000000000000000000000 P a8864c2c9d8b4b7fbf2702901152b087 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:42:55.892297 22861 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a8864c2c9d8b4b7fbf2702901152b087 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:42:55.892581 22861 raft_consensus.cc:686] T 00000000000000000000000000000000 P a8864c2c9d8b4b7fbf2702901152b087 [term 1 LEADER]: Becoming Leader. State: Replica: a8864c2c9d8b4b7fbf2702901152b087, State: Running, Role: LEADER
I20260812 17:42:55.892942 22861 consensus_queue.cc:237] T 00000000000000000000000000000000 P a8864c2c9d8b4b7fbf2702901152b087 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8864c2c9d8b4b7fbf2702901152b087" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 41867 } }
I20260812 17:42:55.893719 22853 sys_catalog.cc:564] T 00000000000000000000000000000000 P a8864c2c9d8b4b7fbf2702901152b087 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:42:55.895130 22865 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8864c2c9d8b4b7fbf2702901152b087 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a8864c2c9d8b4b7fbf2702901152b087. Latest consensus state: current_term: 1 leader_uuid: "a8864c2c9d8b4b7fbf2702901152b087" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8864c2c9d8b4b7fbf2702901152b087" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 41867 } } }
I20260812 17:42:55.895138 22862 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8864c2c9d8b4b7fbf2702901152b087 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a8864c2c9d8b4b7fbf2702901152b087" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8864c2c9d8b4b7fbf2702901152b087" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 41867 } } }
I20260812 17:42:55.895318 22862 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8864c2c9d8b4b7fbf2702901152b087 [sys.catalog]: This master's current role is: LEADER
I20260812 17:42:55.895316 22865 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8864c2c9d8b4b7fbf2702901152b087 [sys.catalog]: This master's current role is: LEADER
I20260812 17:42:55.895893 22877 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:42:55.899032 22877 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:42:55.905515 22877 catalog_manager.cc:1347] Generated new cluster ID: af78841c35284961b0560c4b5edc6360
I20260812 17:42:55.905619 22877 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:42:55.923259 22877 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:42:55.924551 22877 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:42:55.934188 22877 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a8864c2c9d8b4b7fbf2702901152b087: Generated new TSK 0
I20260812 17:42:55.935204 22877 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.255.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab.
Entry for principal kudu/127.17.255.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab.
I20260812 17:42:55.974584 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.1:0
--local_ip_for_outbound_sockets=127.17.255.1
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:41867
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:42027
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:42:56.094849 22897 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:42:56.095163 22897 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:42:56.095270 22897 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:42:56.099416 22897 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:42:56.099488 22897 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:42:56.099548 22897 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.1
I20260812 17:42:56.104827 22897 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:42027
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:41867
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22897
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.1
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:42:56.105921 22897 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:42:56.107003 22897 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:42:56.117575 22910 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:42:56.117578 22909 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:42:56.117624 22912 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:42:56.117955 22897 server_base.cc:1034] running on GCE node
I20260812 17:42:56.118556 22897 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:42:56.119241 22897 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:42:56.120458 22897 hybrid_clock.cc:648] HybridClock initialized: now 1786556576120411 us; error 60 us; skew 500 ppm
Aug 12 17:42:56 dist-test-slave-tk9z krb5kdc[22713](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556576, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:42:56.123826 22897 init.cc:377] Logged in from keytab as kudu/127.17.255.1@KRBTEST.COM (short username kudu)
I20260812 17:42:56.124825 22897 webserver.cc:460] Webserver started at http://127.17.255.1:36669/ using document root <none> and password file <none>
I20260812 17:42:56.125422 22897 fs_manager.cc:359] Metadata directory not provided
I20260812 17:42:56.125494 22897 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:42:56.125681 22897 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:42:56.127934 22897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-0/data/instance:
uuid: "1f9d9a1603be47678d63f81e8db4284d"
format_stamp: "Formatted at 2026-08-12 17:42:56 on dist-test-slave-tk9z"
server_key: "578b284fb3d49751ec7c947575fdef2a"
server_key_iv: "3e4dd23fbd2e62e92cb1f03224259838"
server_key_version: "encryptionkey@0"
I20260812 17:42:56.128499 22897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance:
uuid: "1f9d9a1603be47678d63f81e8db4284d"
format_stamp: "Formatted at 2026-08-12 17:42:56 on dist-test-slave-tk9z"
server_key: "578b284fb3d49751ec7c947575fdef2a"
server_key_iv: "3e4dd23fbd2e62e92cb1f03224259838"
server_key_version: "encryptionkey@0"
I20260812 17:42:56.132692 22897 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 17:42:56.135365 22923 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:56.136726 22897 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:42:56.136837 22897 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-0/wal
uuid: "1f9d9a1603be47678d63f81e8db4284d"
format_stamp: "Formatted at 2026-08-12 17:42:56 on dist-test-slave-tk9z"
server_key: "578b284fb3d49751ec7c947575fdef2a"
server_key_iv: "3e4dd23fbd2e62e92cb1f03224259838"
server_key_version: "encryptionkey@0"
I20260812 17:42:56.136935 22897 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:42:56.162233 22897 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:42:56.165927 22897 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:42:56.166103 22897 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:42:56.166806 22897 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:42:56.167656 22897 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:42:56.167706 22897 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:56.167747 22897 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:42:56.167762 22897 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:56.177245 22897 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.1:46017
I20260812 17:42:56.177362 23106 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.1:46017 every 8 connection(s)
I20260812 17:42:56.178272 22897 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
I20260812 17:42:56.183027 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 22897
I20260812 17:42:56.183140 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance
I20260812 17:42:56.183452 18428 external_mini_cluster.cc:1428] Setting key 7da1026599febd7bc656be5f5fd7c500
Aug 12 17:42:56 dist-test-slave-tk9z krb5kdc[22713](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556576, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.255.2@KRBTEST.COM; defaulting to no policy
I20260812 17:42:56.194125 22857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:56.180355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:59651 (local address 127.17.255.62:41867)
0812 17:42:56.180527 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:56.180531 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:56.181693 (+ 1162us) server_negotiation.cc:407] Connection header received
0812 17:42:56.182687 (+ 994us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:56.182690 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:56.182753 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:56.182863 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:42:56.184418 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:56.185124 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:56.186314 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:56.186774 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:56.186892 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:56.190068 (+ 3176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:42:56.190075 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:42:56.190079 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:42:56.190111 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:42:56.191777 (+ 1666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:56.192360 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:56.192365 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:56.192369 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:56.192458 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:56.192824 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:56.192829 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:56.192831 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:56.193040 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:42:56.193155 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:56.193791 (+ 636us) server_negotiation.cc:299] Negotiation successful
0812 17:42:56.193943 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 17:42:56.195182 23109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:56.180748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:41867 (local address 127.17.255.1:59651)
0812 17:42:56.181523 (+ 775us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:56.181566 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:56.182460 (+ 894us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:56.183059 (+ 599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:56.183067 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:56.183593 (+ 526us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:42:56.184250 (+ 657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:56.184283 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:56.185271 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:56.185274 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:56.186175 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:56.186185 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:56.186985 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:56.186992 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:56.187262 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:56.188028 (+ 766us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:42:56.188056 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:42:56.189853 (+ 1797us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:42:56.191947 (+ 2094us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:56.191954 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:56.191971 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:56.192249 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:56.192564 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:56.192568 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:56.192569 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:56.192723 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:56.193155 (+ 432us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:42:56.193164 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:42:56.193485 (+ 321us) client_negotiation.cc:769] Sending connection context
0812 17:42:56.193735 (+ 250us) client_negotiation.cc:240] Negotiation successful
0812 17:42:56.194096 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":130,"threads_started":1}
I20260812 17:42:56.196717 23107 heartbeater.cc:347] Connected to a master server at 127.17.255.62:41867
I20260812 17:42:56.197075 23107 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.2@KRBTEST.COM" created.
I20260812 17:42:56.197738 23107 heartbeater.cc:511] Master 127.17.255.62:41867 requested a full tablet report, sending...
I20260812 17:42:56.199827 22772 ts_manager.cc:194] Registered new tserver with Master: 1f9d9a1603be47678d63f81e8db4284d (127.17.255.1:46017)
I20260812 17:42:56.201567 22772 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.1@KRBTEST.COM'} at 127.17.255.1:59651
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab.
Entry for principal kudu/127.17.255.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab.
I20260812 17:42:56.217468 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.2:0
--local_ip_for_outbound_sockets=127.17.255.2
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:41867
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:42027
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:42:56.341336 23114 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:42:56.341656 23114 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:42:56.341735 23114 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:42:56.346087 23114 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:42:56.346182 23114 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:42:56.346273 23114 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.2
I20260812 17:42:56.352012 23114 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:42027
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:41867
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23114
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.2
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:42:56.353204 23114 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:42:56.354445 23114 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:42:56.365265 23120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:42:56.365291 23122 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:42:56.365312 23119 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:42:56.365777 23114 server_base.cc:1034] running on GCE node
I20260812 17:42:56.366295 23114 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:42:56.367038 23114 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:42:56.368244 23114 hybrid_clock.cc:648] HybridClock initialized: now 1786556576368186 us; error 71 us; skew 500 ppm
Aug 12 17:42:56 dist-test-slave-tk9z krb5kdc[22713](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556576, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:42:56.371709 23114 init.cc:377] Logged in from keytab as kudu/127.17.255.2@KRBTEST.COM (short username kudu)
I20260812 17:42:56.372768 23114 webserver.cc:460] Webserver started at http://127.17.255.2:36759/ using document root <none> and password file <none>
I20260812 17:42:56.373430 23114 fs_manager.cc:359] Metadata directory not provided
I20260812 17:42:56.373536 23114 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:42:56.373795 23114 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:42:56.376135 23114 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-1/data/instance:
uuid: "5ec2dea2894d4bd3b48458fcf84182f8"
format_stamp: "Formatted at 2026-08-12 17:42:56 on dist-test-slave-tk9z"
server_key: "06aae88adc24058f352537d62f3fa1ea"
server_key_iv: "c08d30d072f781e8fd5288bb9a598d67"
server_key_version: "encryptionkey@0"
I20260812 17:42:56.376806 23114 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance:
uuid: "5ec2dea2894d4bd3b48458fcf84182f8"
format_stamp: "Formatted at 2026-08-12 17:42:56 on dist-test-slave-tk9z"
server_key: "06aae88adc24058f352537d62f3fa1ea"
server_key_iv: "c08d30d072f781e8fd5288bb9a598d67"
server_key_version: "encryptionkey@0"
I20260812 17:42:56.381505 23114 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260812 17:42:56.384542 23131 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:56.386188 23114 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 17:42:56.386355 23114 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-1/wal
uuid: "5ec2dea2894d4bd3b48458fcf84182f8"
format_stamp: "Formatted at 2026-08-12 17:42:56 on dist-test-slave-tk9z"
server_key: "06aae88adc24058f352537d62f3fa1ea"
server_key_iv: "c08d30d072f781e8fd5288bb9a598d67"
server_key_version: "encryptionkey@0"
I20260812 17:42:56.386581 23114 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:42:56.413064 23114 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:42:56.416814 23114 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:42:56.417076 23114 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:42:56.417795 23114 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:42:56.418891 23114 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:42:56.418972 23114 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:56.419060 23114 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:42:56.419109 23114 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:56.429498 23114 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.2:36139
I20260812 17:42:56.429519 23319 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.2:36139 every 8 connection(s)
I20260812 17:42:56.430802 23114 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
I20260812 17:42:56.435910 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 23114
I20260812 17:42:56.436064 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance
I20260812 17:42:56.436394 18428 external_mini_cluster.cc:1428] Setting key 2c80c2a0f60e2fa51f0f1dfc05158bc0
Aug 12 17:42:56 dist-test-slave-tk9z krb5kdc[22713](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556576, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:42:56.446512 22857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:56.432815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:49019 (local address 127.17.255.62:41867)
0812 17:42:56.432958 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:56.432963 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:56.434168 (+ 1205us) server_negotiation.cc:407] Connection header received
0812 17:42:56.435232 (+ 1064us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:56.435235 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:56.435303 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:56.435400 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:42:56.436832 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:56.437461 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:56.438956 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:56.439360 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:56.439497 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:56.442628 (+ 3131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:42:56.442632 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:42:56.442635 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:42:56.442670 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:42:56.444224 (+ 1554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:56.444811 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:56.444814 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:56.444815 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:56.444897 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:56.445272 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:56.445276 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:56.445278 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:56.445487 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:42:56.445600 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:56.446174 (+ 574us) server_negotiation.cc:299] Negotiation successful
0812 17:42:56.446315 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
WARNING: no policy specified for kudu/127.17.255.3@KRBTEST.COM; defaulting to no policy
I20260812 17:42:56.447544 23326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:56.433245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:41867 (local address 127.17.255.2:49019)
0812 17:42:56.434007 (+ 762us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:56.434061 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:56.434992 (+ 931us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:56.435581 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:56.435588 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:56.435964 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:42:56.436645 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:56.436662 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:56.437615 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:56.437622 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:56.438806 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:56.438824 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:56.439519 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:56.439522 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:56.439671 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:56.440449 (+ 778us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:42:56.440477 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:42:56.442449 (+ 1972us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:42:56.444363 (+ 1914us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:56.444369 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:56.444389 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:56.444677 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:56.444997 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:56.445000 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:56.445002 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:56.445165 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:56.445601 (+ 436us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:42:56.445611 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:42:56.445905 (+ 294us) client_negotiation.cc:769] Sending connection context
0812 17:42:56.446113 (+ 208us) client_negotiation.cc:240] Negotiation successful
0812 17:42:56.446534 (+ 421us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":547,"thread_start_us":144,"threads_started":1}
I20260812 17:42:56.449216 23321 heartbeater.cc:347] Connected to a master server at 127.17.255.62:41867
I20260812 17:42:56.449640 23321 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.3@KRBTEST.COM" created.
I20260812 17:42:56.450327 23321 heartbeater.cc:511] Master 127.17.255.62:41867 requested a full tablet report, sending...
I20260812 17:42:56.451800 22772 ts_manager.cc:194] Registered new tserver with Master: 5ec2dea2894d4bd3b48458fcf84182f8 (127.17.255.2:36139)
I20260812 17:42:56.452646 22772 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.2@KRBTEST.COM'} at 127.17.255.2:49019
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab.
Entry for principal kudu/127.17.255.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab.
I20260812 17:42:56.470764 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.3:0
--local_ip_for_outbound_sockets=127.17.255.3
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:41867
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:42027
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:42:56.587379 23330 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:42:56.587715 23330 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:42:56.587793 23330 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:42:56.592640 23330 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:42:56.592780 23330 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:42:56.592900 23330 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.3
I20260812 17:42:56.599452 23330 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:42027
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:41867
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23330
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.3
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:42:56.600819 23330 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:42:56.602044 23330 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:42:56.613006 23335 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:42:56.613092 23341 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:42:56.612978 23336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:42:56.613468 23330 server_base.cc:1034] running on GCE node
I20260812 17:42:56.613965 23330 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:42:56.614763 23330 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:42:56.615983 23330 hybrid_clock.cc:648] HybridClock initialized: now 1786556576615964 us; error 32 us; skew 500 ppm
Aug 12 17:42:56 dist-test-slave-tk9z krb5kdc[22713](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556576, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:42:56.619073 23330 init.cc:377] Logged in from keytab as kudu/127.17.255.3@KRBTEST.COM (short username kudu)
I20260812 17:42:56.619983 23330 webserver.cc:460] Webserver started at http://127.17.255.3:46687/ using document root <none> and password file <none>
I20260812 17:42:56.620596 23330 fs_manager.cc:359] Metadata directory not provided
I20260812 17:42:56.620677 23330 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:42:56.620868 23330 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:42:56.623097 23330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-2/data/instance:
uuid: "47056d6c85294019a7a3f21fbd71870b"
format_stamp: "Formatted at 2026-08-12 17:42:56 on dist-test-slave-tk9z"
server_key: "f688b97eb841a262ec3eac0eb6a6c751"
server_key_iv: "e513d7dc00cccdf00c6d48ed300c50e6"
server_key_version: "encryptionkey@0"
I20260812 17:42:56.623657 23330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance:
uuid: "47056d6c85294019a7a3f21fbd71870b"
format_stamp: "Formatted at 2026-08-12 17:42:56 on dist-test-slave-tk9z"
server_key: "f688b97eb841a262ec3eac0eb6a6c751"
server_key_iv: "e513d7dc00cccdf00c6d48ed300c50e6"
server_key_version: "encryptionkey@0"
I20260812 17:42:56.627660 23330 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 17:42:56.630234 23354 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:56.631740 23330 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:42:56.631912 23330 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-2/wal
uuid: "47056d6c85294019a7a3f21fbd71870b"
format_stamp: "Formatted at 2026-08-12 17:42:56 on dist-test-slave-tk9z"
server_key: "f688b97eb841a262ec3eac0eb6a6c751"
server_key_iv: "e513d7dc00cccdf00c6d48ed300c50e6"
server_key_version: "encryptionkey@0"
I20260812 17:42:56.632041 23330 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:42:56.659804 23330 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:42:56.664410 23330 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:42:56.664711 23330 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:42:56.665472 23330 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:42:56.666564 23330 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:42:56.666622 23330 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:56.666671 23330 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:42:56.666731 23330 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:56.677224 23330 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.3:45461
I20260812 17:42:56.677246 23537 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.3:45461 every 8 connection(s)
I20260812 17:42:56.678329 23330 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
I20260812 17:42:56.678839 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 23330
I20260812 17:42:56.678985 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance
I20260812 17:42:56.679320 18428 external_mini_cluster.cc:1428] Setting key dca29354926b8848c61486249c8ced7b
Aug 12 17:42:56 dist-test-slave-tk9z krb5kdc[22713](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556576, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:42:56.694684 22857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:56.680629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:48155 (local address 127.17.255.62:41867)
0812 17:42:56.680772 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:56.680777 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:56.682296 (+ 1519us) server_negotiation.cc:407] Connection header received
0812 17:42:56.683418 (+ 1122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:56.683420 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:56.683468 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:56.683553 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:42:56.684894 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:56.685621 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:56.686964 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:56.687185 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:56.687273 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:56.689996 (+ 2723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:42:56.690000 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:42:56.690002 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:42:56.690028 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:42:56.691723 (+ 1695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:56.692261 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:56.692264 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:56.692265 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:56.692345 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:56.693152 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:56.693156 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:56.693158 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:56.693425 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:42:56.693566 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:56.694331 (+ 765us) server_negotiation.cc:299] Negotiation successful
0812 17:42:56.694507 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 17:42:56.695587 23541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:56.681285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:41867 (local address 127.17.255.3:48155)
0812 17:42:56.682124 (+ 839us) negotiation.cc:107] Waiting for socket to connect
0812 17:42:56.682183 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0812 17:42:56.683112 (+ 929us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:42:56.683781 (+ 669us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:42:56.683789 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:42:56.684193 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:42:56.684723 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:56.684738 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:56.685780 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:56.685783 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:56.686829 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:42:56.686840 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:42:56.687327 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:42:56.687330 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:42:56.687482 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:56.688084 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:42:56.688102 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:42:56.689780 (+ 1678us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:42:56.691858 (+ 2078us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:56.691863 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:56.691877 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:56.692145 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:56.692805 (+ 660us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:42:56.692807 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:42:56.692808 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:42:56.693018 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:42:56.693578 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:42:56.693587 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:42:56.693971 (+ 384us) client_negotiation.cc:769] Sending connection context
0812 17:42:56.694192 (+ 221us) client_negotiation.cc:240] Negotiation successful
0812 17:42:56.694538 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":601,"thread_start_us":158,"threads_started":1}
I20260812 17:42:56.696957 23539 heartbeater.cc:347] Connected to a master server at 127.17.255.62:41867
I20260812 17:42:56.697258 23539 heartbeater.cc:464] Registering TS with master...
I20260812 17:42:56.697839 23539 heartbeater.cc:511] Master 127.17.255.62:41867 requested a full tablet report, sending...
I20260812 17:42:56.699077 22772 ts_manager.cc:194] Registered new tserver with Master: 47056d6c85294019a7a3f21fbd71870b (127.17.255.3:45461)
I20260812 17:42:56.699673 22772 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.3@KRBTEST.COM'} at 127.17.255.3:48155
I20260812 17:42:56.706135 18428 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 17:42:56.721932 22857 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:42:56.720168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34348 (local address 127.17.255.62:41867)
0812 17:42:56.720365 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:56.720370 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:56.720554 (+ 184us) server_negotiation.cc:407] Connection header received
0812 17:42:56.720785 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:56.720788 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:56.720838 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:56.720940 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:42:56.721810 (+ 870us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34348: BlockingRecv error: recv got EOF from 127.0.0.1:34348 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
I20260812 17:42:56.723311 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 22897
I20260812 17:42:56.738478 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 23114
I20260812 17:42:56.766611 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 23330
I20260812 17:42:56.781243 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 22731
2026-08-12T17:42:56Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2553 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:42:56 dist-test-slave-tk9z krb5kdc[23564](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:42:56 dist-test-slave-tk9z krb5kdc[23564](info): set up 2 sockets
Aug 12 17:42:56 dist-test-slave-tk9z krb5kdc[23564](info): commencing operation
krb5kdc: starting...
W20260812 17:42:58.114519 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.298s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:42:58 dist-test-slave-tk9z krb5kdc[23564](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556578, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:42:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:42:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.255.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
I20260812 17:42:58.250938 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:45559
--webserver_interface=127.17.255.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:39079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:45559
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:42:58.371455 23586 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:42:58.371829 23586 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:42:58.371922 23586 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:42:58.376183 23586 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:42:58.376278 23586 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:42:58.376324 23586 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:42:58.376384 23586 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:42:58.376422 23586 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:42:58.382040 23586 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:39079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:45559
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:45559
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23586
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:42:58.383360 23586 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:42:58.384476 23586 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:42:58.394135 23598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:42:58.394119 23592 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:42:58.394119 23591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:42:58.394644 23586 server_base.cc:1034] running on GCE node
I20260812 17:42:58.395329 23586 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:42:58.396695 23586 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:42:58.397894 23586 hybrid_clock.cc:648] HybridClock initialized: now 1786556578397875 us; error 40 us; skew 500 ppm
Aug 12 17:42:58 dist-test-slave-tk9z krb5kdc[23564](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556578, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:42:58.401086 23586 init.cc:377] Logged in from keytab as kudu/127.17.255.62@KRBTEST.COM (short username kudu)
I20260812 17:42:58.402088 23586 webserver.cc:460] Webserver started at http://127.17.255.62:35873/ using document root <none> and password file <none>
I20260812 17:42:58.402824 23586 fs_manager.cc:359] Metadata directory not provided
I20260812 17:42:58.402901 23586 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:42:58.403170 23586 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:42:58.405606 23586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "dea9b437e3174c50825b5d948671dd1c"
format_stamp: "Formatted at 2026-08-12 17:42:58 on dist-test-slave-tk9z"
server_key: "dc29f8a738dcbc8f46c173ac902cbaee"
server_key_iv: "cec24d42c95ae31a334608010c609bfc"
server_key_version: "encryptionkey@0"
I20260812 17:42:58.406268 23586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "dea9b437e3174c50825b5d948671dd1c"
format_stamp: "Formatted at 2026-08-12 17:42:58 on dist-test-slave-tk9z"
server_key: "dc29f8a738dcbc8f46c173ac902cbaee"
server_key_iv: "cec24d42c95ae31a334608010c609bfc"
server_key_version: "encryptionkey@0"
I20260812 17:42:58.410739 23586 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 17:42:58.413837 23611 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:42:58.415560 23586 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:42:58.415735 23586 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "dea9b437e3174c50825b5d948671dd1c"
format_stamp: "Formatted at 2026-08-12 17:42:58 on dist-test-slave-tk9z"
server_key: "dc29f8a738dcbc8f46c173ac902cbaee"
server_key_iv: "cec24d42c95ae31a334608010c609bfc"
server_key_version: "encryptionkey@0"
I20260812 17:42:58.415874 23586 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:42:58.427728 23586 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:42:58.431787 23586 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:42:58.432071 23586 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:42:58.440768 23586 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:45559
I20260812 17:42:58.441154 23686 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:45559 every 8 connection(s)
I20260812 17:42:58.441905 23586 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:42:58.445068 23687 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:42:58.449208 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 23586
I20260812 17:42:58.449446 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:42:58.449821 18428 external_mini_cluster.cc:1428] Setting key f603d28d12f696a56ceb5986ba0690c4
I20260812 17:42:58.452508 23687 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dea9b437e3174c50825b5d948671dd1c: Bootstrap starting.
I20260812 17:42:58.455284 23687 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dea9b437e3174c50825b5d948671dd1c: Neither blocks nor log segments found. Creating new log.
I20260812 17:42:58.456259 23687 log.cc:824] T 00000000000000000000000000000000 P dea9b437e3174c50825b5d948671dd1c: Log is configured to *not* fsync() on all Append() calls
I20260812 17:42:58.458925 23687 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dea9b437e3174c50825b5d948671dd1c: No bootstrap required, opened a new log
Aug 12 17:42:58 dist-test-slave-tk9z krb5kdc[23564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556578, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:42:58.463989 23687 raft_consensus.cc:348] T 00000000000000000000000000000000 P dea9b437e3174c50825b5d948671dd1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dea9b437e3174c50825b5d948671dd1c" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45559 } }
I20260812 17:42:58.464373 23687 raft_consensus.cc:374] T 00000000000000000000000000000000 P dea9b437e3174c50825b5d948671dd1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:42:58.464478 23687 raft_consensus.cc:729] T 00000000000000000000000000000000 P dea9b437e3174c50825b5d948671dd1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea9b437e3174c50825b5d948671dd1c, State: Initialized, Role: FOLLOWER
I20260812 17:42:58.465057 23687 consensus_queue.cc:260] T 00000000000000000000000000000000 P dea9b437e3174c50825b5d948671dd1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dea9b437e3174c50825b5d948671dd1c" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45559 } }
I20260812 17:42:58.465243 23687 raft_consensus.cc:388] T 00000000000000000000000000000000 P dea9b437e3174c50825b5d948671dd1c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:42:58.465309 23687 raft_consensus.cc:482] T 00000000000000000000000000000000 P dea9b437e3174c50825b5d948671dd1c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:42:58.465421 23687 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dea9b437e3174c50825b5d948671dd1c [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:42:58.466977 23687 raft_consensus.cc:504] T 00000000000000000000000000000000 P dea9b437e3174c50825b5d948671dd1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dea9b437e3174c50825b5d948671dd1c" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45559 } }
I20260812 17:42:58.467465 23687 leader_election.cc:302] T 00000000000000000000000000000000 P dea9b437e3174c50825b5d948671dd1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dea9b437e3174c50825b5d948671dd1c; no voters:
I20260812 17:42:58.467645 23691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:58.451363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37154 (local address 127.17.255.62:45559)
0812 17:42:58.451821 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:58.451855 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:58.451895 (+ 40us) server_negotiation.cc:407] Connection header received
0812 17:42:58.452565 (+ 670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:58.452612 (+ 47us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:58.453027 (+ 415us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:58.453470 (+ 443us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:42:58.454761 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:58.456340 (+ 1579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:58.457579 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:58.458303 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:58.458530 (+ 227us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:58.461355 (+ 2825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:42:58.461362 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:42:58.461382 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:42:58.461418 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:42:58.463590 (+ 2172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:58.464116 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:58.464122 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:58.464130 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:58.464282 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:42:58.464726 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:42:58.464729 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:42:58.464731 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:42:58.465311 (+ 580us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:42:58.465542 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:58.465910 (+ 368us) server_negotiation.cc:299] Negotiation successful
0812 17:42:58.466241 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":138,"threads_started":1}
I20260812 17:42:58.467916 23687 leader_election.cc:288] T 00000000000000000000000000000000 P dea9b437e3174c50825b5d948671dd1c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:42:58.468070 23693 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dea9b437e3174c50825b5d948671dd1c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:42:58.468348 23693 raft_consensus.cc:686] T 00000000000000000000000000000000 P dea9b437e3174c50825b5d948671dd1c [term 1 LEADER]: Becoming Leader. State: Replica: dea9b437e3174c50825b5d948671dd1c, State: Running, Role: LEADER
I20260812 17:42:58.468747 23693 consensus_queue.cc:237] T 00000000000000000000000000000000 P dea9b437e3174c50825b5d948671dd1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dea9b437e3174c50825b5d948671dd1c" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45559 } }
I20260812 17:42:58.469424 23687 sys_catalog.cc:564] T 00000000000000000000000000000000 P dea9b437e3174c50825b5d948671dd1c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:42:58.471554 23694 sys_catalog.cc:455] T 00000000000000000000000000000000 P dea9b437e3174c50825b5d948671dd1c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dea9b437e3174c50825b5d948671dd1c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dea9b437e3174c50825b5d948671dd1c" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45559 } } }
I20260812 17:42:58.471714 18428 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 17:42:58.471726 23694 sys_catalog.cc:458] T 00000000000000000000000000000000 P dea9b437e3174c50825b5d948671dd1c [sys.catalog]: This master's current role is: LEADER
I20260812 17:42:58.472056 23695 sys_catalog.cc:455] T 00000000000000000000000000000000 P dea9b437e3174c50825b5d948671dd1c [sys.catalog]: SysCatalogTable state changed. Reason: New leader dea9b437e3174c50825b5d948671dd1c. Latest consensus state: current_term: 1 leader_uuid: "dea9b437e3174c50825b5d948671dd1c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dea9b437e3174c50825b5d948671dd1c" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45559 } } }
I20260812 17:42:58.472159 23695 sys_catalog.cc:458] T 00000000000000000000000000000000 P dea9b437e3174c50825b5d948671dd1c [sys.catalog]: This master's current role is: LEADER
I20260812 17:42:58.472497 23709 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:42:58.475907 23709 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:42:58.482647 23709 catalog_manager.cc:1347] Generated new cluster ID: d500264e149c454c80a47d80e66910ba
I20260812 17:42:58.482743 23709 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:42:58.496049 23691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:42:58.490465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37166 (local address 127.17.255.62:45559)
0812 17:42:58.490636 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0812 17:42:58.490641 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:42:58.490939 (+ 298us) server_negotiation.cc:407] Connection header received
0812 17:42:58.491141 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:42:58.491143 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:42:58.491193 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:42:58.491283 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:42:58.491882 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:58.492476 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:58.493499 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:42:58.493760 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:42:58.493885 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:42:58.494945 (+ 1060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:42:58.494949 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:42:58.494952 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:42:58.495496 (+ 544us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:42:58.495534 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:42:58.495552 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:42:58.495666 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 17:42:58.495779 (+ 113us) server_negotiation.cc:299] Negotiation successful
0812 17:42:58.495860 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":71}
I20260812 17:42:58.503307 23709 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:42:58.504792 23709 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:42:58.515161 23709 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dea9b437e3174c50825b5d948671dd1c: Generated new TSK 0
I20260812 17:42:58.516132 23709 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 17:42:58.530153 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 23586
2026-08-12T17:42:58Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1748 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:42:58 dist-test-slave-tk9z krb5kdc[23738](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:42:58 dist-test-slave-tk9z krb5kdc[23738](info): set up 2 sockets
Aug 12 17:42:58 dist-test-slave-tk9z krb5kdc[23738](info): commencing operation
krb5kdc: starting...
W20260812 17:42:59.877301 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.312s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:42:59 dist-test-slave-tk9z krb5kdc[23738](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556579, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:42:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:42:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.255.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
I20260812 17:43:00.015836 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:46411
--webserver_interface=127.17.255.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:44789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:46411
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:43:00.138077 23757 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:00.138629 23757 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:00.138715 23757 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:00.143039 23757 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:43:00.143110 23757 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:00.143131 23757 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:00.143149 23757 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:43:00.143167 23757 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:43:00.148736 23757 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:44789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:46411
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:46411
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23757
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:00.149901 23757 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:00.151115 23757 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:00.162637 23769 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:00.162693 23768 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:00.162637 23775 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:00.162940 23757 server_base.cc:1034] running on GCE node
I20260812 17:43:00.163780 23757 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:00.165094 23757 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:00.166340 23757 hybrid_clock.cc:648] HybridClock initialized: now 1786556580166290 us; error 65 us; skew 500 ppm
Aug 12 17:43:00 dist-test-slave-tk9z krb5kdc[23738](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556580, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:00.174980 23757 init.cc:377] Logged in from keytab as kudu/127.17.255.62@KRBTEST.COM (short username kudu)
I20260812 17:43:00.176235 23757 webserver.cc:460] Webserver started at http://127.17.255.62:41129/ using document root <none> and password file <none>
I20260812 17:43:00.176945 23757 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:00.177021 23757 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:00.177287 23757 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:00.179842 23757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "2a63c5fb5bec4b8fa3c676a0a75f9660"
format_stamp: "Formatted at 2026-08-12 17:43:00 on dist-test-slave-tk9z"
server_key: "e15d85a5d592e7f56a540573f10253f5"
server_key_iv: "e0a788b12d4729dc42afc7baa07892da"
server_key_version: "encryptionkey@0"
I20260812 17:43:00.180518 23757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "2a63c5fb5bec4b8fa3c676a0a75f9660"
format_stamp: "Formatted at 2026-08-12 17:43:00 on dist-test-slave-tk9z"
server_key: "e15d85a5d592e7f56a540573f10253f5"
server_key_iv: "e0a788b12d4729dc42afc7baa07892da"
server_key_version: "encryptionkey@0"
I20260812 17:43:00.184934 23757 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 17:43:00.187857 23792 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:00.189293 23757 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 17:43:00.189484 23757 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "2a63c5fb5bec4b8fa3c676a0a75f9660"
format_stamp: "Formatted at 2026-08-12 17:43:00 on dist-test-slave-tk9z"
server_key: "e15d85a5d592e7f56a540573f10253f5"
server_key_iv: "e0a788b12d4729dc42afc7baa07892da"
server_key_version: "encryptionkey@0"
I20260812 17:43:00.189621 23757 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:00.213505 23757 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:00.218073 23757 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:00.218416 23757 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:00.226476 23757 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:46411
I20260812 17:43:00.226794 23870 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:46411 every 8 connection(s)
I20260812 17:43:00.227689 23757 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:43:00.230892 23872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:00.234575 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 23757
I20260812 17:43:00.234736 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:43:00.235073 18428 external_mini_cluster.cc:1428] Setting key cb77af8fffb8cddf407e2f59db2879df
I20260812 17:43:00.237831 23872 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a63c5fb5bec4b8fa3c676a0a75f9660: Bootstrap starting.
I20260812 17:43:00.240809 23872 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a63c5fb5bec4b8fa3c676a0a75f9660: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:00.241767 23872 log.cc:824] T 00000000000000000000000000000000 P 2a63c5fb5bec4b8fa3c676a0a75f9660: Log is configured to *not* fsync() on all Append() calls
I20260812 17:43:00.244748 23872 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a63c5fb5bec4b8fa3c676a0a75f9660: No bootstrap required, opened a new log
Aug 12 17:43:00 dist-test-slave-tk9z krb5kdc[23738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556579, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:43:00.249818 23872 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a63c5fb5bec4b8fa3c676a0a75f9660 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a63c5fb5bec4b8fa3c676a0a75f9660" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 46411 } }
I20260812 17:43:00.250211 23872 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2a63c5fb5bec4b8fa3c676a0a75f9660 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:00.250324 23872 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a63c5fb5bec4b8fa3c676a0a75f9660 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a63c5fb5bec4b8fa3c676a0a75f9660, State: Initialized, Role: FOLLOWER
I20260812 17:43:00.251031 23872 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a63c5fb5bec4b8fa3c676a0a75f9660 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a63c5fb5bec4b8fa3c676a0a75f9660" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 46411 } }
I20260812 17:43:00.251230 23872 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2a63c5fb5bec4b8fa3c676a0a75f9660 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:43:00.251315 23872 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a63c5fb5bec4b8fa3c676a0a75f9660 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:43:00.251441 23872 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a63c5fb5bec4b8fa3c676a0a75f9660 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:00.252556 23872 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a63c5fb5bec4b8fa3c676a0a75f9660 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a63c5fb5bec4b8fa3c676a0a75f9660" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 46411 } }
I20260812 17:43:00.253024 23872 leader_election.cc:302] T 00000000000000000000000000000000 P 2a63c5fb5bec4b8fa3c676a0a75f9660 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2a63c5fb5bec4b8fa3c676a0a75f9660; no voters:
I20260812 17:43:00.253451 23872 leader_election.cc:288] T 00000000000000000000000000000000 P 2a63c5fb5bec4b8fa3c676a0a75f9660 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:43:00.253546 23885 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2a63c5fb5bec4b8fa3c676a0a75f9660 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:43:00.253770 23885 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2a63c5fb5bec4b8fa3c676a0a75f9660 [term 1 LEADER]: Becoming Leader. State: Replica: 2a63c5fb5bec4b8fa3c676a0a75f9660, State: Running, Role: LEADER
I20260812 17:43:00.254097 23878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:00.236721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54834 (local address 127.17.255.62:46411)
0812 17:43:00.237234 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:00.237255 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:00.237301 (+ 46us) server_negotiation.cc:407] Connection header received
0812 17:43:00.238180 (+ 879us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:00.238206 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:00.238683 (+ 477us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:00.239085 (+ 402us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:00.239926 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:00.241484 (+ 1558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:00.242764 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:00.243531 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:00.243714 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:00.246526 (+ 2812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:00.246535 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:00.246558 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:00.246597 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:00.249861 (+ 3264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:00.250629 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:00.250636 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:00.250643 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:00.250839 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:00.251276 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:00.251280 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:00.251283 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:00.251937 (+ 654us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:00.252209 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:00.252548 (+ 339us) server_negotiation.cc:299] Negotiation successful
0812 17:43:00.252940 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":146,"threads_started":1}
I20260812 17:43:00.254158 23885 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a63c5fb5bec4b8fa3c676a0a75f9660 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a63c5fb5bec4b8fa3c676a0a75f9660" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 46411 } }
I20260812 17:43:00.255092 23872 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a63c5fb5bec4b8fa3c676a0a75f9660 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:43:00.255615 23885 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a63c5fb5bec4b8fa3c676a0a75f9660 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a63c5fb5bec4b8fa3c676a0a75f9660. Latest consensus state: current_term: 1 leader_uuid: "2a63c5fb5bec4b8fa3c676a0a75f9660" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a63c5fb5bec4b8fa3c676a0a75f9660" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 46411 } } }
I20260812 17:43:00.255745 23885 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a63c5fb5bec4b8fa3c676a0a75f9660 [sys.catalog]: This master's current role is: LEADER
I20260812 17:43:00.256219 23886 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a63c5fb5bec4b8fa3c676a0a75f9660 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2a63c5fb5bec4b8fa3c676a0a75f9660" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a63c5fb5bec4b8fa3c676a0a75f9660" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 46411 } } }
I20260812 17:43:00.256322 23886 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a63c5fb5bec4b8fa3c676a0a75f9660 [sys.catalog]: This master's current role is: LEADER
I20260812 17:43:00.256875 23890 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:43:00.260740 23890 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:43:00.267547 23890 catalog_manager.cc:1347] Generated new cluster ID: ff5ef4415a9443659d52eb5898804c3c
I20260812 17:43:00.267653 23890 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:43:00.286321 23890 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:43:00.287927 23890 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:43:00.298252 23890 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2a63c5fb5bec4b8fa3c676a0a75f9660: Generated new TSK 0
I20260812 17:43:00.299240 23890 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.255.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab.
Entry for principal kudu/127.17.255.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab.
I20260812 17:43:00.344954 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.1:0
--local_ip_for_outbound_sockets=127.17.255.1
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:46411
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:44789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:43:00.489657 23921 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:00.489951 23921 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:00.489996 23921 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:00.494321 23921 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:00.494432 23921 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:00.494535 23921 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.1
I20260812 17:43:00.499966 23921 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:44789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:46411
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23921
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.1
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:00.501031 23921 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:00.502100 23921 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:00.512540 23933 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:00.512538 23929 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:00.512507 23931 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:00.512882 23921 server_base.cc:1034] running on GCE node
I20260812 17:43:00.513504 23921 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:00.514259 23921 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:00.515460 23921 hybrid_clock.cc:648] HybridClock initialized: now 1786556580515426 us; error 54 us; skew 500 ppm
Aug 12 17:43:00 dist-test-slave-tk9z krb5kdc[23738](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556580, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:00.518699 23921 init.cc:377] Logged in from keytab as kudu/127.17.255.1@KRBTEST.COM (short username kudu)
I20260812 17:43:00.520135 23921 webserver.cc:460] Webserver started at http://127.17.255.1:43797/ using document root <none> and password file <none>
I20260812 17:43:00.520812 23921 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:00.520920 23921 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:00.521165 23921 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:00.523620 23921 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-0/data/instance:
uuid: "9a8bb8698f1e41548aea7297cf24cf28"
format_stamp: "Formatted at 2026-08-12 17:43:00 on dist-test-slave-tk9z"
server_key: "9a966dcf6406682f7fbd9c1591662d3f"
server_key_iv: "fbd90ec3476a5041707405b28c9069d4"
server_key_version: "encryptionkey@0"
I20260812 17:43:00.524310 23921 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance:
uuid: "9a8bb8698f1e41548aea7297cf24cf28"
format_stamp: "Formatted at 2026-08-12 17:43:00 on dist-test-slave-tk9z"
server_key: "9a966dcf6406682f7fbd9c1591662d3f"
server_key_iv: "fbd90ec3476a5041707405b28c9069d4"
server_key_version: "encryptionkey@0"
I20260812 17:43:00.528599 23921 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 17:43:00.531469 23944 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:00.532840 23921 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:43:00.533005 23921 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-0/wal
uuid: "9a8bb8698f1e41548aea7297cf24cf28"
format_stamp: "Formatted at 2026-08-12 17:43:00 on dist-test-slave-tk9z"
server_key: "9a966dcf6406682f7fbd9c1591662d3f"
server_key_iv: "fbd90ec3476a5041707405b28c9069d4"
server_key_version: "encryptionkey@0"
I20260812 17:43:00.533149 23921 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:00.578650 23921 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:00.582449 23921 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:00.582700 23921 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:00.583421 23921 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:43:00.584364 23921 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:43:00.584441 23921 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:00.584522 23921 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:43:00.584568 23921 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:00.594996 23921 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.1:38021
I20260812 17:43:00.595032 24121 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.1:38021 every 8 connection(s)
I20260812 17:43:00.596253 23921 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
I20260812 17:43:00.604954 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 23921
I20260812 17:43:00.605134 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance
I20260812 17:43:00.605562 18428 external_mini_cluster.cc:1428] Setting key b0bc47e54e2c42055597b63fbb4c0715
Aug 12 17:43:00 dist-test-slave-tk9z krb5kdc[23738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556580, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:43:00.613783 23878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:00.598620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:58363 (local address 127.17.255.62:46411)
0812 17:43:00.598813 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:00.598817 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:00.599926 (+ 1109us) server_negotiation.cc:407] Connection header received
0812 17:43:00.601573 (+ 1647us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:00.601577 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:00.601647 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:00.601751 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:00.603235 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:00.603852 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:00.605282 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:00.605657 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:00.605784 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:00.609070 (+ 3286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:00.609077 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:00.609083 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:00.609120 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:00.610986 (+ 1866us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:00.611730 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:00.611733 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:00.611734 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:00.611856 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:00.612345 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:00.612348 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:00.612350 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:00.612624 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:00.612752 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:00.613509 (+ 757us) server_negotiation.cc:299] Negotiation successful
0812 17:43:00.613644 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260812 17:43:00.615243 24125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:00.599133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:46411 (local address 127.17.255.1:58363)
0812 17:43:00.599722 (+ 589us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:00.599791 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:00.601295 (+ 1504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:00.601993 (+ 698us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:00.602001 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:00.602473 (+ 472us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:00.603052 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:00.603067 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:00.604008 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:00.604012 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:00.605068 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:00.605080 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:00.605912 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:00.605915 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:00.606082 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:00.606845 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:00.606870 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:00.608881 (+ 2011us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:00.611130 (+ 2249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:00.611141 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:00.611165 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:00.611594 (+ 429us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:00.611963 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:00.611969 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:00.611974 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:00.612195 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:00.612778 (+ 583us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:00.612787 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:00.613191 (+ 404us) client_negotiation.cc:769] Sending connection context
0812 17:43:00.613443 (+ 252us) client_negotiation.cc:240] Negotiation successful
0812 17:43:00.613907 (+ 464us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":150,"threads_started":1}
I20260812 17:43:00.616737 24122 heartbeater.cc:347] Connected to a master server at 127.17.255.62:46411
I20260812 17:43:00.617038 24122 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.17.255.2@KRBTEST.COM; defaulting to no policy
I20260812 17:43:00.617718 24122 heartbeater.cc:511] Master 127.17.255.62:46411 requested a full tablet report, sending...
I20260812 17:43:00.619623 23815 ts_manager.cc:194] Registered new tserver with Master: 9a8bb8698f1e41548aea7297cf24cf28 (127.17.255.1:38021)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.2@KRBTEST.COM" created.
I20260812 17:43:00.620965 23815 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.1@KRBTEST.COM'} at 127.17.255.1:58363
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab.
Entry for principal kudu/127.17.255.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab.
I20260812 17:43:00.638940 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.2:0
--local_ip_for_outbound_sockets=127.17.255.2
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:46411
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:44789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:43:00.769413 24131 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:00.769851 24131 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:00.769975 24131 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:00.775038 24131 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:00.775115 24131 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:00.775218 24131 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.2
I20260812 17:43:00.782570 24131 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:44789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:46411
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24131
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.2
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:00.784071 24131 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:00.785247 24131 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:00.796393 24137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:00.796393 24138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:00.796416 24140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:00.797130 24131 server_base.cc:1034] running on GCE node
I20260812 17:43:00.797631 24131 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:00.798485 24131 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:00.799710 24131 hybrid_clock.cc:648] HybridClock initialized: now 1786556580799692 us; error 42 us; skew 500 ppm
Aug 12 17:43:00 dist-test-slave-tk9z krb5kdc[23738](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556580, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:00.803050 24131 init.cc:377] Logged in from keytab as kudu/127.17.255.2@KRBTEST.COM (short username kudu)
I20260812 17:43:00.804036 24131 webserver.cc:460] Webserver started at http://127.17.255.2:37875/ using document root <none> and password file <none>
I20260812 17:43:00.804673 24131 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:00.804785 24131 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:00.805048 24131 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:00.807610 24131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-1/data/instance:
uuid: "f8f3394284234e96a3ae9796df675401"
format_stamp: "Formatted at 2026-08-12 17:43:00 on dist-test-slave-tk9z"
server_key: "cce09f50e6fd6735c9e452f39316e71d"
server_key_iv: "05f09bdff6cbc972ae2b7abbef6a002d"
server_key_version: "encryptionkey@0"
I20260812 17:43:00.808327 24131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance:
uuid: "f8f3394284234e96a3ae9796df675401"
format_stamp: "Formatted at 2026-08-12 17:43:00 on dist-test-slave-tk9z"
server_key: "cce09f50e6fd6735c9e452f39316e71d"
server_key_iv: "05f09bdff6cbc972ae2b7abbef6a002d"
server_key_version: "encryptionkey@0"
I20260812 17:43:00.812703 24131 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 17:43:00.815586 24149 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:00.816988 24131 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:43:00.817176 24131 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-1/wal
uuid: "f8f3394284234e96a3ae9796df675401"
format_stamp: "Formatted at 2026-08-12 17:43:00 on dist-test-slave-tk9z"
server_key: "cce09f50e6fd6735c9e452f39316e71d"
server_key_iv: "05f09bdff6cbc972ae2b7abbef6a002d"
server_key_version: "encryptionkey@0"
I20260812 17:43:00.817328 24131 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:00.832156 24131 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:00.836030 24131 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:00.836275 24131 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:00.836972 24131 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:43:00.837942 24131 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:43:00.838023 24131 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:00.838109 24131 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:43:00.838169 24131 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:00.848067 24131 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.2:38333
I20260812 17:43:00.848102 24323 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.2:38333 every 8 connection(s)
I20260812 17:43:00.849112 24131 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
I20260812 17:43:00.858144 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 24131
I20260812 17:43:00.858302 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance
I20260812 17:43:00.858642 18428 external_mini_cluster.cc:1428] Setting key e6cab57accd74d1fe3ce78d9b93ccd37
Aug 12 17:43:00 dist-test-slave-tk9z krb5kdc[23738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556580, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:43:00.866741 23878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:00.851160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:56447 (local address 127.17.255.62:46411)
0812 17:43:00.851344 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:00.851349 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:00.852334 (+ 985us) server_negotiation.cc:407] Connection header received
0812 17:43:00.853764 (+ 1430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:00.853767 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:00.853837 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:00.853919 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:00.855382 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:00.856015 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:00.857993 (+ 1978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:00.858292 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:00.858454 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:00.861933 (+ 3479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:00.861941 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:00.861948 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:00.861988 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:00.863875 (+ 1887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:00.864688 (+ 813us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:00.864691 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:00.864692 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:00.864786 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:00.865264 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:00.865267 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:00.865268 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:00.865499 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:00.865580 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:00.866473 (+ 893us) server_negotiation.cc:299] Negotiation successful
0812 17:43:00.866612 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260812 17:43:00.868104 24327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:00.851618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:46411 (local address 127.17.255.2:56447)
0812 17:43:00.852154 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:00.852203 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:00.853529 (+ 1326us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:00.854099 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:00.854106 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:00.854511 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:00.855226 (+ 715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:00.855243 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:00.856180 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:00.856183 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:00.857781 (+ 1598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:00.857796 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:00.858518 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:00.858523 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:00.858786 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:00.859602 (+ 816us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:00.859631 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:00.861723 (+ 2092us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:00.864029 (+ 2306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:00.864041 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:00.864062 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:00.864554 (+ 492us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:00.864898 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:00.864904 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:00.864930 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:00.865153 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:00.865616 (+ 463us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:00.865627 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:00.866022 (+ 395us) client_negotiation.cc:769] Sending connection context
0812 17:43:00.866320 (+ 298us) client_negotiation.cc:240] Negotiation successful
0812 17:43:00.866793 (+ 473us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":131,"threads_started":1}
I20260812 17:43:00.869709 24325 heartbeater.cc:347] Connected to a master server at 127.17.255.62:46411
I20260812 17:43:00.870040 24325 heartbeater.cc:464] Registering TS with master...
I20260812 17:43:00.870772 24325 heartbeater.cc:511] Master 127.17.255.62:46411 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.17.255.3@KRBTEST.COM; defaulting to no policy
I20260812 17:43:00.872119 23815 ts_manager.cc:194] Registered new tserver with Master: f8f3394284234e96a3ae9796df675401 (127.17.255.2:38333)
I20260812 17:43:00.872820 23815 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.2@KRBTEST.COM'} at 127.17.255.2:56447
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab.
Entry for principal kudu/127.17.255.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab.
I20260812 17:43:00.895218 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.3:0
--local_ip_for_outbound_sockets=127.17.255.3
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:46411
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:44789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:43:01.026021 24331 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:01.026310 24331 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:01.026355 24331 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:01.030427 24331 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:01.030494 24331 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:01.030555 24331 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.3
I20260812 17:43:01.035841 24331 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:44789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:46411
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24331
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.3
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:01.036996 24331 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:01.038213 24331 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:01.048214 24337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:01.048224 24340 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:01.048223 24338 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:01.048523 24331 server_base.cc:1034] running on GCE node
I20260812 17:43:01.049031 24331 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:01.049826 24331 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:01.051046 24331 hybrid_clock.cc:648] HybridClock initialized: now 1786556581051032 us; error 32 us; skew 500 ppm
Aug 12 17:43:01 dist-test-slave-tk9z krb5kdc[23738](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556581, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:01.059347 24331 init.cc:377] Logged in from keytab as kudu/127.17.255.3@KRBTEST.COM (short username kudu)
I20260812 17:43:01.060422 24331 webserver.cc:460] Webserver started at http://127.17.255.3:33483/ using document root <none> and password file <none>
I20260812 17:43:01.061072 24331 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:01.061173 24331 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:01.061434 24331 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:01.063905 24331 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-2/data/instance:
uuid: "6ee2b108c2e54f86a82ec55b2808bf4d"
format_stamp: "Formatted at 2026-08-12 17:43:01 on dist-test-slave-tk9z"
server_key: "4ddf831b4c1a272b3f9196d710b01fe6"
server_key_iv: "81e8242c233a9d1ce26654c0e5699bab"
server_key_version: "encryptionkey@0"
I20260812 17:43:01.064553 24331 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance:
uuid: "6ee2b108c2e54f86a82ec55b2808bf4d"
format_stamp: "Formatted at 2026-08-12 17:43:01 on dist-test-slave-tk9z"
server_key: "4ddf831b4c1a272b3f9196d710b01fe6"
server_key_iv: "81e8242c233a9d1ce26654c0e5699bab"
server_key_version: "encryptionkey@0"
I20260812 17:43:01.068739 24331 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 17:43:01.071565 24354 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:01.073020 24331 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:43:01.073184 24331 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-2/wal
uuid: "6ee2b108c2e54f86a82ec55b2808bf4d"
format_stamp: "Formatted at 2026-08-12 17:43:01 on dist-test-slave-tk9z"
server_key: "4ddf831b4c1a272b3f9196d710b01fe6"
server_key_iv: "81e8242c233a9d1ce26654c0e5699bab"
server_key_version: "encryptionkey@0"
I20260812 17:43:01.073323 24331 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:01.103168 24331 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:01.107720 24331 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:01.108001 24331 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:01.108758 24331 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:43:01.110216 24331 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:43:01.110328 24331 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:01.110430 24331 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:43:01.110498 24331 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:01.121529 24331 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.3:37651
I20260812 17:43:01.121600 24528 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.3:37651 every 8 connection(s)
I20260812 17:43:01.122735 24331 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
I20260812 17:43:01.125532 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 24331
I20260812 17:43:01.125679 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance
I20260812 17:43:01.126041 18428 external_mini_cluster.cc:1428] Setting key 67f5a93166300d0115bbbcfd3a9a35cc
Aug 12 17:43:01 dist-test-slave-tk9z krb5kdc[23738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556581, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:43:01.143368 23878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:01.125060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:46419 (local address 127.17.255.62:46411)
0812 17:43:01.125234 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:01.125240 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:01.126521 (+ 1281us) server_negotiation.cc:407] Connection header received
0812 17:43:01.128782 (+ 2261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:01.128788 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:01.128856 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:01.128983 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:01.131045 (+ 2062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:01.131945 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:01.134240 (+ 2295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:01.134784 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:01.134897 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:01.139122 (+ 4225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:01.139126 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:01.139129 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:01.139170 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:01.140734 (+ 1564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:01.141381 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:01.141384 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:01.141406 (+ 22us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:01.141517 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:01.141968 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:01.141971 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:01.141973 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:01.142240 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:01.142350 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:01.143061 (+ 711us) server_negotiation.cc:299] Negotiation successful
0812 17:43:01.143198 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 17:43:01.144510 24532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:01.125578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:46411 (local address 127.17.255.3:46419)
0812 17:43:01.126290 (+ 712us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:01.126356 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:01.128473 (+ 2117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:01.129250 (+ 777us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:01.129263 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:01.129844 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:01.130820 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:01.130857 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:01.132136 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:01.132141 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:01.134030 (+ 1889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:01.134048 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:01.135200 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:01.135207 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:01.135521 (+ 314us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:01.136351 (+ 830us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:01.136380 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:01.138862 (+ 2482us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:01.140888 (+ 2026us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:01.140896 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:01.140920 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:01.141252 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:01.141638 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:01.141641 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:01.141643 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:01.141847 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:01.142384 (+ 537us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:01.142394 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:01.142779 (+ 385us) client_negotiation.cc:769] Sending connection context
0812 17:43:01.143004 (+ 225us) client_negotiation.cc:240] Negotiation successful
0812 17:43:01.143391 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":152,"threads_started":1}
I20260812 17:43:01.147670 24529 heartbeater.cc:347] Connected to a master server at 127.17.255.62:46411
I20260812 17:43:01.147980 24529 heartbeater.cc:464] Registering TS with master...
I20260812 17:43:01.148666 24529 heartbeater.cc:511] Master 127.17.255.62:46411 requested a full tablet report, sending...
I20260812 17:43:01.150048 23815 ts_manager.cc:194] Registered new tserver with Master: 6ee2b108c2e54f86a82ec55b2808bf4d (127.17.255.3:37651)
I20260812 17:43:01.150768 23815 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.3@KRBTEST.COM'} at 127.17.255.3:46419
I20260812 17:43:01.156251 18428 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 17:43:01 dist-test-slave-tk9z krb5kdc[23738](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556581, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 12 17:43:01 dist-test-slave-tk9z krb5kdc[23738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556581, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:43:01.194913 23878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:01.183433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54838 (local address 127.17.255.62:46411)
0812 17:43:01.183608 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:01.183614 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:01.183737 (+ 123us) server_negotiation.cc:407] Connection header received
0812 17:43:01.183858 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:01.183865 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:01.183935 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:01.184062 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:01.184829 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:01.185787 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:01.187019 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:01.187272 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:01.187413 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:01.190149 (+ 2736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:01.190157 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:01.190163 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:01.190211 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:01.192523 (+ 2312us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:01.193134 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:01.193142 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:01.193146 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:01.193312 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:01.193692 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:01.193696 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:01.193698 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:01.194003 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:01.194127 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:01.194584 (+ 457us) server_negotiation.cc:299] Negotiation successful
0812 17:43:01.194737 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
W20260812 17:43:01.195370 23815 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:54838
I20260812 17:43:01.196532 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 23921
I20260812 17:43:01.221242 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 24131
I20260812 17:43:01.236886 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 24331
I20260812 17:43:01.256387 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 23757
2026-08-12T17:43:01Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2718 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:43:01 dist-test-slave-tk9z krb5kdc[24553](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:43:01 dist-test-slave-tk9z krb5kdc[24553](info): set up 2 sockets
Aug 12 17:43:01 dist-test-slave-tk9z krb5kdc[24553](info): commencing operation
krb5kdc: starting...
W20260812 17:43:02.605787 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.322s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:43:02 dist-test-slave-tk9z krb5kdc[24553](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556582, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:43:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:43:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.255.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
I20260812 17:43:02.750914 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:36997
--webserver_interface=127.17.255.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:41935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:36997
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:43:02.877243 24574 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:02.877630 24574 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:02.877717 24574 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:02.881875 24574 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:43:02.881978 24574 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:02.882012 24574 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:02.882055 24574 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:43:02.882086 24574 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:43:02.887813 24574 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:41935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:36997
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:36997
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24574
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:02.889107 24574 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:02.890271 24574 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:02.899641 24582 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:02.899628 24585 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:02.899631 24580 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:02.900413 24574 server_base.cc:1034] running on GCE node
I20260812 17:43:02.901078 24574 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:02.902323 24574 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:02.903575 24574 hybrid_clock.cc:648] HybridClock initialized: now 1786556582903543 us; error 49 us; skew 500 ppm
Aug 12 17:43:02 dist-test-slave-tk9z krb5kdc[24553](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556582, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:02.906889 24574 init.cc:377] Logged in from keytab as kudu/127.17.255.62@KRBTEST.COM (short username kudu)
I20260812 17:43:02.908334 24574 webserver.cc:460] Webserver started at http://127.17.255.62:33293/ using document root <none> and password file <none>
I20260812 17:43:02.909235 24574 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:02.909340 24574 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:02.909632 24574 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:02.913317 24574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "032a5dc17b444aaaabe16f7cd20b80fc"
format_stamp: "Formatted at 2026-08-12 17:43:02 on dist-test-slave-tk9z"
server_key: "9ef6632e0c0538c106ba5b8a01bbd06d"
server_key_iv: "efe0c0d94dc3a6e6d7c3462aa22fba7f"
server_key_version: "encryptionkey@0"
I20260812 17:43:02.914405 24574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "032a5dc17b444aaaabe16f7cd20b80fc"
format_stamp: "Formatted at 2026-08-12 17:43:02 on dist-test-slave-tk9z"
server_key: "9ef6632e0c0538c106ba5b8a01bbd06d"
server_key_iv: "efe0c0d94dc3a6e6d7c3462aa22fba7f"
server_key_version: "encryptionkey@0"
I20260812 17:43:02.919046 24574 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260812 17:43:02.921773 24595 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:02.923530 24574 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:43:02.923723 24574 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "032a5dc17b444aaaabe16f7cd20b80fc"
format_stamp: "Formatted at 2026-08-12 17:43:02 on dist-test-slave-tk9z"
server_key: "9ef6632e0c0538c106ba5b8a01bbd06d"
server_key_iv: "efe0c0d94dc3a6e6d7c3462aa22fba7f"
server_key_version: "encryptionkey@0"
I20260812 17:43:02.923878 24574 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:02.954958 24574 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:02.958312 24574 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:02.958568 24574 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:02.966157 24574 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:36997
I20260812 17:43:02.966176 24684 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:36997 every 8 connection(s)
I20260812 17:43:02.967252 24574 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:43:02.970449 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 24574
I20260812 17:43:02.970480 24685 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:02.970613 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:43:02.970912 18428 external_mini_cluster.cc:1428] Setting key b4dc4904262f12eb2c9071a02b91fa47
I20260812 17:43:02.978300 24685 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 032a5dc17b444aaaabe16f7cd20b80fc: Bootstrap starting.
I20260812 17:43:02.981206 24685 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 032a5dc17b444aaaabe16f7cd20b80fc: Neither blocks nor log segments found. Creating new log.
Aug 12 17:43:02 dist-test-slave-tk9z krb5kdc[24553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556582, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:43:02.982175 24685 log.cc:824] T 00000000000000000000000000000000 P 032a5dc17b444aaaabe16f7cd20b80fc: Log is configured to *not* fsync() on all Append() calls
I20260812 17:43:02.985008 24685 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 032a5dc17b444aaaabe16f7cd20b80fc: No bootstrap required, opened a new log
I20260812 17:43:02.987831 24690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:02.972472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55872 (local address 127.17.255.62:36997)
0812 17:43:02.972927 (+ 455us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:02.972950 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:02.972995 (+ 45us) server_negotiation.cc:407] Connection header received
0812 17:43:02.974190 (+ 1195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:02.974218 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:02.974731 (+ 513us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:02.975123 (+ 392us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:02.975901 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:02.977445 (+ 1544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:02.978468 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:02.979133 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:02.979321 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:02.982290 (+ 2969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:02.982300 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:02.982320 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:02.982353 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:02.984697 (+ 2344us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:02.985258 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:02.985264 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:02.985269 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:02.985420 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:02.985739 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:02.985742 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:02.985744 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:02.986172 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:02.986421 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:02.986739 (+ 318us) server_negotiation.cc:299] Negotiation successful
0812 17:43:02.987064 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":115,"threads_started":1}
I20260812 17:43:02.989151 24685 raft_consensus.cc:348] T 00000000000000000000000000000000 P 032a5dc17b444aaaabe16f7cd20b80fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "032a5dc17b444aaaabe16f7cd20b80fc" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 36997 } }
I20260812 17:43:02.989455 24685 raft_consensus.cc:374] T 00000000000000000000000000000000 P 032a5dc17b444aaaabe16f7cd20b80fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:02.989511 24685 raft_consensus.cc:729] T 00000000000000000000000000000000 P 032a5dc17b444aaaabe16f7cd20b80fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 032a5dc17b444aaaabe16f7cd20b80fc, State: Initialized, Role: FOLLOWER
I20260812 17:43:02.990010 24685 consensus_queue.cc:260] T 00000000000000000000000000000000 P 032a5dc17b444aaaabe16f7cd20b80fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "032a5dc17b444aaaabe16f7cd20b80fc" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 36997 } }
I20260812 17:43:02.990228 24685 raft_consensus.cc:388] T 00000000000000000000000000000000 P 032a5dc17b444aaaabe16f7cd20b80fc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:43:02.990321 24685 raft_consensus.cc:482] T 00000000000000000000000000000000 P 032a5dc17b444aaaabe16f7cd20b80fc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:43:02.990471 24685 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 032a5dc17b444aaaabe16f7cd20b80fc [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:02.991513 24685 raft_consensus.cc:504] T 00000000000000000000000000000000 P 032a5dc17b444aaaabe16f7cd20b80fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "032a5dc17b444aaaabe16f7cd20b80fc" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 36997 } }
I20260812 17:43:02.991905 24685 leader_election.cc:302] T 00000000000000000000000000000000 P 032a5dc17b444aaaabe16f7cd20b80fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 032a5dc17b444aaaabe16f7cd20b80fc; no voters:
I20260812 17:43:02.992264 24685 leader_election.cc:288] T 00000000000000000000000000000000 P 032a5dc17b444aaaabe16f7cd20b80fc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:43:02.992514 24692 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 032a5dc17b444aaaabe16f7cd20b80fc [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:43:02.992798 24692 raft_consensus.cc:686] T 00000000000000000000000000000000 P 032a5dc17b444aaaabe16f7cd20b80fc [term 1 LEADER]: Becoming Leader. State: Replica: 032a5dc17b444aaaabe16f7cd20b80fc, State: Running, Role: LEADER
I20260812 17:43:02.993168 24692 consensus_queue.cc:237] T 00000000000000000000000000000000 P 032a5dc17b444aaaabe16f7cd20b80fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "032a5dc17b444aaaabe16f7cd20b80fc" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 36997 } }
I20260812 17:43:02.993976 24685 sys_catalog.cc:564] T 00000000000000000000000000000000 P 032a5dc17b444aaaabe16f7cd20b80fc [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:43:02.995317 24695 sys_catalog.cc:455] T 00000000000000000000000000000000 P 032a5dc17b444aaaabe16f7cd20b80fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 032a5dc17b444aaaabe16f7cd20b80fc. Latest consensus state: current_term: 1 leader_uuid: "032a5dc17b444aaaabe16f7cd20b80fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "032a5dc17b444aaaabe16f7cd20b80fc" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 36997 } } }
I20260812 17:43:02.995491 24695 sys_catalog.cc:458] T 00000000000000000000000000000000 P 032a5dc17b444aaaabe16f7cd20b80fc [sys.catalog]: This master's current role is: LEADER
I20260812 17:43:02.995323 24693 sys_catalog.cc:455] T 00000000000000000000000000000000 P 032a5dc17b444aaaabe16f7cd20b80fc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "032a5dc17b444aaaabe16f7cd20b80fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "032a5dc17b444aaaabe16f7cd20b80fc" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 36997 } } }
I20260812 17:43:02.995841 24693 sys_catalog.cc:458] T 00000000000000000000000000000000 P 032a5dc17b444aaaabe16f7cd20b80fc [sys.catalog]: This master's current role is: LEADER
I20260812 17:43:02.996085 24706 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:43:02.999681 24706 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:43:03.005678 24706 catalog_manager.cc:1347] Generated new cluster ID: 4c0db0e701294d0a880989bd09b4a169
I20260812 17:43:03.005770 24706 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:43:03.023722 24706 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:43:03.024802 24706 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:43:03.037938 24706 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 032a5dc17b444aaaabe16f7cd20b80fc: Generated new TSK 0
I20260812 17:43:03.038789 24706 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.255.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab.
Entry for principal kudu/127.17.255.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab.
I20260812 17:43:03.078747 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.1:0
--local_ip_for_outbound_sockets=127.17.255.1
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:36997
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:41935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:43:03.200834 24723 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:03.201130 24723 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:03.201177 24723 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:03.205315 24723 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:03.205401 24723 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:03.205462 24723 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.1
I20260812 17:43:03.211346 24723 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:41935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:36997
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24723
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.1
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:03.212536 24723 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:03.213677 24723 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:03.224413 24734 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:03.224442 24733 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:03.224463 24736 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:03.224900 24723 server_base.cc:1034] running on GCE node
I20260812 17:43:03.225337 24723 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:03.226017 24723 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:03.227195 24723 hybrid_clock.cc:648] HybridClock initialized: now 1786556583227150 us; error 64 us; skew 500 ppm
Aug 12 17:43:03 dist-test-slave-tk9z krb5kdc[24553](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556583, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:03.231180 24723 init.cc:377] Logged in from keytab as kudu/127.17.255.1@KRBTEST.COM (short username kudu)
I20260812 17:43:03.232533 24723 webserver.cc:460] Webserver started at http://127.17.255.1:39401/ using document root <none> and password file <none>
I20260812 17:43:03.233186 24723 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:03.233258 24723 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:03.233470 24723 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:03.235926 24723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-0/data/instance:
uuid: "246e13bd6c494cc689e1439e433037fb"
format_stamp: "Formatted at 2026-08-12 17:43:03 on dist-test-slave-tk9z"
server_key: "1d340a62b47faba5d67f43029b6ac8be"
server_key_iv: "88314fa4ddba0c5e68d3a92ae7888929"
server_key_version: "encryptionkey@0"
I20260812 17:43:03.236567 24723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance:
uuid: "246e13bd6c494cc689e1439e433037fb"
format_stamp: "Formatted at 2026-08-12 17:43:03 on dist-test-slave-tk9z"
server_key: "1d340a62b47faba5d67f43029b6ac8be"
server_key_iv: "88314fa4ddba0c5e68d3a92ae7888929"
server_key_version: "encryptionkey@0"
I20260812 17:43:03.240819 24723 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 17:43:03.243705 24746 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:03.245097 24723 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:43:03.245250 24723 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-0/wal
uuid: "246e13bd6c494cc689e1439e433037fb"
format_stamp: "Formatted at 2026-08-12 17:43:03 on dist-test-slave-tk9z"
server_key: "1d340a62b47faba5d67f43029b6ac8be"
server_key_iv: "88314fa4ddba0c5e68d3a92ae7888929"
server_key_version: "encryptionkey@0"
I20260812 17:43:03.245417 24723 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:03.260449 24723 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:03.264341 24723 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:03.264591 24723 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:03.265357 24723 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:43:03.266297 24723 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:43:03.266373 24723 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:03.266477 24723 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:43:03.266535 24723 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:03.276587 24723 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.1:40209
I20260812 17:43:03.276607 24901 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.1:40209 every 8 connection(s)
I20260812 17:43:03.277601 24723 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
I20260812 17:43:03.287523 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 24723
I20260812 17:43:03.287652 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance
I20260812 17:43:03.288026 18428 external_mini_cluster.cc:1428] Setting key 371e20489e55818ffc556928b140e294
Aug 12 17:43:03 dist-test-slave-tk9z krb5kdc[24553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556583, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:43:03.294348 24690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:03.279720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:57443 (local address 127.17.255.62:36997)
0812 17:43:03.279912 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:03.279917 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:03.280833 (+ 916us) server_negotiation.cc:407] Connection header received
0812 17:43:03.282432 (+ 1599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:03.282436 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:03.282489 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:03.282567 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:03.283940 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:03.284515 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:03.285773 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:03.286028 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:03.286125 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:03.289432 (+ 3307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:03.289436 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:03.289438 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:03.289464 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:03.291487 (+ 2023us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:03.292370 (+ 883us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:03.292374 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:03.292376 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:03.292486 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:03.292927 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:03.292931 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:03.292934 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:03.293163 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:03.293291 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:03.294003 (+ 712us) server_negotiation.cc:299] Negotiation successful
0812 17:43:03.294160 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260812 17:43:03.295542 24904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:03.280138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:36997 (local address 127.17.255.1:57443)
0812 17:43:03.280649 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:03.280697 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:03.282141 (+ 1444us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:03.282762 (+ 621us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:03.282770 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:03.283204 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:03.283772 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:03.283787 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:03.284666 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:03.284669 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:03.285619 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:03.285630 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:03.286204 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:03.286208 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:03.286400 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:03.287152 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:03.287170 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:03.289205 (+ 2035us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:03.291784 (+ 2579us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:03.291791 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:03.291808 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:03.292202 (+ 394us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:03.292600 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:03.292604 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:03.292606 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:03.292802 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:03.293292 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:03.293302 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:03.293695 (+ 393us) client_negotiation.cc:769] Sending connection context
0812 17:43:03.293941 (+ 246us) client_negotiation.cc:240] Negotiation successful
0812 17:43:03.294342 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":114,"threads_started":1}
I20260812 17:43:03.297066 24902 heartbeater.cc:347] Connected to a master server at 127.17.255.62:36997
I20260812 17:43:03.297441 24902 heartbeater.cc:464] Registering TS with master...
I20260812 17:43:03.298084 24902 heartbeater.cc:511] Master 127.17.255.62:36997 requested a full tablet report, sending...
I20260812 17:43:03.300060 24622 ts_manager.cc:194] Registered new tserver with Master: 246e13bd6c494cc689e1439e433037fb (127.17.255.1:40209)
WARNING: no policy specified for kudu/127.17.255.2@KRBTEST.COM; defaulting to no policy
I20260812 17:43:03.301491 24622 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.1@KRBTEST.COM'} at 127.17.255.1:57443
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab.
Entry for principal kudu/127.17.255.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab.
I20260812 17:43:03.321759 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.2:0
--local_ip_for_outbound_sockets=127.17.255.2
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:36997
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:41935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:43:03.444422 24913 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:03.444710 24913 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:03.444753 24913 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:03.448959 24913 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:03.449059 24913 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:03.449157 24913 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.2
I20260812 17:43:03.454777 24913 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:41935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:36997
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24913
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.2
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:03.456018 24913 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:03.457144 24913 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 17:43:03.467649 24913 server_base.cc:1034] running on GCE node
W20260812 17:43:03.467674 24923 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:03.467660 24920 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:03.467825 24919 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:03.468370 24913 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:03.468989 24913 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:03.470191 24913 hybrid_clock.cc:648] HybridClock initialized: now 1786556583470171 us; error 33 us; skew 500 ppm
Aug 12 17:43:03 dist-test-slave-tk9z krb5kdc[24553](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556583, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:03.473102 24913 init.cc:377] Logged in from keytab as kudu/127.17.255.2@KRBTEST.COM (short username kudu)
I20260812 17:43:03.474016 24913 webserver.cc:460] Webserver started at http://127.17.255.2:33001/ using document root <none> and password file <none>
I20260812 17:43:03.474689 24913 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:03.474785 24913 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:03.475039 24913 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:03.477504 24913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-1/data/instance:
uuid: "5907b3d5d4c64dfd9830e61da0f37e47"
format_stamp: "Formatted at 2026-08-12 17:43:03 on dist-test-slave-tk9z"
server_key: "5fff9dc6833fe373e0c985756e153c4e"
server_key_iv: "e42f749e51b5e93bacd083efb678f09a"
server_key_version: "encryptionkey@0"
I20260812 17:43:03.478173 24913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance:
uuid: "5907b3d5d4c64dfd9830e61da0f37e47"
format_stamp: "Formatted at 2026-08-12 17:43:03 on dist-test-slave-tk9z"
server_key: "5fff9dc6833fe373e0c985756e153c4e"
server_key_iv: "e42f749e51b5e93bacd083efb678f09a"
server_key_version: "encryptionkey@0"
I20260812 17:43:03.482075 24913 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.000s
I20260812 17:43:03.484810 24933 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:03.486212 24913 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260812 17:43:03.486452 24913 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-1/wal
uuid: "5907b3d5d4c64dfd9830e61da0f37e47"
format_stamp: "Formatted at 2026-08-12 17:43:03 on dist-test-slave-tk9z"
server_key: "5fff9dc6833fe373e0c985756e153c4e"
server_key_iv: "e42f749e51b5e93bacd083efb678f09a"
server_key_version: "encryptionkey@0"
I20260812 17:43:03.486593 24913 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:03.513953 24913 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:03.517866 24913 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:03.518110 24913 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:03.518883 24913 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:43:03.519878 24913 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:43:03.519954 24913 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:03.520032 24913 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:43:03.520084 24913 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:03.530174 24913 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.2:45161
I20260812 17:43:03.530198 25108 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.2:45161 every 8 connection(s)
I20260812 17:43:03.531486 24913 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
I20260812 17:43:03.540478 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 24913
I20260812 17:43:03.540624 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance
I20260812 17:43:03.540988 18428 external_mini_cluster.cc:1428] Setting key 75d5b7eca915c959cae3af5f443f1664
Aug 12 17:43:03 dist-test-slave-tk9z krb5kdc[24553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556583, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:43:03.546777 24690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:03.533548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:54535 (local address 127.17.255.62:36997)
0812 17:43:03.533717 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:03.533723 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:03.534931 (+ 1208us) server_negotiation.cc:407] Connection header received
0812 17:43:03.535838 (+ 907us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:03.535840 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:03.535891 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:03.535970 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:03.537263 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:03.537834 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:03.539110 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:03.539334 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:03.539447 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:03.542556 (+ 3109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:03.542560 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:03.542563 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:03.542592 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:03.544380 (+ 1788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:03.544949 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:03.544956 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:03.544959 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:03.545062 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:03.545439 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:03.545445 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:03.545448 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:03.545708 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:03.545818 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:03.546539 (+ 721us) server_negotiation.cc:299] Negotiation successful
0812 17:43:03.546654 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 17:43:03.548097 25112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:03.534010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:36997 (local address 127.17.255.2:54535)
0812 17:43:03.534762 (+ 752us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:03.534808 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:03.535614 (+ 806us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:03.536160 (+ 546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:03.536167 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:03.536571 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:03.537105 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:03.537120 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:03.537994 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:03.537997 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:03.538966 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:03.538976 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:03.539497 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:03.539502 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:03.539687 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:03.540533 (+ 846us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:03.540559 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:03.542342 (+ 1783us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:03.544522 (+ 2180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:03.544528 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:03.544552 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:03.544838 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:03.545160 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:03.545162 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:03.545163 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:03.545322 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:03.545828 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:03.545834 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:03.546109 (+ 275us) client_negotiation.cc:769] Sending connection context
0812 17:43:03.546420 (+ 311us) client_negotiation.cc:240] Negotiation successful
0812 17:43:03.546852 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"thread_start_us":117,"threads_started":1}
I20260812 17:43:03.549639 25109 heartbeater.cc:347] Connected to a master server at 127.17.255.62:36997
I20260812 17:43:03.549904 25109 heartbeater.cc:464] Registering TS with master...
I20260812 17:43:03.550555 25109 heartbeater.cc:511] Master 127.17.255.62:36997 requested a full tablet report, sending...
I20260812 17:43:03.551680 24622 ts_manager.cc:194] Registered new tserver with Master: 5907b3d5d4c64dfd9830e61da0f37e47 (127.17.255.2:45161)
I20260812 17:43:03.552287 24622 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.2@KRBTEST.COM'} at 127.17.255.2:54535
WARNING: no policy specified for kudu/127.17.255.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab.
Entry for principal kudu/127.17.255.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab.
I20260812 17:43:03.574991 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.3:0
--local_ip_for_outbound_sockets=127.17.255.3
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:36997
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:41935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:43:03.701392 25118 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:03.701742 25118 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:03.701797 25118 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:03.705977 25118 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:03.706049 25118 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:03.706110 25118 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.3
I20260812 17:43:03.712124 25118 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:41935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:36997
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25118
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.3
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:03.713351 25118 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:03.714534 25118 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:03.724761 25127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:03.724761 25131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:03.724784 25128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:03.725215 25118 server_base.cc:1034] running on GCE node
I20260812 17:43:03.725680 25118 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:03.726452 25118 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:03.727691 25118 hybrid_clock.cc:648] HybridClock initialized: now 1786556583727651 us; error 47 us; skew 500 ppm
Aug 12 17:43:03 dist-test-slave-tk9z krb5kdc[24553](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556583, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:03.730791 25118 init.cc:377] Logged in from keytab as kudu/127.17.255.3@KRBTEST.COM (short username kudu)
I20260812 17:43:03.731823 25118 webserver.cc:460] Webserver started at http://127.17.255.3:41301/ using document root <none> and password file <none>
I20260812 17:43:03.732471 25118 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:03.732538 25118 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:03.732770 25118 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:03.735193 25118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-2/data/instance:
uuid: "f7bb64a63150478695a0b00fd1ba7471"
format_stamp: "Formatted at 2026-08-12 17:43:03 on dist-test-slave-tk9z"
server_key: "1a18ca5b201bc9ad539e564a8cb5ac92"
server_key_iv: "89ae7014b8d250b63d2084b11f3600c7"
server_key_version: "encryptionkey@0"
I20260812 17:43:03.735823 25118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance:
uuid: "f7bb64a63150478695a0b00fd1ba7471"
format_stamp: "Formatted at 2026-08-12 17:43:03 on dist-test-slave-tk9z"
server_key: "1a18ca5b201bc9ad539e564a8cb5ac92"
server_key_iv: "89ae7014b8d250b63d2084b11f3600c7"
server_key_version: "encryptionkey@0"
I20260812 17:43:03.740017 25118 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 17:43:03.742832 25146 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:03.744233 25118 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 17:43:03.744354 25118 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-2/wal
uuid: "f7bb64a63150478695a0b00fd1ba7471"
format_stamp: "Formatted at 2026-08-12 17:43:03 on dist-test-slave-tk9z"
server_key: "1a18ca5b201bc9ad539e564a8cb5ac92"
server_key_iv: "89ae7014b8d250b63d2084b11f3600c7"
server_key_version: "encryptionkey@0"
I20260812 17:43:03.744455 25118 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:03.761385 25118 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:03.765933 25118 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:03.766165 25118 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:03.766968 25118 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:43:03.768054 25118 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:43:03.768110 25118 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:03.768157 25118 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:43:03.768172 25118 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:03.778607 25118 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.3:34685
I20260812 17:43:03.778651 25309 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.3:34685 every 8 connection(s)
I20260812 17:43:03.779744 25118 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
I20260812 17:43:03.783506 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 25118
I20260812 17:43:03.783661 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance
I20260812 17:43:03.784001 18428 external_mini_cluster.cc:1428] Setting key 3032e0710a31e38779b47c60a69f86b8
Aug 12 17:43:03 dist-test-slave-tk9z krb5kdc[24553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556583, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:43:03.796594 24690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:03.781984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:59899 (local address 127.17.255.62:36997)
0812 17:43:03.782164 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:03.782168 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:03.783369 (+ 1201us) server_negotiation.cc:407] Connection header received
0812 17:43:03.784613 (+ 1244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:03.784616 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:03.784675 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:03.784765 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:03.786160 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:03.786761 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:03.787919 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:03.788143 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:03.788257 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:03.791110 (+ 2853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:03.791113 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:03.791115 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:03.791142 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:03.793220 (+ 2078us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:03.794052 (+ 832us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:03.794056 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:03.794058 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:03.794178 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:03.794629 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:03.794633 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:03.794634 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:03.795151 (+ 517us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:03.795285 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:03.796136 (+ 851us) server_negotiation.cc:299] Negotiation successful
0812 17:43:03.796328 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 17:43:03.797818 25313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:03.782285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:36997 (local address 127.17.255.3:59899)
0812 17:43:03.783116 (+ 831us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:03.783162 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:03.784383 (+ 1221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:03.784972 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:03.784979 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:03.785492 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:03.786015 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:03.786029 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:03.786903 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:03.786906 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:03.787790 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:03.787800 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:03.788309 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:03.788314 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:03.788491 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:03.789099 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:03.789118 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:03.790906 (+ 1788us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:03.793439 (+ 2533us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:03.793447 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:03.793467 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:03.793926 (+ 459us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:03.794269 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:03.794273 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:03.794275 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:03.794524 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:03.795298 (+ 774us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:03.795309 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:03.795775 (+ 466us) client_negotiation.cc:769] Sending connection context
0812 17:43:03.796041 (+ 266us) client_negotiation.cc:240] Negotiation successful
0812 17:43:03.796605 (+ 564us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":625,"thread_start_us":132,"threads_started":1}
I20260812 17:43:03.799165 25310 heartbeater.cc:347] Connected to a master server at 127.17.255.62:36997
I20260812 17:43:03.799472 25310 heartbeater.cc:464] Registering TS with master...
I20260812 17:43:03.800041 25310 heartbeater.cc:511] Master 127.17.255.62:36997 requested a full tablet report, sending...
I20260812 17:43:03.801213 24620 ts_manager.cc:194] Registered new tserver with Master: f7bb64a63150478695a0b00fd1ba7471 (127.17.255.3:34685)
I20260812 17:43:03.801966 24620 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.3@KRBTEST.COM'} at 127.17.255.3:59899
I20260812 17:43:03.811291 18428 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 17:43:03 dist-test-slave-tk9z krb5kdc[24553](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556583, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 17:43:03 dist-test-slave-tk9z krb5kdc[24553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556583, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.255.1@KRBTEST.COM
I20260812 17:43:03.842155 25322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:03.829954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36192 (local address 127.17.255.1:40209)
0812 17:43:03.830477 (+ 523us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:03.830485 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:03.830515 (+ 30us) server_negotiation.cc:407] Connection header received
0812 17:43:03.830575 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:03.830581 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:03.830800 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:03.830940 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:03.831807 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:03.832735 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:03.833805 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:03.834230 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:03.834339 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:03.837297 (+ 2958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:03.837309 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:03.837326 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:03.837354 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:03.839507 (+ 2153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:03.840077 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:03.840084 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:03.840086 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:03.840188 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:03.840615 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:03.840619 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:03.840621 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:03.840959 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:03.841273 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:03.841749 (+ 476us) server_negotiation.cc:299] Negotiation successful
0812 17:43:03.841992 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":132,"threads_started":1}
Aug 12 17:43:03 dist-test-slave-tk9z krb5kdc[24553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556583, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:43:03.859301 24690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:03.846616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55880 (local address 127.17.255.62:36997)
0812 17:43:03.846761 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:03.846765 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:03.846779 (+ 14us) server_negotiation.cc:407] Connection header received
0812 17:43:03.846860 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:03.846862 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:03.846904 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:03.846977 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:03.848018 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:03.848570 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:03.849927 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:03.850297 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:03.850562 (+ 265us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:03.853697 (+ 3135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:03.853701 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:03.853704 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:03.853742 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:03.855976 (+ 2234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:03.856876 (+ 900us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:03.856881 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:03.856882 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:03.856993 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:03.857633 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:03.857637 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:03.857638 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:03.857944 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:03.858080 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:03.858824 (+ 744us) server_negotiation.cc:299] Negotiation successful
0812 17:43:03.858978 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
W20260812 17:43:03.860021 24620 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55880
I20260812 17:43:03.860921 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 24723
I20260812 17:43:03.888796 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 24913
I20260812 17:43:03.899787 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 25118
I20260812 17:43:03.921535 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 24574
2026-08-12T17:43:03Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2670 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:43:03 dist-test-slave-tk9z krb5kdc[25331](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:43:03 dist-test-slave-tk9z krb5kdc[25331](info): set up 2 sockets
Aug 12 17:43:03 dist-test-slave-tk9z krb5kdc[25331](info): commencing operation
krb5kdc: starting...
W20260812 17:43:05.245642 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.292s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:43:05 dist-test-slave-tk9z krb5kdc[25331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556585, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:43:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:43:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.255.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
I20260812 17:43:05.399876 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:35037
--webserver_interface=127.17.255.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:43437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:35037
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:43:05.521577 25352 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:05.521903 25352 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:05.521986 25352 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:05.526119 25352 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:43:05.526221 25352 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:05.526259 25352 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:05.526297 25352 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:43:05.526332 25352 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:43:05.531827 25352 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:43437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:35037
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:35037
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25352
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:05.532986 25352 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:05.534080 25352 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:05.542980 25358 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:05.543187 25352 server_base.cc:1034] running on GCE node
W20260812 17:43:05.542981 25362 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:05.543022 25360 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:05.543953 25352 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:05.545197 25352 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:05.546414 25352 hybrid_clock.cc:648] HybridClock initialized: now 1786556585546343 us; error 46 us; skew 500 ppm
Aug 12 17:43:05 dist-test-slave-tk9z krb5kdc[25331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556585, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:05.554244 25352 init.cc:377] Logged in from keytab as kudu/127.17.255.62@KRBTEST.COM (short username kudu)
I20260812 17:43:05.555181 25352 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:05.555263 25352 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:05.555455 25352 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:05.557727 25352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "34a0aa66a1774b6c95a23978cc687599"
format_stamp: "Formatted at 2026-08-12 17:43:05 on dist-test-slave-tk9z"
server_key: "260cde84bdb2735496f1182e10aaf156"
server_key_iv: "1898a12e6a00ed8bd87ce4f0baf7ba77"
server_key_version: "encryptionkey@0"
I20260812 17:43:05.558336 25352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "34a0aa66a1774b6c95a23978cc687599"
format_stamp: "Formatted at 2026-08-12 17:43:05 on dist-test-slave-tk9z"
server_key: "260cde84bdb2735496f1182e10aaf156"
server_key_iv: "1898a12e6a00ed8bd87ce4f0baf7ba77"
server_key_version: "encryptionkey@0"
I20260812 17:43:05.562554 25352 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 17:43:05.565158 25372 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:05.566550 25352 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:43:05.566682 25352 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "34a0aa66a1774b6c95a23978cc687599"
format_stamp: "Formatted at 2026-08-12 17:43:05 on dist-test-slave-tk9z"
server_key: "260cde84bdb2735496f1182e10aaf156"
server_key_iv: "1898a12e6a00ed8bd87ce4f0baf7ba77"
server_key_version: "encryptionkey@0"
I20260812 17:43:05.566799 25352 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:05.588771 25352 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:05.592752 25352 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:05.592994 25352 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:05.601588 25352 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:35037
I20260812 17:43:05.601888 25450 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:35037 every 8 connection(s)
I20260812 17:43:05.602452 25352 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:43:05.605474 25451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:05.608624 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 25352
I20260812 17:43:05.608790 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:43:05.609097 18428 external_mini_cluster.cc:1428] Setting key 0c26f4ae9798597ebcdb32043a80db7c
I20260812 17:43:05.613011 25451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34a0aa66a1774b6c95a23978cc687599: Bootstrap starting.
I20260812 17:43:05.616611 25451 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 34a0aa66a1774b6c95a23978cc687599: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:05.617676 25451 log.cc:824] T 00000000000000000000000000000000 P 34a0aa66a1774b6c95a23978cc687599: Log is configured to *not* fsync() on all Append() calls
I20260812 17:43:05.620838 25451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34a0aa66a1774b6c95a23978cc687599: No bootstrap required, opened a new log
Aug 12 17:43:05 dist-test-slave-tk9z krb5kdc[25331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556585, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:43:05.625694 25451 raft_consensus.cc:348] T 00000000000000000000000000000000 P 34a0aa66a1774b6c95a23978cc687599 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34a0aa66a1774b6c95a23978cc687599" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 35037 } }
I20260812 17:43:05.626003 25451 raft_consensus.cc:374] T 00000000000000000000000000000000 P 34a0aa66a1774b6c95a23978cc687599 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:05.626060 25451 raft_consensus.cc:729] T 00000000000000000000000000000000 P 34a0aa66a1774b6c95a23978cc687599 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a0aa66a1774b6c95a23978cc687599, State: Initialized, Role: FOLLOWER
I20260812 17:43:05.626669 25451 consensus_queue.cc:260] T 00000000000000000000000000000000 P 34a0aa66a1774b6c95a23978cc687599 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34a0aa66a1774b6c95a23978cc687599" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 35037 } }
I20260812 17:43:05.626863 25451 raft_consensus.cc:388] T 00000000000000000000000000000000 P 34a0aa66a1774b6c95a23978cc687599 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:43:05.626940 25451 raft_consensus.cc:482] T 00000000000000000000000000000000 P 34a0aa66a1774b6c95a23978cc687599 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:43:05.627044 25451 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 34a0aa66a1774b6c95a23978cc687599 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:05.628501 25451 raft_consensus.cc:504] T 00000000000000000000000000000000 P 34a0aa66a1774b6c95a23978cc687599 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34a0aa66a1774b6c95a23978cc687599" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 35037 } }
I20260812 17:43:05.628911 25451 leader_election.cc:302] T 00000000000000000000000000000000 P 34a0aa66a1774b6c95a23978cc687599 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 34a0aa66a1774b6c95a23978cc687599; no voters:
I20260812 17:43:05.629282 25451 leader_election.cc:288] T 00000000000000000000000000000000 P 34a0aa66a1774b6c95a23978cc687599 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:43:05.629383 25457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:05.611205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33596 (local address 127.17.255.62:35037)
0812 17:43:05.611768 (+ 563us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:05.611796 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:05.611841 (+ 45us) server_negotiation.cc:407] Connection header received
0812 17:43:05.612677 (+ 836us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:05.612711 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:05.613237 (+ 526us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:05.613614 (+ 377us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:05.615007 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:05.616473 (+ 1466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:05.617918 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:05.618662 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:05.619087 (+ 425us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:05.622287 (+ 3200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:05.622294 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:05.622314 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:05.622351 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:05.625433 (+ 3082us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:05.626002 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:05.626009 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:05.626019 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:05.626180 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:05.626653 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:05.626656 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:05.626658 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:05.627292 (+ 634us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:05.627509 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:05.627874 (+ 365us) server_negotiation.cc:299] Negotiation successful
0812 17:43:05.628272 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":169,"threads_started":1}
I20260812 17:43:05.629456 25459 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 34a0aa66a1774b6c95a23978cc687599 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:43:05.629841 25459 raft_consensus.cc:686] T 00000000000000000000000000000000 P 34a0aa66a1774b6c95a23978cc687599 [term 1 LEADER]: Becoming Leader. State: Replica: 34a0aa66a1774b6c95a23978cc687599, State: Running, Role: LEADER
I20260812 17:43:05.630240 25459 consensus_queue.cc:237] T 00000000000000000000000000000000 P 34a0aa66a1774b6c95a23978cc687599 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34a0aa66a1774b6c95a23978cc687599" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 35037 } }
I20260812 17:43:05.630786 25451 sys_catalog.cc:564] T 00000000000000000000000000000000 P 34a0aa66a1774b6c95a23978cc687599 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:43:05.632261 25461 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34a0aa66a1774b6c95a23978cc687599 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 34a0aa66a1774b6c95a23978cc687599. Latest consensus state: current_term: 1 leader_uuid: "34a0aa66a1774b6c95a23978cc687599" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34a0aa66a1774b6c95a23978cc687599" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 35037 } } }
I20260812 17:43:05.632403 25461 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34a0aa66a1774b6c95a23978cc687599 [sys.catalog]: This master's current role is: LEADER
I20260812 17:43:05.632367 25460 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34a0aa66a1774b6c95a23978cc687599 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "34a0aa66a1774b6c95a23978cc687599" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34a0aa66a1774b6c95a23978cc687599" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 35037 } } }
I20260812 17:43:05.632500 25460 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34a0aa66a1774b6c95a23978cc687599 [sys.catalog]: This master's current role is: LEADER
I20260812 17:43:05.632920 25475 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:43:05.636314 25475 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:43:05.643155 25475 catalog_manager.cc:1347] Generated new cluster ID: 330e0d9c83fa4546896909559dc129cf
I20260812 17:43:05.643253 25475 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:43:05.693156 25475 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:43:05.694670 25475 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:43:05.701819 25475 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 34a0aa66a1774b6c95a23978cc687599: Generated new TSK 0
I20260812 17:43:05.702759 25475 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.255.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab.
Entry for principal kudu/127.17.255.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab.
I20260812 17:43:05.741671 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.1:0
--local_ip_for_outbound_sockets=127.17.255.1
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:35037
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:43437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:43:05.868054 25490 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:05.868341 25490 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:05.868388 25490 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:05.872898 25490 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:05.872975 25490 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:05.873064 25490 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.1
I20260812 17:43:05.878681 25490 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:43437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:35037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25490
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.1
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:05.879864 25490 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:05.880961 25490 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 17:43:05.890858 25490 server_base.cc:1034] running on GCE node
W20260812 17:43:05.890763 25500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:05.890763 25508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:05.890763 25503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:05.891703 25490 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:05.892422 25490 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:05.893662 25490 hybrid_clock.cc:648] HybridClock initialized: now 1786556585893646 us; error 34 us; skew 500 ppm
Aug 12 17:43:05 dist-test-slave-tk9z krb5kdc[25331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556585, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:05.897087 25490 init.cc:377] Logged in from keytab as kudu/127.17.255.1@KRBTEST.COM (short username kudu)
I20260812 17:43:05.898016 25490 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:05.898128 25490 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:05.898473 25490 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:05.900930 25490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-0/data/instance:
uuid: "88722ff924974acca8b256c084641767"
format_stamp: "Formatted at 2026-08-12 17:43:05 on dist-test-slave-tk9z"
server_key: "fd5a1d1850248e0cf4fdead3e3f94400"
server_key_iv: "17b01e26720f3d40dad29dee13c2b4c2"
server_key_version: "encryptionkey@0"
I20260812 17:43:05.901593 25490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance:
uuid: "88722ff924974acca8b256c084641767"
format_stamp: "Formatted at 2026-08-12 17:43:05 on dist-test-slave-tk9z"
server_key: "fd5a1d1850248e0cf4fdead3e3f94400"
server_key_iv: "17b01e26720f3d40dad29dee13c2b4c2"
server_key_version: "encryptionkey@0"
I20260812 17:43:05.905908 25490 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.004s
I20260812 17:43:05.908833 25516 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:05.910321 25490 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260812 17:43:05.910518 25490 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-0/wal
uuid: "88722ff924974acca8b256c084641767"
format_stamp: "Formatted at 2026-08-12 17:43:05 on dist-test-slave-tk9z"
server_key: "fd5a1d1850248e0cf4fdead3e3f94400"
server_key_iv: "17b01e26720f3d40dad29dee13c2b4c2"
server_key_version: "encryptionkey@0"
I20260812 17:43:05.910657 25490 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:05.921617 25490 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:05.925201 25490 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:05.925443 25490 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:05.926138 25490 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:43:05.927155 25490 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:43:05.927237 25490 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:05.927320 25490 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:43:05.927377 25490 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:05.937999 25490 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.1:33067
I20260812 17:43:05.938019 25685 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.1:33067 every 8 connection(s)
I20260812 17:43:05.938781 25490 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
I20260812 17:43:05.940338 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 25490
I20260812 17:43:05.940439 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance
I20260812 17:43:05.940797 18428 external_mini_cluster.cc:1428] Setting key d77037327a0ea426ded7c0f9c9d36e2a
Aug 12 17:43:05 dist-test-slave-tk9z krb5kdc[25331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556585, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.255.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.2@KRBTEST.COM" created.
I20260812 17:43:05.956830 25457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:05.940736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:36701 (local address 127.17.255.62:35037)
0812 17:43:05.940912 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:05.940918 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:05.942000 (+ 1082us) server_negotiation.cc:407] Connection header received
0812 17:43:05.944200 (+ 2200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:05.944203 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:05.944260 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:05.944348 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:05.945848 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:05.946698 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:05.948709 (+ 2011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:05.948976 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:05.949082 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:05.952481 (+ 3399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:05.952485 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:05.952487 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:05.952535 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:05.954232 (+ 1697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:05.954924 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:05.954926 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:05.954928 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:05.955012 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:05.955505 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:05.955508 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:05.955509 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:05.955738 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:05.955866 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:05.956505 (+ 639us) server_negotiation.cc:299] Negotiation successful
0812 17:43:05.956654 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 17:43:05.957785 25688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:05.941262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35037 (local address 127.17.255.1:36701)
0812 17:43:05.941834 (+ 572us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:05.941881 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:05.943902 (+ 2021us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:05.944616 (+ 714us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:05.944632 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:05.945095 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:05.945655 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:05.945671 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:05.946845 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:05.946851 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:05.948534 (+ 1683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:05.948552 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:05.949180 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:05.949188 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:05.949458 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:05.950294 (+ 836us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:05.950318 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:05.952243 (+ 1925us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:05.954433 (+ 2190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:05.954440 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:05.954468 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:05.954766 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:05.955159 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:05.955162 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:05.955165 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:05.955343 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:05.955862 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:05.955870 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:05.956229 (+ 359us) client_negotiation.cc:769] Sending connection context
0812 17:43:05.956445 (+ 216us) client_negotiation.cc:240] Negotiation successful
0812 17:43:05.956845 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":166,"threads_started":1}
I20260812 17:43:05.959340 25686 heartbeater.cc:347] Connected to a master server at 127.17.255.62:35037
I20260812 17:43:05.959671 25686 heartbeater.cc:464] Registering TS with master...
I20260812 17:43:05.960323 25686 heartbeater.cc:511] Master 127.17.255.62:35037 requested a full tablet report, sending...
I20260812 17:43:05.962455 25396 ts_manager.cc:194] Registered new tserver with Master: 88722ff924974acca8b256c084641767 (127.17.255.1:33067)
I20260812 17:43:05.964352 25396 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.1@KRBTEST.COM'} at 127.17.255.1:36701
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab.
Entry for principal kudu/127.17.255.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab.
I20260812 17:43:05.978005 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.2:0
--local_ip_for_outbound_sockets=127.17.255.2
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:35037
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:43437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:43:06.110105 25692 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:06.110556 25692 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:06.110615 25692 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:06.115366 25692 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:06.115440 25692 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:06.115514 25692 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.2
I20260812 17:43:06.122352 25692 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:43437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:35037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25692
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.2
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:06.123876 25692 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:06.125170 25692 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:06.137669 25704 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:06.137669 25702 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:06.137692 25701 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:06.137787 25692 server_base.cc:1034] running on GCE node
I20260812 17:43:06.138556 25692 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:06.139353 25692 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:06.140597 25692 hybrid_clock.cc:648] HybridClock initialized: now 1786556586140561 us; error 51 us; skew 500 ppm
Aug 12 17:43:06 dist-test-slave-tk9z krb5kdc[25331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556586, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:06.143819 25692 init.cc:377] Logged in from keytab as kudu/127.17.255.2@KRBTEST.COM (short username kudu)
I20260812 17:43:06.144660 25692 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:06.144767 25692 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:06.145032 25692 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:06.147517 25692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-1/data/instance:
uuid: "4f26667b32664263b001534ec5937c19"
format_stamp: "Formatted at 2026-08-12 17:43:06 on dist-test-slave-tk9z"
server_key: "032203c99fec4b79df879ac646177c9b"
server_key_iv: "99a6fd9b67cb75e83e13a91ca1548ab9"
server_key_version: "encryptionkey@0"
I20260812 17:43:06.148200 25692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance:
uuid: "4f26667b32664263b001534ec5937c19"
format_stamp: "Formatted at 2026-08-12 17:43:06 on dist-test-slave-tk9z"
server_key: "032203c99fec4b79df879ac646177c9b"
server_key_iv: "99a6fd9b67cb75e83e13a91ca1548ab9"
server_key_version: "encryptionkey@0"
I20260812 17:43:06.152839 25692 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 17:43:06.156342 25713 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:06.157950 25692 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 17:43:06.158166 25692 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-1/wal
uuid: "4f26667b32664263b001534ec5937c19"
format_stamp: "Formatted at 2026-08-12 17:43:06 on dist-test-slave-tk9z"
server_key: "032203c99fec4b79df879ac646177c9b"
server_key_iv: "99a6fd9b67cb75e83e13a91ca1548ab9"
server_key_version: "encryptionkey@0"
I20260812 17:43:06.158332 25692 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:06.184746 25692 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:06.188874 25692 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:06.189062 25692 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:06.189683 25692 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:43:06.190842 25692 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:43:06.190909 25692 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:06.190958 25692 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:43:06.190976 25692 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:06.201881 25692 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.2:45405
I20260812 17:43:06.201979 25883 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.2:45405 every 8 connection(s)
I20260812 17:43:06.202706 25692 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
I20260812 17:43:06.207288 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 25692
I20260812 17:43:06.207440 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance
I20260812 17:43:06.207752 18428 external_mini_cluster.cc:1428] Setting key 290829e3b5c66153f5adb0ec6c3d56b1
Aug 12 17:43:06 dist-test-slave-tk9z krb5kdc[25331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556586, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.255.3@KRBTEST.COM; defaulting to no policy
I20260812 17:43:06.221513 25457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:06.205008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:58459 (local address 127.17.255.62:35037)
0812 17:43:06.205207 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:06.205213 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:06.206232 (+ 1019us) server_negotiation.cc:407] Connection header received
0812 17:43:06.208099 (+ 1867us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:06.208102 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:06.208206 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:06.208316 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:06.210082 (+ 1766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:06.210805 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:06.212468 (+ 1663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:06.212892 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:06.213086 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:06.216985 (+ 3899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:06.216989 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:06.216991 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:06.217022 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:06.218982 (+ 1960us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:06.219639 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:06.219645 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:06.219647 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:06.219743 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:06.220165 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:06.220171 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:06.220176 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:06.220400 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:06.220534 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:06.221163 (+ 629us) server_negotiation.cc:299] Negotiation successful
0812 17:43:06.221320 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260812 17:43:06.222607 25887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:06.205470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35037 (local address 127.17.255.2:58459)
0812 17:43:06.206058 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:06.206107 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:06.207750 (+ 1643us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:06.208606 (+ 856us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:06.208616 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:06.209083 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:06.209884 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:06.209910 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:06.210966 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:06.210973 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:06.212208 (+ 1235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:06.212221 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:06.213148 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:06.213152 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:06.213397 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:06.214186 (+ 789us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:06.214216 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:06.216730 (+ 2514us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:06.219149 (+ 2419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:06.219157 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:06.219180 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:06.219509 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:06.219854 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:06.219857 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:06.219859 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:06.220051 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:06.220536 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:06.220547 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:06.220865 (+ 318us) client_negotiation.cc:769] Sending connection context
0812 17:43:06.221097 (+ 232us) client_negotiation.cc:240] Negotiation successful
0812 17:43:06.221564 (+ 467us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":139,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.3@KRBTEST.COM" created.
I20260812 17:43:06.224155 25885 heartbeater.cc:347] Connected to a master server at 127.17.255.62:35037
I20260812 17:43:06.224502 25885 heartbeater.cc:464] Registering TS with master...
I20260812 17:43:06.225236 25885 heartbeater.cc:511] Master 127.17.255.62:35037 requested a full tablet report, sending...
I20260812 17:43:06.226890 25396 ts_manager.cc:194] Registered new tserver with Master: 4f26667b32664263b001534ec5937c19 (127.17.255.2:45405)
I20260812 17:43:06.227890 25396 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.2@KRBTEST.COM'} at 127.17.255.2:58459
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab.
Entry for principal kudu/127.17.255.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab.
I20260812 17:43:06.247025 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.3:0
--local_ip_for_outbound_sockets=127.17.255.3
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:35037
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:43437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:43:06.375710 25890 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:06.376030 25890 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:06.376080 25890 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:06.380482 25890 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:06.380564 25890 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:06.380632 25890 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.3
I20260812 17:43:06.386560 25890 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:43437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:35037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25890
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.3
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:06.387841 25890 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:06.389001 25890 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 17:43:06.399806 25890 server_base.cc:1034] running on GCE node
W20260812 17:43:06.399746 25902 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:06.399746 25899 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:06.399746 25900 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:06.400611 25890 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:06.401422 25890 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:06.402601 25890 hybrid_clock.cc:648] HybridClock initialized: now 1786556586402580 us; error 35 us; skew 500 ppm
Aug 12 17:43:06 dist-test-slave-tk9z krb5kdc[25331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556586, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:06.405989 25890 init.cc:377] Logged in from keytab as kudu/127.17.255.3@KRBTEST.COM (short username kudu)
I20260812 17:43:06.407020 25890 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:06.407096 25890 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:06.407476 25890 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:06.410157 25890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-2/data/instance:
uuid: "4881f366ae6a4d439fddf34117e523d0"
format_stamp: "Formatted at 2026-08-12 17:43:06 on dist-test-slave-tk9z"
server_key: "ecf4b00504adfff8d5846ef87eda8121"
server_key_iv: "c7339522f429b71ea822c0a625f0e60c"
server_key_version: "encryptionkey@0"
I20260812 17:43:06.410962 25890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance:
uuid: "4881f366ae6a4d439fddf34117e523d0"
format_stamp: "Formatted at 2026-08-12 17:43:06 on dist-test-slave-tk9z"
server_key: "ecf4b00504adfff8d5846ef87eda8121"
server_key_iv: "c7339522f429b71ea822c0a625f0e60c"
server_key_version: "encryptionkey@0"
I20260812 17:43:06.415498 25890 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 17:43:06.418344 25913 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:06.420059 25890 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 17:43:06.420184 25890 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-2/wal
uuid: "4881f366ae6a4d439fddf34117e523d0"
format_stamp: "Formatted at 2026-08-12 17:43:06 on dist-test-slave-tk9z"
server_key: "ecf4b00504adfff8d5846ef87eda8121"
server_key_iv: "c7339522f429b71ea822c0a625f0e60c"
server_key_version: "encryptionkey@0"
I20260812 17:43:06.420296 25890 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:06.462069 25890 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:06.465997 25890 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:06.466171 25890 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:06.466821 25890 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:43:06.467720 25890 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:43:06.467767 25890 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:06.467808 25890 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:43:06.467823 25890 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:06.477399 25890 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.3:44183
I20260812 17:43:06.477424 26086 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.3:44183 every 8 connection(s)
I20260812 17:43:06.478075 25890 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
I20260812 17:43:06.487416 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 25890
I20260812 17:43:06.487599 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance
I20260812 17:43:06.487934 18428 external_mini_cluster.cc:1428] Setting key c6de9a2f2e87d5d2ffae44d254f0ab0b
Aug 12 17:43:06 dist-test-slave-tk9z krb5kdc[25331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556586, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:43:06.493549 25457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:06.480083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:49463 (local address 127.17.255.62:35037)
0812 17:43:06.480238 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:06.480242 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:06.481237 (+ 995us) server_negotiation.cc:407] Connection header received
0812 17:43:06.482707 (+ 1470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:06.482710 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:06.482773 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:06.482888 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:06.484173 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:06.484712 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:06.485919 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:06.486142 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:06.486254 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:06.489345 (+ 3091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:06.489348 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:06.489350 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:06.489378 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:06.491264 (+ 1886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:06.491847 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:06.491850 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:06.491851 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:06.491935 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:06.492285 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:06.492287 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:06.492288 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:06.492504 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:06.492596 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:06.493298 (+ 702us) server_negotiation.cc:299] Negotiation successful
0812 17:43:06.493411 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 17:43:06.494536 26090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:06.480504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35037 (local address 127.17.255.3:49463)
0812 17:43:06.481065 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:06.481113 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:06.482480 (+ 1367us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:06.483084 (+ 604us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:06.483092 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:06.483494 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:06.484017 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:06.484032 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:06.484857 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:06.484860 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:06.485759 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:06.485769 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:06.486316 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:06.486320 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:06.486555 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:06.487212 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:06.487230 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:06.489056 (+ 1826us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:06.491417 (+ 2361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:06.491423 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:06.491438 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:06.491735 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:06.492034 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:06.492036 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:06.492038 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:06.492196 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:06.492686 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:06.492692 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:06.492975 (+ 283us) client_negotiation.cc:769] Sending connection context
0812 17:43:06.493157 (+ 182us) client_negotiation.cc:240] Negotiation successful
0812 17:43:06.493472 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":116,"threads_started":1}
I20260812 17:43:06.495884 26087 heartbeater.cc:347] Connected to a master server at 127.17.255.62:35037
I20260812 17:43:06.496191 26087 heartbeater.cc:464] Registering TS with master...
I20260812 17:43:06.496747 26087 heartbeater.cc:511] Master 127.17.255.62:35037 requested a full tablet report, sending...
I20260812 17:43:06.497918 25396 ts_manager.cc:194] Registered new tserver with Master: 4881f366ae6a4d439fddf34117e523d0 (127.17.255.3:44183)
I20260812 17:43:06.498602 25396 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.3@KRBTEST.COM'} at 127.17.255.3:49463
I20260812 17:43:06.502942 18428 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 17:43:06.512902 25457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:06.504934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33612 (local address 127.17.255.62:35037)
0812 17:43:06.505103 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:06.505108 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:06.505291 (+ 183us) server_negotiation.cc:407] Connection header received
0812 17:43:06.505451 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:06.505454 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:06.505500 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:06.505596 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:06.506334 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:06.506922 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:06.507764 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:06.508002 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:06.508113 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:06.509495 (+ 1382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:06.509501 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:06.509508 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:06.509533 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:06.511137 (+ 1604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:06.511595 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:06.511598 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:06.511600 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:06.511686 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:06.511976 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:06.511980 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:06.511982 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:06.512212 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:06.512355 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:06.512611 (+ 256us) server_negotiation.cc:299] Negotiation successful
0812 17:43:06.512729 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 17:43:06.516258 25396 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33612:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 17:43:06.519341 25396 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 17:43:06.534657 26103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:06.528702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:45405 (local address 127.0.0.1:44692)
0812 17:43:06.529744 (+ 1042us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:06.529757 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:06.529849 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:06.530426 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:06.530428 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:06.530439 (+ 11us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:43:06.530610 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:06.530619 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:06.531876 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:06.531879 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:06.533059 (+ 1180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:06.533069 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:06.534041 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:06.534045 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:06.534164 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:06.534205 (+ 41us) client_negotiation.cc:769] Sending connection context
0812 17:43:06.534343 (+ 138us) client_negotiation.cc:240] Negotiation successful
0812 17:43:06.534493 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":978,"mutex_wait_us":22,"thread_start_us":87,"threads_started":1}
I20260812 17:43:06.534662 26109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:06.528877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44692 (local address 127.17.255.2:45405)
0812 17:43:06.529441 (+ 564us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:06.529455 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:06.529853 (+ 398us) server_negotiation.cc:407] Connection header received
0812 17:43:06.529950 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:06.529955 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:06.530105 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:06.530269 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:43:06.530754 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:06.531668 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:06.533181 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:06.533914 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:06.534039 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:06.534201 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:06.534407 (+ 206us) server_negotiation.cc:299] Negotiation successful
0812 17:43:06.534505 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":447,"thread_start_us":105,"threads_started":1}
I20260812 17:43:06.534999 26107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:06.528268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.3:44183 (local address 127.0.0.1:34032)
0812 17:43:06.529376 (+ 1108us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:06.529429 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:06.529557 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:06.530313 (+ 756us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:06.530315 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:06.530328 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:43:06.530659 (+ 331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:06.530668 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:06.532182 (+ 1514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:06.532185 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:06.533484 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:06.533496 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:06.534612 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:06.534615 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:06.534702 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:06.534725 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 17:43:06.534778 (+ 53us) client_negotiation.cc:240] Negotiation successful
0812 17:43:06.534844 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":927,"mutex_wait_us":169,"thread_start_us":105,"threads_started":1}
I20260812 17:43:06.535145 26108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:06.528535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:33067 (local address 127.0.0.1:51062)
0812 17:43:06.529585 (+ 1050us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:06.529599 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:06.529692 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:06.530279 (+ 587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:06.530289 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:06.530316 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:43:06.530660 (+ 344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:06.530668 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:06.532114 (+ 1446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:06.532120 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:06.533484 (+ 1364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:06.533496 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:06.534786 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:06.534789 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:06.534864 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:06.534884 (+ 20us) client_negotiation.cc:769] Sending connection context
0812 17:43:06.534954 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 17:43:06.535028 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":987,"mutex_wait_us":191,"thread_start_us":101,"threads_started":1}
I20260812 17:43:06.535583 26106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:06.528440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34032 (local address 127.17.255.3:44183)
0812 17:43:06.529865 (+ 1425us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:06.529880 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:06.529907 (+ 27us) server_negotiation.cc:407] Connection header received
0812 17:43:06.529988 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:06.529992 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:06.530139 (+ 147us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:06.530507 (+ 368us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:43:06.530804 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:06.532051 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:06.533632 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:06.534474 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:06.535103 (+ 629us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:06.535257 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:06.535309 (+ 52us) server_negotiation.cc:299] Negotiation successful
0812 17:43:06.535393 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1306,"thread_start_us":180,"threads_started":1}
I20260812 17:43:06.536075 26110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:06.529304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51062 (local address 127.17.255.1:33067)
0812 17:43:06.529729 (+ 425us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:06.529738 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:06.529766 (+ 28us) server_negotiation.cc:407] Connection header received
0812 17:43:06.529877 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:06.529885 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:06.530096 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:06.530269 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:43:06.530804 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:06.531976 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:06.533627 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:06.534467 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:06.534586 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:06.534725 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:06.535846 (+ 1121us) server_negotiation.cc:299] Negotiation successful
0812 17:43:06.535942 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":124,"threads_started":1}
I20260812 17:43:06.538540 25585 tablet_service.cc:1467] Processing CreateTablet for tablet 89a866f96089498ba36f0bcb41667e72 (DEFAULT_TABLE table=test-table [id=8e1f7c0aa2ec4f69a5319f7f38b84db7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:43:06.538550 25982 tablet_service.cc:1467] Processing CreateTablet for tablet 89a866f96089498ba36f0bcb41667e72 (DEFAULT_TABLE table=test-table [id=8e1f7c0aa2ec4f69a5319f7f38b84db7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:43:06.538550 25785 tablet_service.cc:1467] Processing CreateTablet for tablet 89a866f96089498ba36f0bcb41667e72 (DEFAULT_TABLE table=test-table [id=8e1f7c0aa2ec4f69a5319f7f38b84db7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:43:06.539710 25585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89a866f96089498ba36f0bcb41667e72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:06.539712 25982 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89a866f96089498ba36f0bcb41667e72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:06.539709 25785 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89a866f96089498ba36f0bcb41667e72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:06.546156 26112 tablet_bootstrap.cc:492] T 89a866f96089498ba36f0bcb41667e72 P 88722ff924974acca8b256c084641767: Bootstrap starting.
I20260812 17:43:06.547575 26113 tablet_bootstrap.cc:492] T 89a866f96089498ba36f0bcb41667e72 P 4881f366ae6a4d439fddf34117e523d0: Bootstrap starting.
I20260812 17:43:06.547923 26114 tablet_bootstrap.cc:492] T 89a866f96089498ba36f0bcb41667e72 P 4f26667b32664263b001534ec5937c19: Bootstrap starting.
I20260812 17:43:06.548836 26112 tablet_bootstrap.cc:654] T 89a866f96089498ba36f0bcb41667e72 P 88722ff924974acca8b256c084641767: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:06.549889 26112 log.cc:824] T 89a866f96089498ba36f0bcb41667e72 P 88722ff924974acca8b256c084641767: Log is configured to *not* fsync() on all Append() calls
I20260812 17:43:06.550000 26113 tablet_bootstrap.cc:654] T 89a866f96089498ba36f0bcb41667e72 P 4881f366ae6a4d439fddf34117e523d0: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:06.550000 26114 tablet_bootstrap.cc:654] T 89a866f96089498ba36f0bcb41667e72 P 4f26667b32664263b001534ec5937c19: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:06.551517 26113 log.cc:824] T 89a866f96089498ba36f0bcb41667e72 P 4881f366ae6a4d439fddf34117e523d0: Log is configured to *not* fsync() on all Append() calls
I20260812 17:43:06.551517 26114 log.cc:824] T 89a866f96089498ba36f0bcb41667e72 P 4f26667b32664263b001534ec5937c19: Log is configured to *not* fsync() on all Append() calls
I20260812 17:43:06.552206 26112 tablet_bootstrap.cc:492] T 89a866f96089498ba36f0bcb41667e72 P 88722ff924974acca8b256c084641767: No bootstrap required, opened a new log
I20260812 17:43:06.552457 26112 ts_tablet_manager.cc:1397] T 89a866f96089498ba36f0bcb41667e72 P 88722ff924974acca8b256c084641767: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 17:43:06.553440 26113 tablet_bootstrap.cc:492] T 89a866f96089498ba36f0bcb41667e72 P 4881f366ae6a4d439fddf34117e523d0: No bootstrap required, opened a new log
I20260812 17:43:06.553579 26113 ts_tablet_manager.cc:1397] T 89a866f96089498ba36f0bcb41667e72 P 4881f366ae6a4d439fddf34117e523d0: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 17:43:06.555770 26114 tablet_bootstrap.cc:492] T 89a866f96089498ba36f0bcb41667e72 P 4f26667b32664263b001534ec5937c19: No bootstrap required, opened a new log
I20260812 17:43:06.555982 26114 ts_tablet_manager.cc:1397] T 89a866f96089498ba36f0bcb41667e72 P 4f26667b32664263b001534ec5937c19: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.004s
I20260812 17:43:06.556495 26112 raft_consensus.cc:348] T 89a866f96089498ba36f0bcb41667e72 P 88722ff924974acca8b256c084641767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4881f366ae6a4d439fddf34117e523d0" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 44183 } } peers { permanent_uuid: "88722ff924974acca8b256c084641767" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33067 } } peers { permanent_uuid: "4f26667b32664263b001534ec5937c19" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 45405 } }
I20260812 17:43:06.556905 26112 raft_consensus.cc:374] T 89a866f96089498ba36f0bcb41667e72 P 88722ff924974acca8b256c084641767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:06.556770 26113 raft_consensus.cc:348] T 89a866f96089498ba36f0bcb41667e72 P 4881f366ae6a4d439fddf34117e523d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4881f366ae6a4d439fddf34117e523d0" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 44183 } } peers { permanent_uuid: "88722ff924974acca8b256c084641767" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33067 } } peers { permanent_uuid: "4f26667b32664263b001534ec5937c19" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 45405 } }
I20260812 17:43:06.557035 26112 raft_consensus.cc:729] T 89a866f96089498ba36f0bcb41667e72 P 88722ff924974acca8b256c084641767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88722ff924974acca8b256c084641767, State: Initialized, Role: FOLLOWER
I20260812 17:43:06.557178 26113 raft_consensus.cc:374] T 89a866f96089498ba36f0bcb41667e72 P 4881f366ae6a4d439fddf34117e523d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:06.557302 26113 raft_consensus.cc:729] T 89a866f96089498ba36f0bcb41667e72 P 4881f366ae6a4d439fddf34117e523d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4881f366ae6a4d439fddf34117e523d0, State: Initialized, Role: FOLLOWER
I20260812 17:43:06.557611 26112 consensus_queue.cc:260] T 89a866f96089498ba36f0bcb41667e72 P 88722ff924974acca8b256c084641767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4881f366ae6a4d439fddf34117e523d0" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 44183 } } peers { permanent_uuid: "88722ff924974acca8b256c084641767" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33067 } } peers { permanent_uuid: "4f26667b32664263b001534ec5937c19" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 45405 } }
I20260812 17:43:06.557816 26113 consensus_queue.cc:260] T 89a866f96089498ba36f0bcb41667e72 P 4881f366ae6a4d439fddf34117e523d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4881f366ae6a4d439fddf34117e523d0" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 44183 } } peers { permanent_uuid: "88722ff924974acca8b256c084641767" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33067 } } peers { permanent_uuid: "4f26667b32664263b001534ec5937c19" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 45405 } }
I20260812 17:43:06.558461 25686 heartbeater.cc:503] Master 127.17.255.62:35037 was elected leader, sending a full tablet report...
I20260812 17:43:06.558805 26112 ts_tablet_manager.cc:1428] T 89a866f96089498ba36f0bcb41667e72 P 88722ff924974acca8b256c084641767: Time spent starting tablet: real 0.006s user 0.004s sys 0.003s
I20260812 17:43:06.558856 26113 ts_tablet_manager.cc:1428] T 89a866f96089498ba36f0bcb41667e72 P 4881f366ae6a4d439fddf34117e523d0: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260812 17:43:06.559180 26087 heartbeater.cc:503] Master 127.17.255.62:35037 was elected leader, sending a full tablet report...
I20260812 17:43:06.559808 26114 raft_consensus.cc:348] T 89a866f96089498ba36f0bcb41667e72 P 4f26667b32664263b001534ec5937c19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4881f366ae6a4d439fddf34117e523d0" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 44183 } } peers { permanent_uuid: "88722ff924974acca8b256c084641767" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33067 } } peers { permanent_uuid: "4f26667b32664263b001534ec5937c19" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 45405 } }
I20260812 17:43:06.560119 26114 raft_consensus.cc:374] T 89a866f96089498ba36f0bcb41667e72 P 4f26667b32664263b001534ec5937c19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:06.560209 26114 raft_consensus.cc:729] T 89a866f96089498ba36f0bcb41667e72 P 4f26667b32664263b001534ec5937c19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26667b32664263b001534ec5937c19, State: Initialized, Role: FOLLOWER
I20260812 17:43:06.560676 26114 consensus_queue.cc:260] T 89a866f96089498ba36f0bcb41667e72 P 4f26667b32664263b001534ec5937c19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4881f366ae6a4d439fddf34117e523d0" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 44183 } } peers { permanent_uuid: "88722ff924974acca8b256c084641767" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33067 } } peers { permanent_uuid: "4f26667b32664263b001534ec5937c19" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 45405 } }
I20260812 17:43:06.561311 25885 heartbeater.cc:503] Master 127.17.255.62:35037 was elected leader, sending a full tablet report...
I20260812 17:43:06.561666 26114 ts_tablet_manager.cc:1428] T 89a866f96089498ba36f0bcb41667e72 P 4f26667b32664263b001534ec5937c19: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260812 17:43:06.654639 26122 raft_consensus.cc:482] T 89a866f96089498ba36f0bcb41667e72 P 4881f366ae6a4d439fddf34117e523d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:43:06.655052 26122 raft_consensus.cc:504] T 89a866f96089498ba36f0bcb41667e72 P 4881f366ae6a4d439fddf34117e523d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4881f366ae6a4d439fddf34117e523d0" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 44183 } } peers { permanent_uuid: "88722ff924974acca8b256c084641767" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33067 } } peers { permanent_uuid: "4f26667b32664263b001534ec5937c19" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 45405 } }
I20260812 17:43:06.656461 26122 leader_election.cc:288] T 89a866f96089498ba36f0bcb41667e72 P 4881f366ae6a4d439fddf34117e523d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88722ff924974acca8b256c084641767 (127.17.255.1:33067), 4f26667b32664263b001534ec5937c19 (127.17.255.2:45405)
I20260812 17:43:06.662099 26110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:06.656848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:50043 (local address 127.17.255.1:33067)
0812 17:43:06.656980 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:06.656986 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:06.657005 (+ 19us) server_negotiation.cc:407] Connection header received
0812 17:43:06.657166 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:06.657169 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:06.657215 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:06.657274 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:43:06.657674 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:06.658622 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:06.660610 (+ 1988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:06.661279 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:06.661410 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:06.661471 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:06.661864 (+ 393us) server_negotiation.cc:299] Negotiation successful
0812 17:43:06.661957 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 17:43:06.662099 26109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:06.657014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:37243 (local address 127.17.255.2:45405)
0812 17:43:06.657139 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:06.657143 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:06.657363 (+ 220us) server_negotiation.cc:407] Connection header received
0812 17:43:06.657490 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:06.657493 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:06.657534 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:06.657595 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:43:06.657878 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:06.658793 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:06.660610 (+ 1817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:06.661254 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:06.661410 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:06.661471 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:06.661864 (+ 393us) server_negotiation.cc:299] Negotiation successful
0812 17:43:06.661957 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 17:43:06.662072 26090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:06.656680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:33067 (local address 127.17.255.3:50043)
0812 17:43:06.656872 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:06.656889 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:06.657001 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:06.657333 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:06.657337 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:06.657383 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:43:06.657531 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:06.657537 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:06.658780 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:06.658783 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:06.660385 (+ 1602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:06.660398 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:06.661446 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:06.661450 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:06.661615 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:06.661668 (+ 53us) client_negotiation.cc:769] Sending connection context
0812 17:43:06.661774 (+ 106us) client_negotiation.cc:240] Negotiation successful
0812 17:43:06.661940 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66,"mutex_wait_us":171,"spinlock_wait_cycles":10624}
I20260812 17:43:06.662081 26126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:06.656826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:45405 (local address 127.17.255.3:37243)
0812 17:43:06.657223 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:06.657234 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:06.657385 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:06.657642 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:06.657648 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:06.657669 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:43:06.657769 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:06.657774 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:06.658903 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:06.658906 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:06.660385 (+ 1479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:06.660398 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:06.661446 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:06.661450 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:06.661618 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:06.661695 (+ 77us) client_negotiation.cc:769] Sending connection context
0812 17:43:06.661773 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 17:43:06.661894 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"mutex_wait_us":203,"spinlock_wait_cycles":31360,"thread_start_us":134,"threads_started":1}
I20260812 17:43:06.662994 25616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89a866f96089498ba36f0bcb41667e72" candidate_uuid: "4881f366ae6a4d439fddf34117e523d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88722ff924974acca8b256c084641767" is_pre_election: true
I20260812 17:43:06.663031 25815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89a866f96089498ba36f0bcb41667e72" candidate_uuid: "4881f366ae6a4d439fddf34117e523d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26667b32664263b001534ec5937c19" is_pre_election: true
I20260812 17:43:06.663420 25616 raft_consensus.cc:2454] T 89a866f96089498ba36f0bcb41667e72 P 88722ff924974acca8b256c084641767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4881f366ae6a4d439fddf34117e523d0 in term 0.
I20260812 17:43:06.663441 25815 raft_consensus.cc:2454] T 89a866f96089498ba36f0bcb41667e72 P 4f26667b32664263b001534ec5937c19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4881f366ae6a4d439fddf34117e523d0 in term 0.
I20260812 17:43:06.664031 25916 leader_election.cc:302] T 89a866f96089498ba36f0bcb41667e72 P 4881f366ae6a4d439fddf34117e523d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 4881f366ae6a4d439fddf34117e523d0, 4f26667b32664263b001534ec5937c19, 88722ff924974acca8b256c084641767; no voters:
I20260812 17:43:06.664343 26122 raft_consensus.cc:2781] T 89a866f96089498ba36f0bcb41667e72 P 4881f366ae6a4d439fddf34117e523d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 17:43:06.664444 26122 raft_consensus.cc:482] T 89a866f96089498ba36f0bcb41667e72 P 4881f366ae6a4d439fddf34117e523d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 17:43:06.664513 26122 raft_consensus.cc:3037] T 89a866f96089498ba36f0bcb41667e72 P 4881f366ae6a4d439fddf34117e523d0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:06.665627 26122 raft_consensus.cc:504] T 89a866f96089498ba36f0bcb41667e72 P 4881f366ae6a4d439fddf34117e523d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4881f366ae6a4d439fddf34117e523d0" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 44183 } } peers { permanent_uuid: "88722ff924974acca8b256c084641767" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33067 } } peers { permanent_uuid: "4f26667b32664263b001534ec5937c19" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 45405 } }
I20260812 17:43:06.666045 26122 leader_election.cc:288] T 89a866f96089498ba36f0bcb41667e72 P 4881f366ae6a4d439fddf34117e523d0 [CANDIDATE]: Term 1 election: Requested vote from peers 88722ff924974acca8b256c084641767 (127.17.255.1:33067), 4f26667b32664263b001534ec5937c19 (127.17.255.2:45405)
I20260812 17:43:06.666499 25616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89a866f96089498ba36f0bcb41667e72" candidate_uuid: "4881f366ae6a4d439fddf34117e523d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88722ff924974acca8b256c084641767"
I20260812 17:43:06.666509 25815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89a866f96089498ba36f0bcb41667e72" candidate_uuid: "4881f366ae6a4d439fddf34117e523d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26667b32664263b001534ec5937c19"
I20260812 17:43:06.666638 25616 raft_consensus.cc:3037] T 89a866f96089498ba36f0bcb41667e72 P 88722ff924974acca8b256c084641767 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:06.666644 25815 raft_consensus.cc:3037] T 89a866f96089498ba36f0bcb41667e72 P 4f26667b32664263b001534ec5937c19 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:06.667717 25616 raft_consensus.cc:2454] T 89a866f96089498ba36f0bcb41667e72 P 88722ff924974acca8b256c084641767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4881f366ae6a4d439fddf34117e523d0 in term 1.
I20260812 17:43:06.667749 25815 raft_consensus.cc:2454] T 89a866f96089498ba36f0bcb41667e72 P 4f26667b32664263b001534ec5937c19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4881f366ae6a4d439fddf34117e523d0 in term 1.
I20260812 17:43:06.668066 25915 leader_election.cc:302] T 89a866f96089498ba36f0bcb41667e72 P 4881f366ae6a4d439fddf34117e523d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4881f366ae6a4d439fddf34117e523d0, 88722ff924974acca8b256c084641767; no voters:
I20260812 17:43:06.668313 26122 raft_consensus.cc:2781] T 89a866f96089498ba36f0bcb41667e72 P 4881f366ae6a4d439fddf34117e523d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:43:06.668568 26122 raft_consensus.cc:686] T 89a866f96089498ba36f0bcb41667e72 P 4881f366ae6a4d439fddf34117e523d0 [term 1 LEADER]: Becoming Leader. State: Replica: 4881f366ae6a4d439fddf34117e523d0, State: Running, Role: LEADER
I20260812 17:43:06.668967 26122 consensus_queue.cc:237] T 89a866f96089498ba36f0bcb41667e72 P 4881f366ae6a4d439fddf34117e523d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4881f366ae6a4d439fddf34117e523d0" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 44183 } } peers { permanent_uuid: "88722ff924974acca8b256c084641767" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33067 } } peers { permanent_uuid: "4f26667b32664263b001534ec5937c19" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 45405 } }
I20260812 17:43:06.672811 25394 catalog_manager.cc:5495] T 89a866f96089498ba36f0bcb41667e72 P 4881f366ae6a4d439fddf34117e523d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4881f366ae6a4d439fddf34117e523d0 (127.17.255.3). New cstate: current_term: 1 leader_uuid: "4881f366ae6a4d439fddf34117e523d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4881f366ae6a4d439fddf34117e523d0" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 44183 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "88722ff924974acca8b256c084641767" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f26667b32664263b001534ec5937c19" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 45405 } health_report { overall_health: UNKNOWN } } }
I20260812 17:43:06.688589 26106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:06.684545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34042 (local address 127.17.255.3:44183)
0812 17:43:06.684675 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:06.684679 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:06.684694 (+ 15us) server_negotiation.cc:407] Connection header received
0812 17:43:06.684934 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:06.684937 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:06.685003 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:06.685107 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:43:06.685432 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:06.685957 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:06.687026 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:06.687246 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:06.687347 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:06.687644 (+ 297us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:43:06.688128 (+ 484us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:43:06.688225 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:06.688354 (+ 129us) server_negotiation.cc:299] Negotiation successful
0812 17:43:06.688409 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
W20260812 17:43:06.690476 25687 tablet.cc:2369] T 89a866f96089498ba36f0bcb41667e72 P 88722ff924974acca8b256c084641767: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 17:43:06.695408 25616 raft_consensus.cc:1261] T 89a866f96089498ba36f0bcb41667e72 P 88722ff924974acca8b256c084641767 [term 1 FOLLOWER]: Refusing update from remote peer 4881f366ae6a4d439fddf34117e523d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:43:06.695408 25815 raft_consensus.cc:1261] T 89a866f96089498ba36f0bcb41667e72 P 4f26667b32664263b001534ec5937c19 [term 1 FOLLOWER]: Refusing update from remote peer 4881f366ae6a4d439fddf34117e523d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:43:06.696306 26128 consensus_queue.cc:1035] T 89a866f96089498ba36f0bcb41667e72 P 4881f366ae6a4d439fddf34117e523d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88722ff924974acca8b256c084641767" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:43:06.696622 26122 consensus_queue.cc:1035] T 89a866f96089498ba36f0bcb41667e72 P 4881f366ae6a4d439fddf34117e523d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26667b32664263b001534ec5937c19" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 17:43:06.704013 25886 tablet.cc:2369] T 89a866f96089498ba36f0bcb41667e72 P 4f26667b32664263b001534ec5937c19: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 17:43:06.704546 26135 mvcc.cc:205] Tried to move back new op lower bound from 7317735779095101440 to 7317735778999341056. Current Snapshot: MvccSnapshot[applied={T|T < 7317735779095101440}]
I20260812 17:43:06.703781 26133 mvcc.cc:205] Tried to move back new op lower bound from 7317735779095101440 to 7317735778999341056. Current Snapshot: MvccSnapshot[applied={T|T < 7317735779095101440}]
I20260812 17:43:06.706681 26134 mvcc.cc:205] Tried to move back new op lower bound from 7317735779095101440 to 7317735778999341056. Current Snapshot: MvccSnapshot[applied={T|T < 7317735779095101440}]
I20260812 17:43:06.715662 25395 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33612:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:43:06.715862 25395 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33612:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:43:06.718403 25395 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 34a0aa66a1774b6c95a23978cc687599: Sending DeleteTablet for 3 replicas of tablet 89a866f96089498ba36f0bcb41667e72
I20260812 17:43:06.719256 25982 tablet_service.cc:1514] Processing DeleteTablet for tablet 89a866f96089498ba36f0bcb41667e72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:43:06 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:34032
I20260812 17:43:06.719261 25585 tablet_service.cc:1514] Processing DeleteTablet for tablet 89a866f96089498ba36f0bcb41667e72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:43:06 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:51062
I20260812 17:43:06.719995 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 25490
I20260812 17:43:06.720146 25785 tablet_service.cc:1514] Processing DeleteTablet for tablet 89a866f96089498ba36f0bcb41667e72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:43:06 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:44692
I20260812 17:43:06.720643 26145 tablet_replica.cc:330] T 89a866f96089498ba36f0bcb41667e72 P 4f26667b32664263b001534ec5937c19: stopping tablet replica
I20260812 17:43:06.721060 26145 raft_consensus.cc:2229] T 89a866f96089498ba36f0bcb41667e72 P 4f26667b32664263b001534ec5937c19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:43:06.721480 26145 raft_consensus.cc:2258] T 89a866f96089498ba36f0bcb41667e72 P 4f26667b32664263b001534ec5937c19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:43:06.726517 26145 ts_tablet_manager.cc:1905] T 89a866f96089498ba36f0bcb41667e72 P 4f26667b32664263b001534ec5937c19: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:43:06.730630 26144 tablet_replica.cc:330] T 89a866f96089498ba36f0bcb41667e72 P 4881f366ae6a4d439fddf34117e523d0: stopping tablet replica
I20260812 17:43:06.731709 26144 raft_consensus.cc:2229] T 89a866f96089498ba36f0bcb41667e72 P 4881f366ae6a4d439fddf34117e523d0 [term 1 LEADER]: Raft consensus shutting down.
I20260812 17:43:06.732306 26144 raft_consensus.cc:2258] T 89a866f96089498ba36f0bcb41667e72 P 4881f366ae6a4d439fddf34117e523d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:43:06.732537 26145 ts_tablet_manager.cc:1918] T 89a866f96089498ba36f0bcb41667e72 P 4f26667b32664263b001534ec5937c19: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 17:43:06.732694 26145 log.cc:1196] T 89a866f96089498ba36f0bcb41667e72 P 4f26667b32664263b001534ec5937c19: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-1/wal/wals/89a866f96089498ba36f0bcb41667e72
I20260812 17:43:06.733119 26145 ts_tablet_manager.cc:1939] T 89a866f96089498ba36f0bcb41667e72 P 4f26667b32664263b001534ec5937c19: Deleting consensus metadata
I20260812 17:43:06.734565 26144 ts_tablet_manager.cc:1905] T 89a866f96089498ba36f0bcb41667e72 P 4881f366ae6a4d439fddf34117e523d0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:43:06.734668 25375 catalog_manager.cc:4841] TS 4f26667b32664263b001534ec5937c19 (127.17.255.2:45405): tablet 89a866f96089498ba36f0bcb41667e72 (table test-table [id=8e1f7c0aa2ec4f69a5319f7f38b84db7]) successfully deleted
I20260812 17:43:06.736976 26144 ts_tablet_manager.cc:1918] T 89a866f96089498ba36f0bcb41667e72 P 4881f366ae6a4d439fddf34117e523d0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 17:43:06.737107 26144 log.cc:1196] T 89a866f96089498ba36f0bcb41667e72 P 4881f366ae6a4d439fddf34117e523d0: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786556557564181-18428-0/minicluster-data/ts-2/wal/wals/89a866f96089498ba36f0bcb41667e72
I20260812 17:43:06.737476 26144 ts_tablet_manager.cc:1939] T 89a866f96089498ba36f0bcb41667e72 P 4881f366ae6a4d439fddf34117e523d0: Deleting consensus metadata
I20260812 17:43:06.738670 25373 catalog_manager.cc:4841] TS 4881f366ae6a4d439fddf34117e523d0 (127.17.255.3:44183): tablet 89a866f96089498ba36f0bcb41667e72 (table test-table [id=8e1f7c0aa2ec4f69a5319f7f38b84db7]) successfully deleted
W20260812 17:43:06.744879 25374 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.255.1:33067 (error 108)
I20260812 17:43:06.745955 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 25692
I20260812 17:43:06.746143 26108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:06.745815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:33067 (local address 127.0.0.1:51070)
0812 17:43:06.745959 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:06.746041 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.1:33067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260812 17:43:06.755223 25374 catalog_manager.cc:4584] TS 88722ff924974acca8b256c084641767 (127.17.255.1:33067): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 89a866f96089498ba36f0bcb41667e72: Network error: Client connection negotiation failed: client connection to 127.17.255.1:33067: connect: Connection refused (error 111)
I20260812 17:43:06.769076 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 25890
I20260812 17:43:06.792060 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 25352
2026-08-12T17:43:06Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2863 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-12T17:43:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:43:06Z Disabled control of system clock
I20260812 17:43:06.826740 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:33261
--webserver_interface=127.17.255.62
--webserver_port=0
--builtin_ntp_servers=127.17.255.20:33367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:33261
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 17:43:07.000360 26152 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:07.000970 26152 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:07.001075 26152 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:07.008086 26152 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:43:07.008255 26152 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:07.008293 26152 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:07.008314 26152 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:43:07.008387 26152 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:43:07.015832 26152 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:33367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:33261
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:33261
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26152
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:07.018250 26152 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:07.021277 26152 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:07.038568 26164 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:07.038681 26152 server_base.cc:1034] running on GCE node
W20260812 17:43:07.038563 26167 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:07.038563 26162 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:07.040532 26152 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:07.042927 26152 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:07.046466 26152 hybrid_clock.cc:648] HybridClock initialized: now 1786556587046274 us; error 121 us; skew 500 ppm
I20260812 17:43:07.050737 26152 webserver.cc:460] Webserver started at http://127.17.255.62:35015/ using document root <none> and password file <none>
I20260812 17:43:07.051983 26152 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:07.052114 26152 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:07.052533 26152 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:07.056074 26152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "8e4a073186c248f082f25e8ae9e6abee"
format_stamp: "Formatted at 2026-08-12 17:43:07 on dist-test-slave-tk9z"
server_key: "6a7d79491af77d2c5e431e1d16a0eb66"
server_key_iv: "142345414f8be61fc22714be9adb2e62"
server_key_version: "encryptionkey@0"
I20260812 17:43:07.057044 26152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "8e4a073186c248f082f25e8ae9e6abee"
format_stamp: "Formatted at 2026-08-12 17:43:07 on dist-test-slave-tk9z"
server_key: "6a7d79491af77d2c5e431e1d16a0eb66"
server_key_iv: "142345414f8be61fc22714be9adb2e62"
server_key_version: "encryptionkey@0"
I20260812 17:43:07.065981 26152 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.005s sys 0.004s
I20260812 17:43:07.071677 26177 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:07.075022 26152 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.006s sys 0.000s
I20260812 17:43:07.075389 26152 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "8e4a073186c248f082f25e8ae9e6abee"
format_stamp: "Formatted at 2026-08-12 17:43:07 on dist-test-slave-tk9z"
server_key: "6a7d79491af77d2c5e431e1d16a0eb66"
server_key_iv: "142345414f8be61fc22714be9adb2e62"
server_key_version: "encryptionkey@0"
I20260812 17:43:07.075726 26152 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:07.085737 26152 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:07.087261 26152 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:07.087615 26152 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:07.102486 26152 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:33261
I20260812 17:43:07.102545 26261 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:33261 every 8 connection(s)
I20260812 17:43:07.104568 26152 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:43:07.107107 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 26152
I20260812 17:43:07.107290 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:43:07.107894 18428 external_mini_cluster.cc:1428] Setting key 4057536330dd5706746934373c8ac14c
I20260812 17:43:07.112967 26262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:07.119642 26267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:07.111036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35724 (local address 127.17.255.62:33261)
0812 17:43:07.112493 (+ 1457us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:07.112539 (+ 46us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:07.112612 (+ 73us) server_negotiation.cc:407] Connection header received
0812 17:43:07.113930 (+ 1318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:07.113966 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:07.114803 (+ 837us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:07.115469 (+ 666us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:07.117036 (+ 1567us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:07.117047 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:07.117076 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:43:07.117094 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:07.117185 (+ 91us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:43:07.117209 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:07.117471 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:07.117629 (+ 158us) server_negotiation.cc:299] Negotiation successful
0812 17:43:07.118085 (+ 456us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":605,"thread_start_us":236,"threads_started":1}
I20260812 17:43:07.125768 26262 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e4a073186c248f082f25e8ae9e6abee: Bootstrap starting.
I20260812 17:43:07.130401 26262 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8e4a073186c248f082f25e8ae9e6abee: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:07.132047 26262 log.cc:824] T 00000000000000000000000000000000 P 8e4a073186c248f082f25e8ae9e6abee: Log is configured to *not* fsync() on all Append() calls
I20260812 17:43:07.136696 26262 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e4a073186c248f082f25e8ae9e6abee: No bootstrap required, opened a new log
I20260812 17:43:07.143471 26262 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8e4a073186c248f082f25e8ae9e6abee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e4a073186c248f082f25e8ae9e6abee" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 33261 } }
I20260812 17:43:07.143996 26262 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8e4a073186c248f082f25e8ae9e6abee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:07.144066 26262 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8e4a073186c248f082f25e8ae9e6abee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e4a073186c248f082f25e8ae9e6abee, State: Initialized, Role: FOLLOWER
I20260812 17:43:07.145133 26262 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8e4a073186c248f082f25e8ae9e6abee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e4a073186c248f082f25e8ae9e6abee" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 33261 } }
I20260812 17:43:07.145566 26262 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8e4a073186c248f082f25e8ae9e6abee [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:43:07.145735 26262 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8e4a073186c248f082f25e8ae9e6abee [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:43:07.145974 26262 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8e4a073186c248f082f25e8ae9e6abee [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:07.147710 26262 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8e4a073186c248f082f25e8ae9e6abee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e4a073186c248f082f25e8ae9e6abee" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 33261 } }
I20260812 17:43:07.148387 26262 leader_election.cc:302] T 00000000000000000000000000000000 P 8e4a073186c248f082f25e8ae9e6abee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8e4a073186c248f082f25e8ae9e6abee; no voters:
I20260812 17:43:07.149082 26262 leader_election.cc:288] T 00000000000000000000000000000000 P 8e4a073186c248f082f25e8ae9e6abee [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:43:07.149415 26269 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8e4a073186c248f082f25e8ae9e6abee [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:43:07.149961 26269 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8e4a073186c248f082f25e8ae9e6abee [term 1 LEADER]: Becoming Leader. State: Replica: 8e4a073186c248f082f25e8ae9e6abee, State: Running, Role: LEADER
I20260812 17:43:07.150710 26269 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8e4a073186c248f082f25e8ae9e6abee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e4a073186c248f082f25e8ae9e6abee" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 33261 } }
I20260812 17:43:07.151837 26262 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8e4a073186c248f082f25e8ae9e6abee [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:43:07.154193 26271 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e4a073186c248f082f25e8ae9e6abee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8e4a073186c248f082f25e8ae9e6abee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e4a073186c248f082f25e8ae9e6abee" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 33261 } } }
I20260812 17:43:07.154268 26273 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e4a073186c248f082f25e8ae9e6abee [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8e4a073186c248f082f25e8ae9e6abee. Latest consensus state: current_term: 1 leader_uuid: "8e4a073186c248f082f25e8ae9e6abee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e4a073186c248f082f25e8ae9e6abee" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 33261 } } }
I20260812 17:43:07.154527 26271 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e4a073186c248f082f25e8ae9e6abee [sys.catalog]: This master's current role is: LEADER
I20260812 17:43:07.154527 26273 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e4a073186c248f082f25e8ae9e6abee [sys.catalog]: This master's current role is: LEADER
I20260812 17:43:07.155438 26283 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:43:07.161623 26283 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:43:07.173621 26283 catalog_manager.cc:1347] Generated new cluster ID: f697438be70b4990899090aedde6e82e
I20260812 17:43:07.173792 26283 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:43:07.205636 26283 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:43:07.206445 26283 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:43:07.223668 26283 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8e4a073186c248f082f25e8ae9e6abee: Generated new TSK 0
I20260812 17:43:07.225370 26283 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 17:43:07.231902 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.1:0
--local_ip_for_outbound_sockets=127.17.255.1
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:33261
--builtin_ntp_servers=127.17.255.20:33367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 17:43:07.468262 26299 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:07.468822 26299 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:07.468957 26299 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:07.476308 26299 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:07.476485 26299 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:07.476688 26299 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.1
I20260812 17:43:07.485687 26299 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:33367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:33261
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26299
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.1
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:07.488215 26299 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:07.491246 26299 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:07.509563 26308 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:07.509563 26312 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:07.509619 26307 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:07.510229 26299 server_base.cc:1034] running on GCE node
I20260812 17:43:07.511524 26299 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:07.512897 26299 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:07.514339 26299 hybrid_clock.cc:648] HybridClock initialized: now 1786556587514306 us; error 50 us; skew 500 ppm
I20260812 17:43:07.518299 26299 webserver.cc:460] Webserver started at http://127.17.255.1:43561/ using document root <none> and password file <none>
I20260812 17:43:07.519361 26299 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:07.519521 26299 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:07.519876 26299 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:07.523834 26299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-0/data/instance:
uuid: "23a587816a6349a3a1ecdda42cd93152"
format_stamp: "Formatted at 2026-08-12 17:43:07 on dist-test-slave-tk9z"
server_key: "bbbd523fc6519bbb51a600a451f7e6ba"
server_key_iv: "01d673f2c521b3e614e901a0fd635456"
server_key_version: "encryptionkey@0"
I20260812 17:43:07.524977 26299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance:
uuid: "23a587816a6349a3a1ecdda42cd93152"
format_stamp: "Formatted at 2026-08-12 17:43:07 on dist-test-slave-tk9z"
server_key: "bbbd523fc6519bbb51a600a451f7e6ba"
server_key_iv: "01d673f2c521b3e614e901a0fd635456"
server_key_version: "encryptionkey@0"
I20260812 17:43:07.533335 26299 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.009s sys 0.000s
I20260812 17:43:07.538678 26319 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:07.541347 26299 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260812 17:43:07.541654 26299 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-0/wal
uuid: "23a587816a6349a3a1ecdda42cd93152"
format_stamp: "Formatted at 2026-08-12 17:43:07 on dist-test-slave-tk9z"
server_key: "bbbd523fc6519bbb51a600a451f7e6ba"
server_key_iv: "01d673f2c521b3e614e901a0fd635456"
server_key_version: "encryptionkey@0"
I20260812 17:43:07.541960 26299 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:07.554324 26299 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:07.555703 26299 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:07.555955 26299 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:07.556882 26299 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:43:07.558749 26299 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:43:07.558856 26299 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:07.558933 26299 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:43:07.558961 26299 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:07.577666 26299 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.1:45997
I20260812 17:43:07.577737 26496 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.1:45997 every 8 connection(s)
I20260812 17:43:07.579788 26299 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
I20260812 17:43:07.589666 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 26299
I20260812 17:43:07.589905 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance
I20260812 17:43:07.590552 18428 external_mini_cluster.cc:1428] Setting key 91977815ec7bb1917b8c2a8e7bddcc90
I20260812 17:43:07.593007 26267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:07.583887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:44611 (local address 127.17.255.62:33261)
0812 17:43:07.584142 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:07.584147 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:07.586584 (+ 2437us) server_negotiation.cc:407] Connection header received
0812 17:43:07.589239 (+ 2655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:07.589245 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:07.589351 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:07.589514 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:07.592040 (+ 2526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:07.592053 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:07.592057 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:43:07.592073 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:07.592116 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:43:07.592142 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:07.592282 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:07.592629 (+ 347us) server_negotiation.cc:299] Negotiation successful
0812 17:43:07.592700 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111}
I20260812 17:43:07.594616 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.2:0
--local_ip_for_outbound_sockets=127.17.255.2
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:33261
--builtin_ntp_servers=127.17.255.20:33367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260812 17:43:07.595208 26500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:07.584871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:33261 (local address 127.17.255.1:44611)
0812 17:43:07.586170 (+ 1299us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:07.586253 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:07.588817 (+ 2564us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:07.589930 (+ 1113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:07.589948 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:07.590172 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:07.591445 (+ 1273us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 17:43:07.591448 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:07.591522 (+ 74us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 17:43:07.591636 (+ 114us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:07.592385 (+ 749us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:07.592400 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:07.592405 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 17:43:07.592710 (+ 305us) client_negotiation.cc:240] Negotiation successful
0812 17:43:07.593258 (+ 548us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":608,"thread_start_us":332,"threads_started":1}
I20260812 17:43:07.597913 26497 heartbeater.cc:347] Connected to a master server at 127.17.255.62:33261
I20260812 17:43:07.598523 26497 heartbeater.cc:464] Registering TS with master...
I20260812 17:43:07.599649 26497 heartbeater.cc:511] Master 127.17.255.62:33261 requested a full tablet report, sending...
I20260812 17:43:07.602900 26200 ts_manager.cc:194] Registered new tserver with Master: 23a587816a6349a3a1ecdda42cd93152 (127.17.255.1:45997)
W20260812 17:43:07.807497 26502 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:07.808554 26502 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:07.808777 26502 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:07.819132 26502 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:07.819298 26502 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:07.819585 26502 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.2
I20260812 17:43:07.830348 26502 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:33367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:33261
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26502
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.2
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:07.833070 26502 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:07.836527 26502 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:07.856631 26509 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:07.856648 26511 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:07.856631 26508 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:07.857451 26502 server_base.cc:1034] running on GCE node
I20260812 17:43:07.858245 26502 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:07.859553 26502 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:07.861102 26502 hybrid_clock.cc:648] HybridClock initialized: now 1786556587861053 us; error 74 us; skew 500 ppm
I20260812 17:43:07.864960 26502 webserver.cc:460] Webserver started at http://127.17.255.2:42721/ using document root <none> and password file <none>
I20260812 17:43:07.866089 26502 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:07.866276 26502 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:07.866707 26502 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:07.870831 26502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-1/data/instance:
uuid: "12ce199bc90144a09516854222520f12"
format_stamp: "Formatted at 2026-08-12 17:43:07 on dist-test-slave-tk9z"
server_key: "11a72d0a24515329bbe11ee7f33ccfa8"
server_key_iv: "9c142480bcc47c49ba42c1306b590644"
server_key_version: "encryptionkey@0"
I20260812 17:43:07.872056 26502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance:
uuid: "12ce199bc90144a09516854222520f12"
format_stamp: "Formatted at 2026-08-12 17:43:07 on dist-test-slave-tk9z"
server_key: "11a72d0a24515329bbe11ee7f33ccfa8"
server_key_iv: "9c142480bcc47c49ba42c1306b590644"
server_key_version: "encryptionkey@0"
I20260812 17:43:07.880779 26502 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.003s sys 0.005s
I20260812 17:43:07.885911 26517 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:07.888649 26502 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260812 17:43:07.888926 26502 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-1/wal
uuid: "12ce199bc90144a09516854222520f12"
format_stamp: "Formatted at 2026-08-12 17:43:07 on dist-test-slave-tk9z"
server_key: "11a72d0a24515329bbe11ee7f33ccfa8"
server_key_iv: "9c142480bcc47c49ba42c1306b590644"
server_key_version: "encryptionkey@0"
I20260812 17:43:07.889158 26502 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:07.899092 26502 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:07.900377 26502 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:07.900722 26502 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:07.901825 26502 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:43:07.903939 26502 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:43:07.904064 26502 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:07.904232 26502 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:43:07.904294 26502 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:07.933840 26502 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.2:42611
I20260812 17:43:07.933877 26688 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.2:42611 every 8 connection(s)
I20260812 17:43:07.935770 26502 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
I20260812 17:43:07.942107 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 26502
I20260812 17:43:07.942432 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance
I20260812 17:43:07.942975 18428 external_mini_cluster.cc:1428] Setting key 3b8d07200e7b790391cb34cdd916e582
I20260812 17:43:07.946827 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.3:0
--local_ip_for_outbound_sockets=127.17.255.3
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:33261
--builtin_ntp_servers=127.17.255.20:33367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260812 17:43:07.948137 26267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:07.939183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:60875 (local address 127.17.255.62:33261)
0812 17:43:07.939461 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:07.939473 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:07.941531 (+ 2058us) server_negotiation.cc:407] Connection header received
0812 17:43:07.944532 (+ 3001us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:07.944537 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:07.944638 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:07.944725 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:07.947054 (+ 2329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:07.947063 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:07.947069 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:43:07.947104 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:07.947146 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:43:07.947186 (+ 40us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:07.947343 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:07.947674 (+ 331us) server_negotiation.cc:299] Negotiation successful
0812 17:43:07.947804 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260812 17:43:07.949699 26691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:07.939934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:33261 (local address 127.17.255.2:60875)
0812 17:43:07.941228 (+ 1294us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:07.941308 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:07.944094 (+ 2786us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:07.945116 (+ 1022us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:07.945137 (+ 21us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:07.945334 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:07.946537 (+ 1203us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 17:43:07.946545 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:07.946629 (+ 84us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 17:43:07.946789 (+ 160us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:07.947396 (+ 607us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:07.947411 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:07.947417 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 17:43:07.947677 (+ 260us) client_negotiation.cc:240] Negotiation successful
0812 17:43:07.948055 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":208,"threads_started":1}
I20260812 17:43:07.952090 26689 heartbeater.cc:347] Connected to a master server at 127.17.255.62:33261
I20260812 17:43:07.952427 26689 heartbeater.cc:464] Registering TS with master...
I20260812 17:43:07.953212 26689 heartbeater.cc:511] Master 127.17.255.62:33261 requested a full tablet report, sending...
I20260812 17:43:07.955788 26200 ts_manager.cc:194] Registered new tserver with Master: 12ce199bc90144a09516854222520f12 (127.17.255.2:42611)
W20260812 17:43:08.141032 26692 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:08.141309 26692 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:08.141386 26692 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:08.145488 26692 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:08.145550 26692 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:08.145637 26692 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.3
I20260812 17:43:08.150522 26692 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:33367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:33261
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26692
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.3
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:08.151676 26692 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:08.153237 26692 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:08.163275 26697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:08.163275 26699 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:08.163287 26702 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:08.163733 26692 server_base.cc:1034] running on GCE node
I20260812 17:43:08.164140 26692 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:08.164834 26692 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:08.166016 26692 hybrid_clock.cc:648] HybridClock initialized: now 1786556588166003 us; error 28 us; skew 500 ppm
I20260812 17:43:08.167984 26692 webserver.cc:460] Webserver started at http://127.17.255.3:38215/ using document root <none> and password file <none>
I20260812 17:43:08.168553 26692 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:08.168615 26692 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:08.168793 26692 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:08.171056 26692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-2/data/instance:
uuid: "99e06e936b9648ddb4ac07ec6b38f0ab"
format_stamp: "Formatted at 2026-08-12 17:43:08 on dist-test-slave-tk9z"
server_key: "72ec9bf16417887f1290b1ee24d183fc"
server_key_iv: "ba52badfde331c23de337022eddb7a1d"
server_key_version: "encryptionkey@0"
I20260812 17:43:08.171646 26692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance:
uuid: "99e06e936b9648ddb4ac07ec6b38f0ab"
format_stamp: "Formatted at 2026-08-12 17:43:08 on dist-test-slave-tk9z"
server_key: "72ec9bf16417887f1290b1ee24d183fc"
server_key_iv: "ba52badfde331c23de337022eddb7a1d"
server_key_version: "encryptionkey@0"
I20260812 17:43:08.175477 26692 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 17:43:08.178517 26708 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:08.179878 26692 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:43:08.179996 26692 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-2/wal
uuid: "99e06e936b9648ddb4ac07ec6b38f0ab"
format_stamp: "Formatted at 2026-08-12 17:43:08 on dist-test-slave-tk9z"
server_key: "72ec9bf16417887f1290b1ee24d183fc"
server_key_iv: "ba52badfde331c23de337022eddb7a1d"
server_key_version: "encryptionkey@0"
I20260812 17:43:08.180095 26692 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:08.184948 26692 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:08.185539 26692 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:08.185734 26692 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:08.186323 26692 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:43:08.187361 26692 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:43:08.187436 26692 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:08.187564 26692 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:43:08.187618 26692 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:08.197096 26692 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.3:39351
I20260812 17:43:08.197130 26876 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.3:39351 every 8 connection(s)
I20260812 17:43:08.198168 26692 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
I20260812 17:43:08.201156 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 26692
I20260812 17:43:08.201301 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance
I20260812 17:43:08.201642 18428 external_mini_cluster.cc:1428] Setting key 58c6b1db4e3da25538ba9bc40efba9d6
I20260812 17:43:08.205101 26267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:08.200226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:34463 (local address 127.17.255.62:33261)
0812 17:43:08.200416 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:08.200421 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:08.201904 (+ 1483us) server_negotiation.cc:407] Connection header received
0812 17:43:08.203259 (+ 1355us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:08.203262 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:08.203306 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:08.203399 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:08.204571 (+ 1172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:08.204574 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:08.204576 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:43:08.204589 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:08.204612 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:43:08.204620 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:08.204700 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:08.204951 (+ 251us) server_negotiation.cc:299] Negotiation successful
0812 17:43:08.204995 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 17:43:08.206014 26880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:08.200716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:33261 (local address 127.17.255.3:34463)
0812 17:43:08.201704 (+ 988us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:08.201766 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:08.203075 (+ 1309us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:08.203567 (+ 492us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:08.203574 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:08.203666 (+ 92us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:08.204298 (+ 632us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 17:43:08.204300 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:08.204344 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 17:43:08.204415 (+ 71us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:08.204737 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:08.204747 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:08.204752 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 17:43:08.204940 (+ 188us) client_negotiation.cc:240] Negotiation successful
0812 17:43:08.205142 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":179,"threads_started":1}
I20260812 17:43:08.207356 26877 heartbeater.cc:347] Connected to a master server at 127.17.255.62:33261
I20260812 17:43:08.207653 26877 heartbeater.cc:464] Registering TS with master...
I20260812 17:43:08.208107 26877 heartbeater.cc:511] Master 127.17.255.62:33261 requested a full tablet report, sending...
I20260812 17:43:08.209249 26200 ts_manager.cc:194] Registered new tserver with Master: 99e06e936b9648ddb4ac07ec6b38f0ab (127.17.255.3:39351)
I20260812 17:43:08.216522 18428 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 17:43:08.220650 26267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:08.218723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35730 (local address 127.17.255.62:33261)
0812 17:43:08.218899 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:08.218903 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:08.219042 (+ 139us) server_negotiation.cc:407] Connection header received
0812 17:43:08.219117 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:08.219119 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:08.219158 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:08.219226 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:08.220140 (+ 914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:08.220146 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:08.220151 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:43:08.220171 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:08.220200 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:43:08.220214 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:08.220344 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:08.220453 (+ 109us) server_negotiation.cc:299] Negotiation successful
0812 17:43:08.220499 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260812 17:43:08.223845 26200 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35730:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 17:43:08.227182 26200 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 17:43:08.240379 26903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:08.237661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48340 (local address 127.17.255.3:39351)
0812 17:43:08.238276 (+ 615us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:08.238288 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:08.238309 (+ 21us) server_negotiation.cc:407] Connection header received
0812 17:43:08.238360 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:08.238365 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:08.238582 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:08.238732 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:08.239708 (+ 976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:08.239713 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:08.239721 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:43:08.239733 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:08.239783 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:43:08.239816 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:08.239922 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:08.240148 (+ 226us) server_negotiation.cc:299] Negotiation successful
0812 17:43:08.240231 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":515,"thread_start_us":101,"threads_started":1}
I20260812 17:43:08.240367 26895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:08.236583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:42611 (local address 127.0.0.1:40290)
0812 17:43:08.237338 (+ 755us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:08.237395 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:08.238016 (+ 621us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:08.238585 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:08.238592 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:08.238682 (+ 90us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:08.239504 (+ 822us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 17:43:08.239507 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:08.239518 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 17:43:08.239545 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:08.239955 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:08.239972 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:08.239979 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 17:43:08.240129 (+ 150us) client_negotiation.cc:240] Negotiation successful
0812 17:43:08.240192 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":549,"thread_start_us":134,"threads_started":1}
I20260812 17:43:08.240370 26902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:08.237473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.3:39351 (local address 127.0.0.1:48340)
0812 17:43:08.237732 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:08.237746 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:08.237842 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:08.238707 (+ 865us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:08.238710 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:08.238721 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:08.239443 (+ 722us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 17:43:08.239445 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:08.239468 (+ 23us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 17:43:08.239545 (+ 77us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:08.239967 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:08.239978 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:08.239985 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 17:43:08.240112 (+ 127us) client_negotiation.cc:240] Negotiation successful
0812 17:43:08.240196 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":102,"threads_started":1}
I20260812 17:43:08.241187 26896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:08.236583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:45997 (local address 127.0.0.1:55230)
0812 17:43:08.237414 (+ 831us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:08.237429 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:08.237571 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:08.239508 (+ 1937us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:08.239511 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:08.239526 (+ 15us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:08.240565 (+ 1039us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 17:43:08.240567 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:08.240578 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 17:43:08.240607 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:08.240933 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:08.240937 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:08.240940 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 17:43:08.241028 (+ 88us) client_negotiation.cc:240] Negotiation successful
0812 17:43:08.241065 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":777,"mutex_wait_us":187,"thread_start_us":92,"threads_started":1}
I20260812 17:43:08.241263 26899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:08.236858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55230 (local address 127.17.255.1:45997)
0812 17:43:08.237466 (+ 608us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:08.237473 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:08.237505 (+ 32us) server_negotiation.cc:407] Connection header received
0812 17:43:08.237739 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:08.237747 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:08.238081 (+ 334us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:08.238227 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:08.240745 (+ 2518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:08.240752 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:08.240769 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:43:08.240781 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:08.240814 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:43:08.240840 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:08.240966 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:08.241046 (+ 80us) server_negotiation.cc:299] Negotiation successful
0812 17:43:08.241118 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":490,"thread_start_us":126,"threads_started":1}
I20260812 17:43:08.240387 26897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:08.236716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40290 (local address 127.17.255.2:42611)
0812 17:43:08.237290 (+ 574us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:08.237302 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:08.238019 (+ 717us) server_negotiation.cc:407] Connection header received
0812 17:43:08.238157 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:08.238164 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:08.238404 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:08.239016 (+ 612us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:08.239698 (+ 682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:08.239704 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:08.239717 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:43:08.239729 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:08.239773 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:43:08.239804 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:08.239958 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:08.240160 (+ 202us) server_negotiation.cc:299] Negotiation successful
0812 17:43:08.240241 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":452,"thread_start_us":157,"threads_started":1}
I20260812 17:43:08.244088 26386 tablet_service.cc:1467] Processing CreateTablet for tablet a0a3cf0cea334d8ab294cd2482209187 (DEFAULT_TABLE table=test-table [id=77be61750460463180ad82dabd3b0c50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:43:08.244000 26782 tablet_service.cc:1467] Processing CreateTablet for tablet a0a3cf0cea334d8ab294cd2482209187 (DEFAULT_TABLE table=test-table [id=77be61750460463180ad82dabd3b0c50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:43:08.244657 26588 tablet_service.cc:1467] Processing CreateTablet for tablet a0a3cf0cea334d8ab294cd2482209187 (DEFAULT_TABLE table=test-table [id=77be61750460463180ad82dabd3b0c50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:43:08.245281 26782 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0a3cf0cea334d8ab294cd2482209187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:08.245282 26386 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0a3cf0cea334d8ab294cd2482209187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:08.245602 26588 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0a3cf0cea334d8ab294cd2482209187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:08.252215 26904 tablet_bootstrap.cc:492] T a0a3cf0cea334d8ab294cd2482209187 P 99e06e936b9648ddb4ac07ec6b38f0ab: Bootstrap starting.
I20260812 17:43:08.253453 26906 tablet_bootstrap.cc:492] T a0a3cf0cea334d8ab294cd2482209187 P 23a587816a6349a3a1ecdda42cd93152: Bootstrap starting.
I20260812 17:43:08.254717 26908 tablet_bootstrap.cc:492] T a0a3cf0cea334d8ab294cd2482209187 P 12ce199bc90144a09516854222520f12: Bootstrap starting.
I20260812 17:43:08.255303 26904 tablet_bootstrap.cc:654] T a0a3cf0cea334d8ab294cd2482209187 P 99e06e936b9648ddb4ac07ec6b38f0ab: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:08.255730 26906 tablet_bootstrap.cc:654] T a0a3cf0cea334d8ab294cd2482209187 P 23a587816a6349a3a1ecdda42cd93152: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:08.256131 26904 log.cc:824] T a0a3cf0cea334d8ab294cd2482209187 P 99e06e936b9648ddb4ac07ec6b38f0ab: Log is configured to *not* fsync() on all Append() calls
I20260812 17:43:08.256582 26906 log.cc:824] T a0a3cf0cea334d8ab294cd2482209187 P 23a587816a6349a3a1ecdda42cd93152: Log is configured to *not* fsync() on all Append() calls
I20260812 17:43:08.256989 26908 tablet_bootstrap.cc:654] T a0a3cf0cea334d8ab294cd2482209187 P 12ce199bc90144a09516854222520f12: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:08.257805 26908 log.cc:824] T a0a3cf0cea334d8ab294cd2482209187 P 12ce199bc90144a09516854222520f12: Log is configured to *not* fsync() on all Append() calls
I20260812 17:43:08.258543 26904 tablet_bootstrap.cc:492] T a0a3cf0cea334d8ab294cd2482209187 P 99e06e936b9648ddb4ac07ec6b38f0ab: No bootstrap required, opened a new log
I20260812 17:43:08.258790 26904 ts_tablet_manager.cc:1397] T a0a3cf0cea334d8ab294cd2482209187 P 99e06e936b9648ddb4ac07ec6b38f0ab: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260812 17:43:08.258797 26906 tablet_bootstrap.cc:492] T a0a3cf0cea334d8ab294cd2482209187 P 23a587816a6349a3a1ecdda42cd93152: No bootstrap required, opened a new log
I20260812 17:43:08.259017 26906 ts_tablet_manager.cc:1397] T a0a3cf0cea334d8ab294cd2482209187 P 23a587816a6349a3a1ecdda42cd93152: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260812 17:43:08.260922 26908 tablet_bootstrap.cc:492] T a0a3cf0cea334d8ab294cd2482209187 P 12ce199bc90144a09516854222520f12: No bootstrap required, opened a new log
I20260812 17:43:08.261122 26908 ts_tablet_manager.cc:1397] T a0a3cf0cea334d8ab294cd2482209187 P 12ce199bc90144a09516854222520f12: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260812 17:43:08.262619 26904 raft_consensus.cc:348] T a0a3cf0cea334d8ab294cd2482209187 P 99e06e936b9648ddb4ac07ec6b38f0ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12ce199bc90144a09516854222520f12" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 42611 } } peers { permanent_uuid: "23a587816a6349a3a1ecdda42cd93152" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 45997 } } peers { permanent_uuid: "99e06e936b9648ddb4ac07ec6b38f0ab" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 39351 } }
I20260812 17:43:08.262892 26904 raft_consensus.cc:374] T a0a3cf0cea334d8ab294cd2482209187 P 99e06e936b9648ddb4ac07ec6b38f0ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:08.262957 26904 raft_consensus.cc:729] T a0a3cf0cea334d8ab294cd2482209187 P 99e06e936b9648ddb4ac07ec6b38f0ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e06e936b9648ddb4ac07ec6b38f0ab, State: Initialized, Role: FOLLOWER
I20260812 17:43:08.263449 26904 consensus_queue.cc:260] T a0a3cf0cea334d8ab294cd2482209187 P 99e06e936b9648ddb4ac07ec6b38f0ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12ce199bc90144a09516854222520f12" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 42611 } } peers { permanent_uuid: "23a587816a6349a3a1ecdda42cd93152" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 45997 } } peers { permanent_uuid: "99e06e936b9648ddb4ac07ec6b38f0ab" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 39351 } }
I20260812 17:43:08.263715 26906 raft_consensus.cc:348] T a0a3cf0cea334d8ab294cd2482209187 P 23a587816a6349a3a1ecdda42cd93152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12ce199bc90144a09516854222520f12" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 42611 } } peers { permanent_uuid: "23a587816a6349a3a1ecdda42cd93152" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 45997 } } peers { permanent_uuid: "99e06e936b9648ddb4ac07ec6b38f0ab" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 39351 } }
I20260812 17:43:08.264019 26906 raft_consensus.cc:374] T a0a3cf0cea334d8ab294cd2482209187 P 23a587816a6349a3a1ecdda42cd93152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:08.264081 26906 raft_consensus.cc:729] T a0a3cf0cea334d8ab294cd2482209187 P 23a587816a6349a3a1ecdda42cd93152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23a587816a6349a3a1ecdda42cd93152, State: Initialized, Role: FOLLOWER
I20260812 17:43:08.264331 26877 heartbeater.cc:503] Master 127.17.255.62:33261 was elected leader, sending a full tablet report...
I20260812 17:43:08.264590 26904 ts_tablet_manager.cc:1428] T a0a3cf0cea334d8ab294cd2482209187 P 99e06e936b9648ddb4ac07ec6b38f0ab: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260812 17:43:08.264660 26906 consensus_queue.cc:260] T a0a3cf0cea334d8ab294cd2482209187 P 23a587816a6349a3a1ecdda42cd93152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12ce199bc90144a09516854222520f12" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 42611 } } peers { permanent_uuid: "23a587816a6349a3a1ecdda42cd93152" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 45997 } } peers { permanent_uuid: "99e06e936b9648ddb4ac07ec6b38f0ab" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 39351 } }
I20260812 17:43:08.265416 26497 heartbeater.cc:503] Master 127.17.255.62:33261 was elected leader, sending a full tablet report...
I20260812 17:43:08.265725 26906 ts_tablet_manager.cc:1428] T a0a3cf0cea334d8ab294cd2482209187 P 23a587816a6349a3a1ecdda42cd93152: Time spent starting tablet: real 0.007s user 0.003s sys 0.004s
I20260812 17:43:08.266271 26908 raft_consensus.cc:348] T a0a3cf0cea334d8ab294cd2482209187 P 12ce199bc90144a09516854222520f12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12ce199bc90144a09516854222520f12" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 42611 } } peers { permanent_uuid: "23a587816a6349a3a1ecdda42cd93152" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 45997 } } peers { permanent_uuid: "99e06e936b9648ddb4ac07ec6b38f0ab" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 39351 } }
I20260812 17:43:08.266580 26908 raft_consensus.cc:374] T a0a3cf0cea334d8ab294cd2482209187 P 12ce199bc90144a09516854222520f12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:08.266652 26908 raft_consensus.cc:729] T a0a3cf0cea334d8ab294cd2482209187 P 12ce199bc90144a09516854222520f12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12ce199bc90144a09516854222520f12, State: Initialized, Role: FOLLOWER
I20260812 17:43:08.267109 26908 consensus_queue.cc:260] T a0a3cf0cea334d8ab294cd2482209187 P 12ce199bc90144a09516854222520f12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12ce199bc90144a09516854222520f12" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 42611 } } peers { permanent_uuid: "23a587816a6349a3a1ecdda42cd93152" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 45997 } } peers { permanent_uuid: "99e06e936b9648ddb4ac07ec6b38f0ab" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 39351 } }
I20260812 17:43:08.267781 26689 heartbeater.cc:503] Master 127.17.255.62:33261 was elected leader, sending a full tablet report...
I20260812 17:43:08.268229 26908 ts_tablet_manager.cc:1428] T a0a3cf0cea334d8ab294cd2482209187 P 12ce199bc90144a09516854222520f12: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
W20260812 17:43:08.331943 26498 tablet.cc:2369] T a0a3cf0cea334d8ab294cd2482209187 P 23a587816a6349a3a1ecdda42cd93152: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 17:43:08.437579 26690 tablet.cc:2369] T a0a3cf0cea334d8ab294cd2482209187 P 12ce199bc90144a09516854222520f12: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 17:43:08.449247 26879 tablet.cc:2369] T a0a3cf0cea334d8ab294cd2482209187 P 99e06e936b9648ddb4ac07ec6b38f0ab: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 17:43:08.610620 26915 raft_consensus.cc:482] T a0a3cf0cea334d8ab294cd2482209187 P 23a587816a6349a3a1ecdda42cd93152 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:43:08.610917 26915 raft_consensus.cc:504] T a0a3cf0cea334d8ab294cd2482209187 P 23a587816a6349a3a1ecdda42cd93152 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12ce199bc90144a09516854222520f12" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 42611 } } peers { permanent_uuid: "23a587816a6349a3a1ecdda42cd93152" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 45997 } } peers { permanent_uuid: "99e06e936b9648ddb4ac07ec6b38f0ab" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 39351 } }
I20260812 17:43:08.612219 26915 leader_election.cc:288] T a0a3cf0cea334d8ab294cd2482209187 P 23a587816a6349a3a1ecdda42cd93152 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 12ce199bc90144a09516854222520f12 (127.17.255.2:42611), 99e06e936b9648ddb4ac07ec6b38f0ab (127.17.255.3:39351)
I20260812 17:43:08.614912 26897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:08.612837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:56111 (local address 127.17.255.2:42611)
0812 17:43:08.613032 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:08.613038 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:08.613235 (+ 197us) server_negotiation.cc:407] Connection header received
0812 17:43:08.613435 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:08.613438 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:08.613477 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:08.613573 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:08.614487 (+ 914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:08.614490 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:08.614492 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:43:08.614503 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:08.614524 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:43:08.614532 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:08.614636 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:08.614709 (+ 73us) server_negotiation.cc:299] Negotiation successful
0812 17:43:08.614757 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260812 17:43:08.614959 26917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:08.612718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:42611 (local address 127.17.255.1:56111)
0812 17:43:08.613126 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:08.613140 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:08.613282 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:08.613621 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:08.613624 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:08.613642 (+ 18us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:08.614251 (+ 609us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 17:43:08.614253 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:08.614267 (+ 14us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 17:43:08.614299 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:08.614623 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:08.614626 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:08.614630 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 17:43:08.614717 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 17:43:08.614757 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":181,"threads_started":1}
I20260812 17:43:08.615434 26903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:08.613482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:49147 (local address 127.17.255.3:39351)
0812 17:43:08.613650 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:08.613655 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:08.613833 (+ 178us) server_negotiation.cc:407] Connection header received
0812 17:43:08.613945 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:08.613949 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:08.613988 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:08.614078 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:08.614975 (+ 897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:08.614981 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:08.614985 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:43:08.614999 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:08.615028 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:43:08.615041 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:08.615139 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:08.615281 (+ 142us) server_negotiation.cc:299] Negotiation successful
0812 17:43:08.615329 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 17:43:08.615437 26919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:08.613308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.3:39351 (local address 127.17.255.1:49147)
0812 17:43:08.613732 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:08.613749 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:08.613853 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:08.614211 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:08.614216 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:08.614233 (+ 17us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:08.614800 (+ 567us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 17:43:08.614802 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:08.614812 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 17:43:08.614839 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:08.615180 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:08.615183 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:08.615185 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 17:43:08.615261 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 17:43:08.615302 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":112,"threads_started":1}
I20260812 17:43:08.615638 26615 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0a3cf0cea334d8ab294cd2482209187" candidate_uuid: "23a587816a6349a3a1ecdda42cd93152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12ce199bc90144a09516854222520f12" is_pre_election: true
I20260812 17:43:08.616019 26615 raft_consensus.cc:2454] T a0a3cf0cea334d8ab294cd2482209187 P 12ce199bc90144a09516854222520f12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23a587816a6349a3a1ecdda42cd93152 in term 0.
I20260812 17:43:08.616051 26815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0a3cf0cea334d8ab294cd2482209187" candidate_uuid: "23a587816a6349a3a1ecdda42cd93152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e06e936b9648ddb4ac07ec6b38f0ab" is_pre_election: true
I20260812 17:43:08.616420 26815 raft_consensus.cc:2454] T a0a3cf0cea334d8ab294cd2482209187 P 99e06e936b9648ddb4ac07ec6b38f0ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23a587816a6349a3a1ecdda42cd93152 in term 0.
I20260812 17:43:08.616547 26321 leader_election.cc:302] T a0a3cf0cea334d8ab294cd2482209187 P 23a587816a6349a3a1ecdda42cd93152 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12ce199bc90144a09516854222520f12, 23a587816a6349a3a1ecdda42cd93152; no voters:
I20260812 17:43:08.616882 26915 raft_consensus.cc:2781] T a0a3cf0cea334d8ab294cd2482209187 P 23a587816a6349a3a1ecdda42cd93152 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 17:43:08.616964 26915 raft_consensus.cc:482] T a0a3cf0cea334d8ab294cd2482209187 P 23a587816a6349a3a1ecdda42cd93152 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 17:43:08.616997 26915 raft_consensus.cc:3037] T a0a3cf0cea334d8ab294cd2482209187 P 23a587816a6349a3a1ecdda42cd93152 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:08.618273 26915 raft_consensus.cc:504] T a0a3cf0cea334d8ab294cd2482209187 P 23a587816a6349a3a1ecdda42cd93152 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12ce199bc90144a09516854222520f12" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 42611 } } peers { permanent_uuid: "23a587816a6349a3a1ecdda42cd93152" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 45997 } } peers { permanent_uuid: "99e06e936b9648ddb4ac07ec6b38f0ab" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 39351 } }
I20260812 17:43:08.618669 26915 leader_election.cc:288] T a0a3cf0cea334d8ab294cd2482209187 P 23a587816a6349a3a1ecdda42cd93152 [CANDIDATE]: Term 1 election: Requested vote from peers 12ce199bc90144a09516854222520f12 (127.17.255.2:42611), 99e06e936b9648ddb4ac07ec6b38f0ab (127.17.255.3:39351)
I20260812 17:43:08.619103 26615 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0a3cf0cea334d8ab294cd2482209187" candidate_uuid: "23a587816a6349a3a1ecdda42cd93152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12ce199bc90144a09516854222520f12"
I20260812 17:43:08.619128 26815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0a3cf0cea334d8ab294cd2482209187" candidate_uuid: "23a587816a6349a3a1ecdda42cd93152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99e06e936b9648ddb4ac07ec6b38f0ab"
I20260812 17:43:08.619248 26615 raft_consensus.cc:3037] T a0a3cf0cea334d8ab294cd2482209187 P 12ce199bc90144a09516854222520f12 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:08.619262 26815 raft_consensus.cc:3037] T a0a3cf0cea334d8ab294cd2482209187 P 99e06e936b9648ddb4ac07ec6b38f0ab [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:08.620414 26815 raft_consensus.cc:2454] T a0a3cf0cea334d8ab294cd2482209187 P 99e06e936b9648ddb4ac07ec6b38f0ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23a587816a6349a3a1ecdda42cd93152 in term 1.
I20260812 17:43:08.620416 26615 raft_consensus.cc:2454] T a0a3cf0cea334d8ab294cd2482209187 P 12ce199bc90144a09516854222520f12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23a587816a6349a3a1ecdda42cd93152 in term 1.
I20260812 17:43:08.620704 26321 leader_election.cc:302] T a0a3cf0cea334d8ab294cd2482209187 P 23a587816a6349a3a1ecdda42cd93152 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12ce199bc90144a09516854222520f12, 23a587816a6349a3a1ecdda42cd93152; no voters:
I20260812 17:43:08.620879 26915 raft_consensus.cc:2781] T a0a3cf0cea334d8ab294cd2482209187 P 23a587816a6349a3a1ecdda42cd93152 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:43:08.621146 26915 raft_consensus.cc:686] T a0a3cf0cea334d8ab294cd2482209187 P 23a587816a6349a3a1ecdda42cd93152 [term 1 LEADER]: Becoming Leader. State: Replica: 23a587816a6349a3a1ecdda42cd93152, State: Running, Role: LEADER
I20260812 17:43:08.621536 26915 consensus_queue.cc:237] T a0a3cf0cea334d8ab294cd2482209187 P 23a587816a6349a3a1ecdda42cd93152 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12ce199bc90144a09516854222520f12" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 42611 } } peers { permanent_uuid: "23a587816a6349a3a1ecdda42cd93152" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 45997 } } peers { permanent_uuid: "99e06e936b9648ddb4ac07ec6b38f0ab" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 39351 } }
I20260812 17:43:08.628690 26200 catalog_manager.cc:5495] T a0a3cf0cea334d8ab294cd2482209187 P 23a587816a6349a3a1ecdda42cd93152 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23a587816a6349a3a1ecdda42cd93152 (127.17.255.1). New cstate: current_term: 1 leader_uuid: "23a587816a6349a3a1ecdda42cd93152" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12ce199bc90144a09516854222520f12" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 42611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23a587816a6349a3a1ecdda42cd93152" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 45997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99e06e936b9648ddb4ac07ec6b38f0ab" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 39351 } health_report { overall_health: UNKNOWN } } }
I20260812 17:43:08.697142 26899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:08.695385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55244 (local address 127.17.255.1:45997)
0812 17:43:08.695573 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:08.695579 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:08.695595 (+ 16us) server_negotiation.cc:407] Connection header received
0812 17:43:08.695688 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:08.695690 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:08.695754 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:08.695851 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:08.696599 (+ 748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:08.696603 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:08.696605 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:43:08.696624 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:08.696642 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:43:08.696649 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:08.696746 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:08.696895 (+ 149us) server_negotiation.cc:299] Negotiation successful
0812 17:43:08.696955 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260812 17:43:08.704146 26815 raft_consensus.cc:1261] T a0a3cf0cea334d8ab294cd2482209187 P 99e06e936b9648ddb4ac07ec6b38f0ab [term 1 FOLLOWER]: Refusing update from remote peer 23a587816a6349a3a1ecdda42cd93152: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:43:08.704146 26615 raft_consensus.cc:1261] T a0a3cf0cea334d8ab294cd2482209187 P 12ce199bc90144a09516854222520f12 [term 1 FOLLOWER]: Refusing update from remote peer 23a587816a6349a3a1ecdda42cd93152: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:43:08.704959 26920 consensus_queue.cc:1035] T a0a3cf0cea334d8ab294cd2482209187 P 23a587816a6349a3a1ecdda42cd93152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ce199bc90144a09516854222520f12" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 42611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:43:08.705220 26915 consensus_queue.cc:1035] T a0a3cf0cea334d8ab294cd2482209187 P 23a587816a6349a3a1ecdda42cd93152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99e06e936b9648ddb4ac07ec6b38f0ab" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 39351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:43:08.716099 26924 mvcc.cc:205] Tried to move back new op lower bound from 7317735787322839040 to 7317735786997301248. Current Snapshot: MvccSnapshot[applied={T|T < 7317735787322839040}]
I20260812 17:43:08.722328 26199 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35730:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:43:08.722648 26199 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35730:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:43:08.725878 26199 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8e4a073186c248f082f25e8ae9e6abee: Sending DeleteTablet for 3 replicas of tablet a0a3cf0cea334d8ab294cd2482209187
I20260812 17:43:08.727037 26386 tablet_service.cc:1514] Processing DeleteTablet for tablet a0a3cf0cea334d8ab294cd2482209187 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:43:08 UTC) from {username='slave'} at 127.0.0.1:55230
I20260812 17:43:08.727028 26588 tablet_service.cc:1514] Processing DeleteTablet for tablet a0a3cf0cea334d8ab294cd2482209187 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:43:08 UTC) from {username='slave'} at 127.0.0.1:40290
I20260812 17:43:08.727182 26782 tablet_service.cc:1514] Processing DeleteTablet for tablet a0a3cf0cea334d8ab294cd2482209187 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:43:08 UTC) from {username='slave'} at 127.0.0.1:48340
I20260812 17:43:08.727653 26945 tablet_replica.cc:330] T a0a3cf0cea334d8ab294cd2482209187 P 99e06e936b9648ddb4ac07ec6b38f0ab: stopping tablet replica
I20260812 17:43:08.728089 26945 raft_consensus.cc:2229] T a0a3cf0cea334d8ab294cd2482209187 P 99e06e936b9648ddb4ac07ec6b38f0ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:43:08.728403 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 26299
I20260812 17:43:08.728586 26945 raft_consensus.cc:2258] T a0a3cf0cea334d8ab294cd2482209187 P 99e06e936b9648ddb4ac07ec6b38f0ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:43:08.730413 26945 ts_tablet_manager.cc:1905] T a0a3cf0cea334d8ab294cd2482209187 P 99e06e936b9648ddb4ac07ec6b38f0ab: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:43:08.734333 26945 ts_tablet_manager.cc:1918] T a0a3cf0cea334d8ab294cd2482209187 P 99e06e936b9648ddb4ac07ec6b38f0ab: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 17:43:08.734512 26945 log.cc:1196] T a0a3cf0cea334d8ab294cd2482209187 P 99e06e936b9648ddb4ac07ec6b38f0ab: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-2/wal/wals/a0a3cf0cea334d8ab294cd2482209187
I20260812 17:43:08.734902 26945 ts_tablet_manager.cc:1939] T a0a3cf0cea334d8ab294cd2482209187 P 99e06e936b9648ddb4ac07ec6b38f0ab: Deleting consensus metadata
I20260812 17:43:08.736797 26178 catalog_manager.cc:4841] TS 99e06e936b9648ddb4ac07ec6b38f0ab (127.17.255.3:39351): tablet a0a3cf0cea334d8ab294cd2482209187 (table test-table [id=77be61750460463180ad82dabd3b0c50]) successfully deleted
I20260812 17:43:08.742252 26943 tablet_replica.cc:330] T a0a3cf0cea334d8ab294cd2482209187 P 12ce199bc90144a09516854222520f12: stopping tablet replica
I20260812 17:43:08.742810 26943 raft_consensus.cc:2229] T a0a3cf0cea334d8ab294cd2482209187 P 12ce199bc90144a09516854222520f12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:43:08.743233 26943 raft_consensus.cc:2258] T a0a3cf0cea334d8ab294cd2482209187 P 12ce199bc90144a09516854222520f12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:43:08.744881 26943 ts_tablet_manager.cc:1905] T a0a3cf0cea334d8ab294cd2482209187 P 12ce199bc90144a09516854222520f12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:43:08.747403 26943 ts_tablet_manager.cc:1918] T a0a3cf0cea334d8ab294cd2482209187 P 12ce199bc90144a09516854222520f12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 17:43:08.747545 26943 log.cc:1196] T a0a3cf0cea334d8ab294cd2482209187 P 12ce199bc90144a09516854222520f12: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786556557564181-18428-0/minicluster-data/ts-1/wal/wals/a0a3cf0cea334d8ab294cd2482209187
I20260812 17:43:08.747869 26943 ts_tablet_manager.cc:1939] T a0a3cf0cea334d8ab294cd2482209187 P 12ce199bc90144a09516854222520f12: Deleting consensus metadata
I20260812 17:43:08.749045 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 26502
W20260812 17:43:08.749105 26179 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.255.1:45997 (error 108)
I20260812 17:43:08.762876 26948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:08.760982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:45997 (local address 127.0.0.1:55256)
0812 17:43:08.762677 (+ 1695us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:08.762768 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.1:45997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1583,"thread_start_us":1333,"threads_started":1}
W20260812 17:43:08.763197 26179 catalog_manager.cc:4584] TS 23a587816a6349a3a1ecdda42cd93152 (127.17.255.1:45997): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a0a3cf0cea334d8ab294cd2482209187: Network error: Client connection negotiation failed: client connection to 127.17.255.1:45997: connect: Connection refused (error 111)
I20260812 17:43:08.769703 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 26692
I20260812 17:43:08.784504 26948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:08.770069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:42611 (local address 127.0.0.1:40306)
0812 17:43:08.784311 (+ 14242us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:08.784395 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.2:42611: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":14083}
I20260812 17:43:08.791213 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 26152
2026-08-12T17:43:08Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (2005 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260812 17:43:08.823071 18428 mini_oidc.cc:152] Starting JWKS server
I20260812 17:43:08.825018 18428 webserver.cc:460] Webserver started at https://127.0.0.1:39655/ using document root <none> and password file <none>
I20260812 17:43:08.825214 18428 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 17:43:08.825531 18428 webserver.cc:460] Webserver started at http://127.0.0.1:45609/ using document root <none> and password file <none>
2026-08-12T17:43:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:43:08Z Disabled control of system clock
I20260812 17:43:08.837615 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:37225
--webserver_interface=127.17.255.62
--webserver_port=0
--builtin_ntp_servers=127.17.255.20:35653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:37225
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39655/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786556557564181-18428-0/testchainca.cert with env {}
W20260812 17:43:08.959996 26954 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:08.960325 26954 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:08.960368 26954 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:08.964689 26954 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:43:08.964767 26954 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:08.964783 26954 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:08.964802 26954 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:43:08.964818 26954 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 17:43:08.964834 26954 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 17:43:08.964876 26954 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39655/jwks.json
I20260812 17:43:08.970746 26954 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:35653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:37225
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:37225
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39655/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786556557564181-18428-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26954
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:08.971977 26954 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:08.973109 26954 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:08.982491 26964 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:08.982503 26967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:08.982528 26962 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:08.982889 26954 server_base.cc:1034] running on GCE node
I20260812 17:43:08.983549 26954 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:08.984743 26954 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:08.985945 26954 hybrid_clock.cc:648] HybridClock initialized: now 1786556588985931 us; error 36 us; skew 500 ppm
I20260812 17:43:08.988140 26954 webserver.cc:460] Webserver started at http://127.17.255.62:37719/ using document root <none> and password file <none>
I20260812 17:43:08.988797 26954 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:08.988902 26954 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:08.989156 26954 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:08.991562 26954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "d722e493f8f6497c8a698cce3498c2f4"
format_stamp: "Formatted at 2026-08-12 17:43:08 on dist-test-slave-tk9z"
server_key: "641b68bfefb1b855ca40cc5b29a5a8ae"
server_key_iv: "60af198b50b445e52aca6f97fce01f74"
server_key_version: "encryptionkey@0"
I20260812 17:43:08.992199 26954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "d722e493f8f6497c8a698cce3498c2f4"
format_stamp: "Formatted at 2026-08-12 17:43:08 on dist-test-slave-tk9z"
server_key: "641b68bfefb1b855ca40cc5b29a5a8ae"
server_key_iv: "60af198b50b445e52aca6f97fce01f74"
server_key_version: "encryptionkey@0"
I20260812 17:43:08.996397 26954 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 17:43:08.999125 26973 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:09.000526 26954 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:43:09.000707 26954 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "d722e493f8f6497c8a698cce3498c2f4"
format_stamp: "Formatted at 2026-08-12 17:43:08 on dist-test-slave-tk9z"
server_key: "641b68bfefb1b855ca40cc5b29a5a8ae"
server_key_iv: "60af198b50b445e52aca6f97fce01f74"
server_key_version: "encryptionkey@0"
I20260812 17:43:09.000844 26954 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:09.025991 26954 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:09.026868 26954 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:09.027088 26954 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:09.034727 26954 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:37225
I20260812 17:43:09.034778 27058 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:37225 every 8 connection(s)
I20260812 17:43:09.035880 26954 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:43:09.039685 27060 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:09.045297 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 26954
I20260812 17:43:09.045482 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:43:09.045770 18428 external_mini_cluster.cc:1428] Setting key 4e314295c59b927fe06ae671038f8284
I20260812 17:43:09.045985 27060 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d722e493f8f6497c8a698cce3498c2f4: Bootstrap starting.
I20260812 17:43:09.048916 27060 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d722e493f8f6497c8a698cce3498c2f4: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:09.049744 27060 log.cc:824] T 00000000000000000000000000000000 P d722e493f8f6497c8a698cce3498c2f4: Log is configured to *not* fsync() on all Append() calls
I20260812 17:43:09.052042 27060 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d722e493f8f6497c8a698cce3498c2f4: No bootstrap required, opened a new log
I20260812 17:43:09.055943 27064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:09.047212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36174 (local address 127.17.255.62:37225)
0812 17:43:09.047978 (+ 766us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:09.047994 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:09.048033 (+ 39us) server_negotiation.cc:407] Connection header received
0812 17:43:09.048697 (+ 664us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:09.048722 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:09.049222 (+ 500us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:09.049593 (+ 371us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:09.050098 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:09.051326 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:09.052301 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:09.052806 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:09.052997 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:09.053908 (+ 911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:09.053913 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:09.053929 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:43:09.054348 (+ 419us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:09.054477 (+ 129us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:43:09.054501 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:09.054616 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:09.054744 (+ 128us) server_negotiation.cc:299] Negotiation successful
0812 17:43:09.055051 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":157,"threads_started":1}
I20260812 17:43:09.056226 27060 raft_consensus.cc:348] T 00000000000000000000000000000000 P d722e493f8f6497c8a698cce3498c2f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d722e493f8f6497c8a698cce3498c2f4" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 37225 } }
I20260812 17:43:09.056555 27060 raft_consensus.cc:374] T 00000000000000000000000000000000 P d722e493f8f6497c8a698cce3498c2f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:09.056613 27060 raft_consensus.cc:729] T 00000000000000000000000000000000 P d722e493f8f6497c8a698cce3498c2f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d722e493f8f6497c8a698cce3498c2f4, State: Initialized, Role: FOLLOWER
I20260812 17:43:09.057127 27060 consensus_queue.cc:260] T 00000000000000000000000000000000 P d722e493f8f6497c8a698cce3498c2f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d722e493f8f6497c8a698cce3498c2f4" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 37225 } }
I20260812 17:43:09.057333 27060 raft_consensus.cc:388] T 00000000000000000000000000000000 P d722e493f8f6497c8a698cce3498c2f4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:43:09.057410 27060 raft_consensus.cc:482] T 00000000000000000000000000000000 P d722e493f8f6497c8a698cce3498c2f4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:43:09.057543 27060 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d722e493f8f6497c8a698cce3498c2f4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:09.058928 27060 raft_consensus.cc:504] T 00000000000000000000000000000000 P d722e493f8f6497c8a698cce3498c2f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d722e493f8f6497c8a698cce3498c2f4" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 37225 } }
I20260812 17:43:09.059340 27060 leader_election.cc:302] T 00000000000000000000000000000000 P d722e493f8f6497c8a698cce3498c2f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d722e493f8f6497c8a698cce3498c2f4; no voters:
I20260812 17:43:09.059600 18428 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 17:43:09.059782 27060 leader_election.cc:288] T 00000000000000000000000000000000 P d722e493f8f6497c8a698cce3498c2f4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:43:09.059878 27066 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d722e493f8f6497c8a698cce3498c2f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:43:09.060143 27066 raft_consensus.cc:686] T 00000000000000000000000000000000 P d722e493f8f6497c8a698cce3498c2f4 [term 1 LEADER]: Becoming Leader. State: Replica: d722e493f8f6497c8a698cce3498c2f4, State: Running, Role: LEADER
I20260812 17:43:09.060583 27066 consensus_queue.cc:237] T 00000000000000000000000000000000 P d722e493f8f6497c8a698cce3498c2f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d722e493f8f6497c8a698cce3498c2f4" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 37225 } }
I20260812 17:43:09.061309 27060 sys_catalog.cc:564] T 00000000000000000000000000000000 P d722e493f8f6497c8a698cce3498c2f4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:43:09.061949 27066 sys_catalog.cc:455] T 00000000000000000000000000000000 P d722e493f8f6497c8a698cce3498c2f4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d722e493f8f6497c8a698cce3498c2f4. Latest consensus state: current_term: 1 leader_uuid: "d722e493f8f6497c8a698cce3498c2f4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d722e493f8f6497c8a698cce3498c2f4" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 37225 } } }
I20260812 17:43:09.062079 27066 sys_catalog.cc:458] T 00000000000000000000000000000000 P d722e493f8f6497c8a698cce3498c2f4 [sys.catalog]: This master's current role is: LEADER
I20260812 17:43:09.062601 27067 sys_catalog.cc:455] T 00000000000000000000000000000000 P d722e493f8f6497c8a698cce3498c2f4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d722e493f8f6497c8a698cce3498c2f4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d722e493f8f6497c8a698cce3498c2f4" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 37225 } } }
I20260812 17:43:09.062752 27067 sys_catalog.cc:458] T 00000000000000000000000000000000 P d722e493f8f6497c8a698cce3498c2f4 [sys.catalog]: This master's current role is: LEADER
I20260812 17:43:09.064003 27074 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:43:09.067181 27074 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:43:09.073110 27074 catalog_manager.cc:1347] Generated new cluster ID: fb2aac6144624f0e94347d19538e7746
I20260812 17:43:09.073194 27074 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:43:09.101933 27074 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:43:09.103516 27074 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:43:09.110656 27074 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d722e493f8f6497c8a698cce3498c2f4: Generated new TSK 0
I20260812 17:43:09.111575 27074 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260812 17:43:09.150166 27102 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260812 17:43:09.150406 27102 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260812 17:43:09.151067 27064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:09.126225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36178 (local address 127.17.255.62:37225)
0812 17:43:09.126411 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:09.126416 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:09.126635 (+ 219us) server_negotiation.cc:407] Connection header received
0812 17:43:09.126942 (+ 307us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:09.126945 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:09.127007 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:09.127113 (+ 106us) server_negotiation.cc:226] Negotiated authn=JWT
0812 17:43:09.127456 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:09.128029 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:09.129306 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:09.129537 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:09.129623 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:09.130044 (+ 421us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 17:43:09.150664 (+ 20620us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39655/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0812 17:43:09.150938 (+ 274us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36178: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39655/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":70}
W20260812 17:43:09.151185 27064 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36178: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39655/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260812 17:43:09.152921 27101 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:09.126126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:37225 (local address 127.0.0.1:36178)
0812 17:43:09.126534 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:09.126551 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:09.126698 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:09.127154 (+ 456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:09.127157 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:09.127171 (+ 14us) client_negotiation.cc:189] Negotiated authn=JWT
0812 17:43:09.127308 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:09.127315 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:09.128145 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:09.128149 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:09.129168 (+ 1019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:09.129179 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:09.129662 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:09.129666 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:09.129760 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:09.129823 (+ 63us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 17:43:09.150974 (+ 21151us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39655/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0812 17:43:09.151266 (+ 292us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.17.255.62:37225: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39655/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":124,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.17.255.62:37225: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39655/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260812 17:43:09.153788 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 26954
2026-08-12T17:43:09Z chronyd exiting
I20260812 17:43:09.209651 18428 test_util.cc:175] -----------------------------------------------
I20260812 17:43:09.209758 18428 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786556557564181-18428-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (388 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260812 17:43:09.211088 18428 mini_oidc.cc:152] Starting JWKS server
I20260812 17:43:09.211952 18428 webserver.cc:460] Webserver started at https://127.0.0.1:33557/ using document root <none> and password file <none>
I20260812 17:43:09.212054 18428 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 17:43:09.212267 18428 webserver.cc:460] Webserver started at http://127.0.0.1:37001/ using document root <none> and password file <none>
2026-08-12T17:43:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:43:09Z Disabled control of system clock
I20260812 17:43:09.223469 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:36199
--webserver_interface=127.17.255.62
--webserver_port=0
--builtin_ntp_servers=127.17.255.20:39857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:36199
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33557/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786556557564181-18428-0/testchainca.cert with env {}
W20260812 17:43:09.339823 27113 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:09.340134 27113 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:09.340209 27113 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:09.344234 27113 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:43:09.344340 27113 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:09.344372 27113 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:09.344412 27113 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:43:09.344444 27113 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 17:43:09.344481 27113 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 17:43:09.344515 27113 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:33557/jwks.json
I20260812 17:43:09.349872 27113 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:39857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:36199
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:36199
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33557/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786556557564181-18428-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27113
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:09.351051 27113 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:09.352115 27113 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:09.361043 27119 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:09.361043 27120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:09.361176 27122 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:09.361486 27113 server_base.cc:1034] running on GCE node
I20260812 17:43:09.362155 27113 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:09.363370 27113 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:09.364565 27113 hybrid_clock.cc:648] HybridClock initialized: now 1786556589364526 us; error 52 us; skew 500 ppm
I20260812 17:43:09.366971 27113 webserver.cc:460] Webserver started at http://127.17.255.62:36007/ using document root <none> and password file <none>
I20260812 17:43:09.367659 27113 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:09.367734 27113 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:09.367992 27113 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:09.370538 27113 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "26d9717a460448118f77912afeedf9b6"
format_stamp: "Formatted at 2026-08-12 17:43:09 on dist-test-slave-tk9z"
server_key: "e637acdb2ad94d68d19fec27f00256cc"
server_key_iv: "a3f1cf1245ffc9bd2febc799b4670633"
server_key_version: "encryptionkey@0"
I20260812 17:43:09.371285 27113 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "26d9717a460448118f77912afeedf9b6"
format_stamp: "Formatted at 2026-08-12 17:43:09 on dist-test-slave-tk9z"
server_key: "e637acdb2ad94d68d19fec27f00256cc"
server_key_iv: "a3f1cf1245ffc9bd2febc799b4670633"
server_key_version: "encryptionkey@0"
I20260812 17:43:09.375756 27113 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 17:43:09.378506 27132 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:09.379874 27113 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:43:09.380040 27113 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "26d9717a460448118f77912afeedf9b6"
format_stamp: "Formatted at 2026-08-12 17:43:09 on dist-test-slave-tk9z"
server_key: "e637acdb2ad94d68d19fec27f00256cc"
server_key_iv: "a3f1cf1245ffc9bd2febc799b4670633"
server_key_version: "encryptionkey@0"
I20260812 17:43:09.380168 27113 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:09.398249 27113 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:09.399101 27113 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:09.399323 27113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:09.406822 27113 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:36199
I20260812 17:43:09.406832 27210 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:36199 every 8 connection(s)
I20260812 17:43:09.407891 27113 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:43:09.410159 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 27113
I20260812 17:43:09.410310 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:43:09.410701 18428 external_mini_cluster.cc:1428] Setting key cc1d86f100f36742fbb5c60dda287ce6
I20260812 17:43:09.411835 27212 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:09.418603 27212 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26d9717a460448118f77912afeedf9b6: Bootstrap starting.
I20260812 17:43:09.420356 27216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:09.412118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39350 (local address 127.17.255.62:36199)
0812 17:43:09.412869 (+ 751us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:09.412887 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:09.412928 (+ 41us) server_negotiation.cc:407] Connection header received
0812 17:43:09.413627 (+ 699us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:09.413645 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:09.414051 (+ 406us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:09.414338 (+ 287us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:09.414760 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:09.415726 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:09.416940 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:09.417431 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:09.417555 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:09.418513 (+ 958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:09.418518 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:09.418532 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:43:09.418991 (+ 459us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:09.419051 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:43:09.419074 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:09.419151 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:09.419328 (+ 177us) server_negotiation.cc:299] Negotiation successful
0812 17:43:09.419626 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":135,"threads_started":1}
I20260812 17:43:09.421286 27212 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 26d9717a460448118f77912afeedf9b6: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:09.422055 27212 log.cc:824] T 00000000000000000000000000000000 P 26d9717a460448118f77912afeedf9b6: Log is configured to *not* fsync() on all Append() calls
I20260812 17:43:09.423447 18428 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 17:43:09.424242 27212 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26d9717a460448118f77912afeedf9b6: No bootstrap required, opened a new log
I20260812 17:43:09.428002 27212 raft_consensus.cc:348] T 00000000000000000000000000000000 P 26d9717a460448118f77912afeedf9b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26d9717a460448118f77912afeedf9b6" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 36199 } }
I20260812 17:43:09.428246 27212 raft_consensus.cc:374] T 00000000000000000000000000000000 P 26d9717a460448118f77912afeedf9b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:09.428290 27212 raft_consensus.cc:729] T 00000000000000000000000000000000 P 26d9717a460448118f77912afeedf9b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26d9717a460448118f77912afeedf9b6, State: Initialized, Role: FOLLOWER
I20260812 17:43:09.428743 27212 consensus_queue.cc:260] T 00000000000000000000000000000000 P 26d9717a460448118f77912afeedf9b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26d9717a460448118f77912afeedf9b6" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 36199 } }
I20260812 17:43:09.428879 27212 raft_consensus.cc:388] T 00000000000000000000000000000000 P 26d9717a460448118f77912afeedf9b6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:43:09.428929 27212 raft_consensus.cc:482] T 00000000000000000000000000000000 P 26d9717a460448118f77912afeedf9b6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:43:09.429011 27212 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 26d9717a460448118f77912afeedf9b6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:09.429986 27212 raft_consensus.cc:504] T 00000000000000000000000000000000 P 26d9717a460448118f77912afeedf9b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26d9717a460448118f77912afeedf9b6" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 36199 } }
I20260812 17:43:09.430331 27212 leader_election.cc:302] T 00000000000000000000000000000000 P 26d9717a460448118f77912afeedf9b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 26d9717a460448118f77912afeedf9b6; no voters:
I20260812 17:43:09.430801 27212 leader_election.cc:288] T 00000000000000000000000000000000 P 26d9717a460448118f77912afeedf9b6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:43:09.430925 27219 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 26d9717a460448118f77912afeedf9b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:43:09.431118 27219 raft_consensus.cc:686] T 00000000000000000000000000000000 P 26d9717a460448118f77912afeedf9b6 [term 1 LEADER]: Becoming Leader. State: Replica: 26d9717a460448118f77912afeedf9b6, State: Running, Role: LEADER
I20260812 17:43:09.431444 27219 consensus_queue.cc:237] T 00000000000000000000000000000000 P 26d9717a460448118f77912afeedf9b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26d9717a460448118f77912afeedf9b6" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 36199 } }
I20260812 17:43:09.432260 27212 sys_catalog.cc:564] T 00000000000000000000000000000000 P 26d9717a460448118f77912afeedf9b6 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:43:09.433315 27222 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26d9717a460448118f77912afeedf9b6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 26d9717a460448118f77912afeedf9b6. Latest consensus state: current_term: 1 leader_uuid: "26d9717a460448118f77912afeedf9b6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26d9717a460448118f77912afeedf9b6" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 36199 } } }
I20260812 17:43:09.433378 27221 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26d9717a460448118f77912afeedf9b6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "26d9717a460448118f77912afeedf9b6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26d9717a460448118f77912afeedf9b6" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 36199 } } }
I20260812 17:43:09.433557 27221 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26d9717a460448118f77912afeedf9b6 [sys.catalog]: This master's current role is: LEADER
I20260812 17:43:09.433590 27222 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26d9717a460448118f77912afeedf9b6 [sys.catalog]: This master's current role is: LEADER
I20260812 17:43:09.434981 27233 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:43:09.438817 27233 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:43:09.445652 27233 catalog_manager.cc:1347] Generated new cluster ID: 7a8c06be12e942f9b1676ae74d066134
I20260812 17:43:09.445744 27233 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:43:09.471227 27233 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:43:09.472602 27233 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:43:09.485562 27233 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 26d9717a460448118f77912afeedf9b6: Generated new TSK 0
I20260812 17:43:09.486537 27233 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260812 17:43:09.522003 27258 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260812 17:43:09.522104 27258 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260812 17:43:09.522831 27216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:09.499467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39354 (local address 127.17.255.62:36199)
0812 17:43:09.499619 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:09.499624 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:09.499639 (+ 15us) server_negotiation.cc:407] Connection header received
0812 17:43:09.499749 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:09.499752 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:09.499805 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:09.499934 (+ 129us) server_negotiation.cc:226] Negotiated authn=JWT
0812 17:43:09.500192 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:09.500775 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:09.502113 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:09.502334 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:09.502502 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:09.502836 (+ 334us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 17:43:09.522446 (+ 19610us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33557/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0812 17:43:09.522716 (+ 270us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:39354: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33557/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":44}
W20260812 17:43:09.522930 27216 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:39354: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33557/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260812 17:43:09.523078 27257 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:09.499004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:36199 (local address 127.0.0.1:39354)
0812 17:43:09.499492 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:09.499507 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:09.499619 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:09.499931 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:09.499934 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:09.499942 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0812 17:43:09.500070 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:09.500077 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:09.500901 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:09.500905 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:09.501981 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:09.501993 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:09.502536 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:09.502540 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:09.502631 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:09.502661 (+ 30us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 17:43:09.522677 (+ 20016us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33557/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0812 17:43:09.522890 (+ 213us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.17.255.62:36199: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33557/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":111,"threads_started":1}
I20260812 17:43:09.523808 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 27113
2026-08-12T17:43:09Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (367 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260812 17:43:09.578190 18428 mini_oidc.cc:152] Starting JWKS server
I20260812 17:43:09.579181 18428 webserver.cc:460] Webserver started at https://127.0.0.1:36843/ using document root <none> and password file <none>
I20260812 17:43:09.579269 18428 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 17:43:09.579480 18428 webserver.cc:460] Webserver started at http://127.0.0.1:39169/ using document root <none> and password file <none>
2026-08-12T17:43:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:43:09Z Disabled control of system clock
I20260812 17:43:09.590265 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:35795
--webserver_interface=127.17.255.62
--webserver_port=0
--builtin_ntp_servers=127.17.255.20:43721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:35795
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36843/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260812 17:43:09.708084 27268 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:09.708375 27268 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:09.708415 27268 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:09.712551 27268 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:43:09.712612 27268 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:09.712634 27268 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:09.712651 27268 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:43:09.712692 27268 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 17:43:09.712724 27268 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 17:43:09.712744 27268 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:36843/jwks.json
I20260812 17:43:09.717712 27268 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:43721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:35795
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:35795
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36843/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27268
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:09.718988 27268 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:09.720484 27268 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:09.729192 27276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:09.729218 27283 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:09.729184 27278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:09.729748 27268 server_base.cc:1034] running on GCE node
I20260812 17:43:09.730319 27268 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:09.731469 27268 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:09.732649 27268 hybrid_clock.cc:648] HybridClock initialized: now 1786556589732623 us; error 40 us; skew 500 ppm
I20260812 17:43:09.734905 27268 webserver.cc:460] Webserver started at http://127.17.255.62:39141/ using document root <none> and password file <none>
I20260812 17:43:09.735565 27268 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:09.735634 27268 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:09.735885 27268 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:09.738051 27268 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "84045f01db9a46279e211a8099464734"
format_stamp: "Formatted at 2026-08-12 17:43:09 on dist-test-slave-tk9z"
server_key: "3a5f53aceafe42aa4a280d48fea1c0e0"
server_key_iv: "2d3cbbbf003bb15a9b24daad98bb5e23"
server_key_version: "encryptionkey@0"
I20260812 17:43:09.738780 27268 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "84045f01db9a46279e211a8099464734"
format_stamp: "Formatted at 2026-08-12 17:43:09 on dist-test-slave-tk9z"
server_key: "3a5f53aceafe42aa4a280d48fea1c0e0"
server_key_iv: "2d3cbbbf003bb15a9b24daad98bb5e23"
server_key_version: "encryptionkey@0"
I20260812 17:43:09.742799 27268 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 17:43:09.745573 27292 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:09.747017 27268 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:43:09.747182 27268 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "84045f01db9a46279e211a8099464734"
format_stamp: "Formatted at 2026-08-12 17:43:09 on dist-test-slave-tk9z"
server_key: "3a5f53aceafe42aa4a280d48fea1c0e0"
server_key_iv: "2d3cbbbf003bb15a9b24daad98bb5e23"
server_key_version: "encryptionkey@0"
I20260812 17:43:09.747331 27268 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:09.764467 27268 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:09.765342 27268 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:09.765592 27268 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:09.773538 27268 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:35795
I20260812 17:43:09.773586 27370 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:35795 every 8 connection(s)
I20260812 17:43:09.774655 27268 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:43:09.776856 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 27268
I20260812 17:43:09.777020 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:43:09.777331 18428 external_mini_cluster.cc:1428] Setting key 10757986c0d4688060022762d48beaca
I20260812 17:43:09.778995 27371 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:09.786429 27371 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84045f01db9a46279e211a8099464734: Bootstrap starting.
I20260812 17:43:09.787860 27374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:09.778874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35570 (local address 127.17.255.62:35795)
0812 17:43:09.779643 (+ 769us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:09.779660 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:09.779714 (+ 54us) server_negotiation.cc:407] Connection header received
0812 17:43:09.780416 (+ 702us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:09.780434 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:09.780848 (+ 414us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:09.781150 (+ 302us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:09.781549 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:09.782639 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:09.783991 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:09.784525 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:09.784668 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:09.785704 (+ 1036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:09.785710 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:09.785727 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:43:09.786192 (+ 465us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:09.786274 (+ 82us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:43:09.786300 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:09.786542 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:09.786641 (+ 99us) server_negotiation.cc:299] Negotiation successful
0812 17:43:09.786996 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":164,"threads_started":1}
I20260812 17:43:09.789042 27371 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 84045f01db9a46279e211a8099464734: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:09.789902 27371 log.cc:824] T 00000000000000000000000000000000 P 84045f01db9a46279e211a8099464734: Log is configured to *not* fsync() on all Append() calls
I20260812 17:43:09.791342 18428 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 17:43:09.792738 27371 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84045f01db9a46279e211a8099464734: No bootstrap required, opened a new log
I20260812 17:43:09.796514 27371 raft_consensus.cc:348] T 00000000000000000000000000000000 P 84045f01db9a46279e211a8099464734 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84045f01db9a46279e211a8099464734" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 35795 } }
I20260812 17:43:09.796761 27371 raft_consensus.cc:374] T 00000000000000000000000000000000 P 84045f01db9a46279e211a8099464734 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:09.796825 27371 raft_consensus.cc:729] T 00000000000000000000000000000000 P 84045f01db9a46279e211a8099464734 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84045f01db9a46279e211a8099464734, State: Initialized, Role: FOLLOWER
I20260812 17:43:09.797330 27371 consensus_queue.cc:260] T 00000000000000000000000000000000 P 84045f01db9a46279e211a8099464734 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84045f01db9a46279e211a8099464734" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 35795 } }
I20260812 17:43:09.797472 27371 raft_consensus.cc:388] T 00000000000000000000000000000000 P 84045f01db9a46279e211a8099464734 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:43:09.797539 27371 raft_consensus.cc:482] T 00000000000000000000000000000000 P 84045f01db9a46279e211a8099464734 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:43:09.797647 27371 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 84045f01db9a46279e211a8099464734 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:09.798820 27371 raft_consensus.cc:504] T 00000000000000000000000000000000 P 84045f01db9a46279e211a8099464734 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84045f01db9a46279e211a8099464734" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 35795 } }
I20260812 17:43:09.799187 27371 leader_election.cc:302] T 00000000000000000000000000000000 P 84045f01db9a46279e211a8099464734 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 84045f01db9a46279e211a8099464734; no voters:
I20260812 17:43:09.799530 27371 leader_election.cc:288] T 00000000000000000000000000000000 P 84045f01db9a46279e211a8099464734 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:43:09.799690 27377 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 84045f01db9a46279e211a8099464734 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:43:09.799934 27377 raft_consensus.cc:686] T 00000000000000000000000000000000 P 84045f01db9a46279e211a8099464734 [term 1 LEADER]: Becoming Leader. State: Replica: 84045f01db9a46279e211a8099464734, State: Running, Role: LEADER
I20260812 17:43:09.800261 27377 consensus_queue.cc:237] T 00000000000000000000000000000000 P 84045f01db9a46279e211a8099464734 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84045f01db9a46279e211a8099464734" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 35795 } }
I20260812 17:43:09.800796 27371 sys_catalog.cc:564] T 00000000000000000000000000000000 P 84045f01db9a46279e211a8099464734 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:43:09.802045 27380 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84045f01db9a46279e211a8099464734 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 84045f01db9a46279e211a8099464734. Latest consensus state: current_term: 1 leader_uuid: "84045f01db9a46279e211a8099464734" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84045f01db9a46279e211a8099464734" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 35795 } } }
I20260812 17:43:09.802196 27380 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84045f01db9a46279e211a8099464734 [sys.catalog]: This master's current role is: LEADER
I20260812 17:43:09.802423 27378 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84045f01db9a46279e211a8099464734 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "84045f01db9a46279e211a8099464734" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84045f01db9a46279e211a8099464734" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 35795 } } }
I20260812 17:43:09.802577 27378 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84045f01db9a46279e211a8099464734 [sys.catalog]: This master's current role is: LEADER
I20260812 17:43:09.802666 27393 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:43:09.805817 27393 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:43:09.811344 27393 catalog_manager.cc:1347] Generated new cluster ID: 19f17a1b47354e8c8217c6a04c278462
I20260812 17:43:09.811424 27393 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:43:09.836305 27393 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:43:09.837707 27393 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:43:09.846658 27393 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 84045f01db9a46279e211a8099464734: Generated new TSK 0
I20260812 17:43:09.847497 27393 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 17:43:09.860733 27374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:09.855494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35574 (local address 127.17.255.62:35795)
0812 17:43:09.855636 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:09.855641 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:09.855809 (+ 168us) server_negotiation.cc:407] Connection header received
0812 17:43:09.856012 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:09.856016 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:09.856073 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:09.856191 (+ 118us) server_negotiation.cc:226] Negotiated authn=JWT
0812 17:43:09.856486 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:09.857028 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:09.858286 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:09.858579 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:09.858662 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:09.859032 (+ 370us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 17:43:09.860326 (+ 1294us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36843/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0812 17:43:09.860610 (+ 284us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:35574: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36843/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":57}
W20260812 17:43:09.860831 27374 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:35574: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36843/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260812 17:43:09.863581 27412 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:09.855348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35795 (local address 127.0.0.1:35574)
0812 17:43:09.855690 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:09.855705 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:09.855832 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:09.856213 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:09.856216 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:09.856224 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0812 17:43:09.856343 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:09.856350 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:09.857153 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:09.857156 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:09.858163 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:09.858174 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:09.858707 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:09.858712 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:09.858807 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:09.858839 (+ 32us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 17:43:09.860512 (+ 1673us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36843/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0812 17:43:09.863428 (+ 2916us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.17.255.62:35795: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36843/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":249,"mutex_wait_us":2728,"thread_start_us":117,"threads_started":1}
I20260812 17:43:09.864293 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 27268
E20260812 17:43:09.891229 27413 webserver.cc:533] Webserver: sslize failed:
E20260812 17:43:09.891322 27413 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-12T17:43:09Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (345 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-12T17:43:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:43:09Z Disabled control of system clock
I20260812 17:43:09.934242 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:45611
--webserver_interface=127.17.255.62
--webserver_port=0
--builtin_ntp_servers=127.17.255.20:36467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:45611
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786556557564181-18428-0/testchainca.cert with env {}
W20260812 17:43:10.054072 27418 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:10.054420 27418 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:10.054473 27418 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:10.058666 27418 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:43:10.058763 27418 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:10.058779 27418 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:10.058796 27418 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:43:10.058811 27418 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 17:43:10.058828 27418 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 17:43:10.058842 27418 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260812 17:43:10.064842 27418 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:36467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:45611
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:45611
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786556557564181-18428-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27418
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:10.066084 27418 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:10.067234 27418 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:10.076509 27426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:10.076529 27428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:10.076516 27425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:10.077181 27418 server_base.cc:1034] running on GCE node
I20260812 17:43:10.077818 27418 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:10.079190 27418 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:10.080415 27418 hybrid_clock.cc:648] HybridClock initialized: now 1786556590080361 us; error 72 us; skew 500 ppm
I20260812 17:43:10.082698 27418 webserver.cc:460] Webserver started at http://127.17.255.62:39507/ using document root <none> and password file <none>
I20260812 17:43:10.083352 27418 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:10.083452 27418 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:10.083700 27418 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:10.086050 27418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "ed82e4d5909b4061800ac9c3e7316e79"
format_stamp: "Formatted at 2026-08-12 17:43:10 on dist-test-slave-tk9z"
server_key: "f8fd4ecb91244b4e8dde72edfe3aaeef"
server_key_iv: "8c92e47e18ea39da8683fe35e651d1d3"
server_key_version: "encryptionkey@0"
I20260812 17:43:10.086802 27418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "ed82e4d5909b4061800ac9c3e7316e79"
format_stamp: "Formatted at 2026-08-12 17:43:10 on dist-test-slave-tk9z"
server_key: "f8fd4ecb91244b4e8dde72edfe3aaeef"
server_key_iv: "8c92e47e18ea39da8683fe35e651d1d3"
server_key_version: "encryptionkey@0"
I20260812 17:43:10.091042 27418 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 17:43:10.093745 27440 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:10.095232 27418 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:43:10.095508 27418 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "ed82e4d5909b4061800ac9c3e7316e79"
format_stamp: "Formatted at 2026-08-12 17:43:10 on dist-test-slave-tk9z"
server_key: "f8fd4ecb91244b4e8dde72edfe3aaeef"
server_key_iv: "8c92e47e18ea39da8683fe35e651d1d3"
server_key_version: "encryptionkey@0"
I20260812 17:43:10.095650 27418 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:10.116425 27418 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:10.117240 27418 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:10.117470 27418 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:10.125001 27418 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:45611
I20260812 17:43:10.125011 27519 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:45611 every 8 connection(s)
I20260812 17:43:10.126035 27418 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:43:10.129429 27520 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:10.132241 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 27418
I20260812 17:43:10.132390 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:43:10.132710 18428 external_mini_cluster.cc:1428] Setting key d2d764e1bb0e6164a7f458c7d41084c5
I20260812 17:43:10.136677 27520 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed82e4d5909b4061800ac9c3e7316e79: Bootstrap starting.
I20260812 17:43:10.139721 27520 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ed82e4d5909b4061800ac9c3e7316e79: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:10.140640 27520 log.cc:824] T 00000000000000000000000000000000 P ed82e4d5909b4061800ac9c3e7316e79: Log is configured to *not* fsync() on all Append() calls
I20260812 17:43:10.143354 27520 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed82e4d5909b4061800ac9c3e7316e79: No bootstrap required, opened a new log
I20260812 17:43:10.144363 27524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:10.134483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44136 (local address 127.17.255.62:45611)
0812 17:43:10.135302 (+ 819us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:10.135324 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:10.135371 (+ 47us) server_negotiation.cc:407] Connection header received
0812 17:43:10.136214 (+ 843us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:10.136240 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:10.136789 (+ 549us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:10.137193 (+ 404us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:10.137686 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:10.139202 (+ 1516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:10.140227 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:10.140953 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:10.141132 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:10.142185 (+ 1053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:10.142192 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:10.142209 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:43:10.142768 (+ 559us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:10.142842 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:43:10.142870 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:10.142977 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:10.143124 (+ 147us) server_negotiation.cc:299] Negotiation successful
0812 17:43:10.143413 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":139,"threads_started":1}
I20260812 17:43:10.147009 27520 raft_consensus.cc:348] T 00000000000000000000000000000000 P ed82e4d5909b4061800ac9c3e7316e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed82e4d5909b4061800ac9c3e7316e79" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45611 } }
I20260812 17:43:10.147290 27520 raft_consensus.cc:374] T 00000000000000000000000000000000 P ed82e4d5909b4061800ac9c3e7316e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:10.147380 27520 raft_consensus.cc:729] T 00000000000000000000000000000000 P ed82e4d5909b4061800ac9c3e7316e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed82e4d5909b4061800ac9c3e7316e79, State: Initialized, Role: FOLLOWER
I20260812 17:43:10.147873 18428 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 17:43:10.147910 27520 consensus_queue.cc:260] T 00000000000000000000000000000000 P ed82e4d5909b4061800ac9c3e7316e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed82e4d5909b4061800ac9c3e7316e79" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45611 } }
I20260812 17:43:10.148074 27520 raft_consensus.cc:388] T 00000000000000000000000000000000 P ed82e4d5909b4061800ac9c3e7316e79 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:43:10.148134 27520 raft_consensus.cc:482] T 00000000000000000000000000000000 P ed82e4d5909b4061800ac9c3e7316e79 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:43:10.148231 27520 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ed82e4d5909b4061800ac9c3e7316e79 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:10.149346 27520 raft_consensus.cc:504] T 00000000000000000000000000000000 P ed82e4d5909b4061800ac9c3e7316e79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed82e4d5909b4061800ac9c3e7316e79" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45611 } }
I20260812 17:43:10.149717 27520 leader_election.cc:302] T 00000000000000000000000000000000 P ed82e4d5909b4061800ac9c3e7316e79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ed82e4d5909b4061800ac9c3e7316e79; no voters:
I20260812 17:43:10.150066 27520 leader_election.cc:288] T 00000000000000000000000000000000 P ed82e4d5909b4061800ac9c3e7316e79 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:43:10.150185 27526 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ed82e4d5909b4061800ac9c3e7316e79 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:43:10.150477 27526 raft_consensus.cc:686] T 00000000000000000000000000000000 P ed82e4d5909b4061800ac9c3e7316e79 [term 1 LEADER]: Becoming Leader. State: Replica: ed82e4d5909b4061800ac9c3e7316e79, State: Running, Role: LEADER
I20260812 17:43:10.150800 27526 consensus_queue.cc:237] T 00000000000000000000000000000000 P ed82e4d5909b4061800ac9c3e7316e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed82e4d5909b4061800ac9c3e7316e79" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45611 } }
I20260812 17:43:10.151481 27520 sys_catalog.cc:564] T 00000000000000000000000000000000 P ed82e4d5909b4061800ac9c3e7316e79 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:43:10.152796 27528 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed82e4d5909b4061800ac9c3e7316e79 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ed82e4d5909b4061800ac9c3e7316e79. Latest consensus state: current_term: 1 leader_uuid: "ed82e4d5909b4061800ac9c3e7316e79" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed82e4d5909b4061800ac9c3e7316e79" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45611 } } }
I20260812 17:43:10.152827 27527 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed82e4d5909b4061800ac9c3e7316e79 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ed82e4d5909b4061800ac9c3e7316e79" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed82e4d5909b4061800ac9c3e7316e79" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45611 } } }
I20260812 17:43:10.152969 27528 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed82e4d5909b4061800ac9c3e7316e79 [sys.catalog]: This master's current role is: LEADER
I20260812 17:43:10.152980 27527 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed82e4d5909b4061800ac9c3e7316e79 [sys.catalog]: This master's current role is: LEADER
I20260812 17:43:10.153322 27538 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:43:10.156639 27538 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:43:10.162693 27538 catalog_manager.cc:1347] Generated new cluster ID: 3b47cfd2e5394b3684a44b074bfe8fa8
I20260812 17:43:10.162778 27538 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:43:10.181095 27538 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:43:10.182106 27538 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:43:10.191586 27538 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ed82e4d5909b4061800ac9c3e7316e79: Generated new TSK 0
I20260812 17:43:10.192366 27538 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 17:43:10.695673 27524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:10.206705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44150 (local address 127.17.255.62:45611)
0812 17:43:10.206858 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:10.206863 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:10.207102 (+ 239us) server_negotiation.cc:407] Connection header received
0812 17:43:10.207262 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:10.207265 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:10.207333 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:10.207466 (+ 133us) server_negotiation.cc:226] Negotiated authn=JWT
0812 17:43:10.207749 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:10.208615 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:10.209526 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:10.209884 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:10.209990 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:10.210409 (+ 419us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 17:43:10.695235 (+484826us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0812 17:43:10.695549 (+ 314us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44150: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":60}
W20260812 17:43:10.695796 27524 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44150: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260812 17:43:10.695865 27562 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:10.206618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:45611 (local address 127.0.0.1:44150)
0812 17:43:10.207008 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:10.207023 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:10.207133 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:10.207498 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:10.207501 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:10.207510 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0812 17:43:10.207627 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:10.207633 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:10.208753 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:10.208757 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:10.209404 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:10.209413 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:10.210056 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:10.210059 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:10.210136 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:10.210163 (+ 27us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 17:43:10.695485 (+485322us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0812 17:43:10.695681 (+ 196us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.17.255.62:45611: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":194,"threads_started":1}
I20260812 17:43:10.696811 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 27418
2026-08-12T17:43:10Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (799 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (143 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (142 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:43:11 dist-test-slave-tk9z krb5kdc[27579](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:43:11 dist-test-slave-tk9z krb5kdc[27579](info): set up 2 sockets
Aug 12 17:43:11 dist-test-slave-tk9z krb5kdc[27579](info): commencing operation
krb5kdc: starting...
W20260812 17:43:12.334195 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.324s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:43:12 dist-test-slave-tk9z krb5kdc[27579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556592, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:43:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:43:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.255.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
I20260812 17:43:12.473091 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:39817
--webserver_interface=127.17.255.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:36137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:39817
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:43:12.589964 27601 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:12.590363 27601 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:12.590432 27601 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:12.594363 27601 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:43:12.594455 27601 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:12.594476 27601 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:12.594496 27601 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:43:12.594512 27601 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:43:12.600265 27601 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:36137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:39817
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:39817
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27601
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:12.601450 27601 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:12.602581 27601 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:12.611887 27607 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:12.612051 27601 server_base.cc:1034] running on GCE node
W20260812 17:43:12.611894 27608 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:12.611894 27610 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:12.612914 27601 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:12.614161 27601 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:12.615332 27601 hybrid_clock.cc:648] HybridClock initialized: now 1786556592615294 us; error 59 us; skew 500 ppm
Aug 12 17:43:12 dist-test-slave-tk9z krb5kdc[27579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556592, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:12.618499 27601 init.cc:377] Logged in from keytab as kudu/127.17.255.62@KRBTEST.COM (short username kudu)
I20260812 17:43:12.619556 27601 webserver.cc:460] Webserver started at http://127.17.255.62:37685/ using document root <none> and password file <none>
I20260812 17:43:12.620170 27601 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:12.620280 27601 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:12.620538 27601 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:12.622851 27601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "d95a362d8f1e4fb093d2bf5610d75c9f"
format_stamp: "Formatted at 2026-08-12 17:43:12 on dist-test-slave-tk9z"
server_key: "165c242122cfeab7c67fc7261648de18"
server_key_iv: "bceed8a72ab6d9578df8a5b257e9ab01"
server_key_version: "encryptionkey@0"
I20260812 17:43:12.623481 27601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "d95a362d8f1e4fb093d2bf5610d75c9f"
format_stamp: "Formatted at 2026-08-12 17:43:12 on dist-test-slave-tk9z"
server_key: "165c242122cfeab7c67fc7261648de18"
server_key_iv: "bceed8a72ab6d9578df8a5b257e9ab01"
server_key_version: "encryptionkey@0"
I20260812 17:43:12.627668 27601 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260812 17:43:12.630313 27621 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:12.631731 27601 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:43:12.631887 27601 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "d95a362d8f1e4fb093d2bf5610d75c9f"
format_stamp: "Formatted at 2026-08-12 17:43:12 on dist-test-slave-tk9z"
server_key: "165c242122cfeab7c67fc7261648de18"
server_key_iv: "bceed8a72ab6d9578df8a5b257e9ab01"
server_key_version: "encryptionkey@0"
I20260812 17:43:12.632016 27601 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:12.645804 27601 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:12.649508 27601 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:12.649740 27601 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:12.658510 27601 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:39817
I20260812 17:43:12.658527 27704 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:39817 every 8 connection(s)
I20260812 17:43:12.659729 27601 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:43:12.660681 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 27601
I20260812 17:43:12.660807 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:43:12.661131 18428 external_mini_cluster.cc:1428] Setting key 3c760e0b08e5c09dec55ed0c3c62f432
I20260812 17:43:12.663422 27705 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:12.669445 27705 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d95a362d8f1e4fb093d2bf5610d75c9f: Bootstrap starting.
Aug 12 17:43:12 dist-test-slave-tk9z krb5kdc[27579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556592, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:43:12.672374 27705 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d95a362d8f1e4fb093d2bf5610d75c9f: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:12.673460 27705 log.cc:824] T 00000000000000000000000000000000 P d95a362d8f1e4fb093d2bf5610d75c9f: Log is configured to *not* fsync() on all Append() calls
I20260812 17:43:12.676090 27705 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d95a362d8f1e4fb093d2bf5610d75c9f: No bootstrap required, opened a new log
I20260812 17:43:12.677453 27709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:12.662824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36616 (local address 127.17.255.62:39817)
0812 17:43:12.663360 (+ 536us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:12.663383 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:12.663430 (+ 47us) server_negotiation.cc:407] Connection header received
0812 17:43:12.664228 (+ 798us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:12.664249 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:12.664628 (+ 379us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:12.665120 (+ 492us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:12.666049 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:12.667268 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:12.668236 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:12.668769 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:12.668984 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:12.672035 (+ 3051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:12.672040 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:12.672055 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:12.672086 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:12.674152 (+ 2066us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:12.674687 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:12.674693 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:12.674700 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:12.674842 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:12.675130 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:12.675133 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:12.675134 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:12.675682 (+ 548us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:12.675881 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:12.676118 (+ 237us) server_negotiation.cc:299] Negotiation successful
0812 17:43:12.676468 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":172,"threads_started":1}
I20260812 17:43:12.680076 27705 raft_consensus.cc:348] T 00000000000000000000000000000000 P d95a362d8f1e4fb093d2bf5610d75c9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d95a362d8f1e4fb093d2bf5610d75c9f" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 39817 } }
I20260812 17:43:12.680389 27705 raft_consensus.cc:374] T 00000000000000000000000000000000 P d95a362d8f1e4fb093d2bf5610d75c9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:12.680460 27705 raft_consensus.cc:729] T 00000000000000000000000000000000 P d95a362d8f1e4fb093d2bf5610d75c9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d95a362d8f1e4fb093d2bf5610d75c9f, State: Initialized, Role: FOLLOWER
I20260812 17:43:12.680971 27705 consensus_queue.cc:260] T 00000000000000000000000000000000 P d95a362d8f1e4fb093d2bf5610d75c9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d95a362d8f1e4fb093d2bf5610d75c9f" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 39817 } }
I20260812 17:43:12.681109 27705 raft_consensus.cc:388] T 00000000000000000000000000000000 P d95a362d8f1e4fb093d2bf5610d75c9f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:43:12.681200 27705 raft_consensus.cc:482] T 00000000000000000000000000000000 P d95a362d8f1e4fb093d2bf5610d75c9f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:43:12.681308 27705 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d95a362d8f1e4fb093d2bf5610d75c9f [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:12.682364 27705 raft_consensus.cc:504] T 00000000000000000000000000000000 P d95a362d8f1e4fb093d2bf5610d75c9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d95a362d8f1e4fb093d2bf5610d75c9f" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 39817 } }
I20260812 17:43:12.682804 27705 leader_election.cc:302] T 00000000000000000000000000000000 P d95a362d8f1e4fb093d2bf5610d75c9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d95a362d8f1e4fb093d2bf5610d75c9f; no voters:
I20260812 17:43:12.683153 27705 leader_election.cc:288] T 00000000000000000000000000000000 P d95a362d8f1e4fb093d2bf5610d75c9f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:43:12.683354 27714 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d95a362d8f1e4fb093d2bf5610d75c9f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:43:12.683624 27714 raft_consensus.cc:686] T 00000000000000000000000000000000 P d95a362d8f1e4fb093d2bf5610d75c9f [term 1 LEADER]: Becoming Leader. State: Replica: d95a362d8f1e4fb093d2bf5610d75c9f, State: Running, Role: LEADER
I20260812 17:43:12.684033 27714 consensus_queue.cc:237] T 00000000000000000000000000000000 P d95a362d8f1e4fb093d2bf5610d75c9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d95a362d8f1e4fb093d2bf5610d75c9f" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 39817 } }
I20260812 17:43:12.684672 27705 sys_catalog.cc:564] T 00000000000000000000000000000000 P d95a362d8f1e4fb093d2bf5610d75c9f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:43:12.685989 27716 sys_catalog.cc:455] T 00000000000000000000000000000000 P d95a362d8f1e4fb093d2bf5610d75c9f [sys.catalog]: SysCatalogTable state changed. Reason: New leader d95a362d8f1e4fb093d2bf5610d75c9f. Latest consensus state: current_term: 1 leader_uuid: "d95a362d8f1e4fb093d2bf5610d75c9f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d95a362d8f1e4fb093d2bf5610d75c9f" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 39817 } } }
I20260812 17:43:12.686136 27716 sys_catalog.cc:458] T 00000000000000000000000000000000 P d95a362d8f1e4fb093d2bf5610d75c9f [sys.catalog]: This master's current role is: LEADER
I20260812 17:43:12.686545 27724 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:43:12.686517 27715 sys_catalog.cc:455] T 00000000000000000000000000000000 P d95a362d8f1e4fb093d2bf5610d75c9f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d95a362d8f1e4fb093d2bf5610d75c9f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d95a362d8f1e4fb093d2bf5610d75c9f" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 39817 } } }
I20260812 17:43:12.686663 27715 sys_catalog.cc:458] T 00000000000000000000000000000000 P d95a362d8f1e4fb093d2bf5610d75c9f [sys.catalog]: This master's current role is: LEADER
I20260812 17:43:12.690033 27724 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:43:12.695926 27724 catalog_manager.cc:1347] Generated new cluster ID: 20be3561c154410aafd2ea4b47aa8b98
I20260812 17:43:12.696053 27724 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:43:12.706962 27724 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:43:12.707966 27724 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:43:12.715615 27724 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d95a362d8f1e4fb093d2bf5610d75c9f: Generated new TSK 0
I20260812 17:43:12.716434 27724 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.255.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab.
Entry for principal kudu/127.17.255.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab.
I20260812 17:43:12.755055 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.1:0
--local_ip_for_outbound_sockets=127.17.255.1
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:39817
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:36137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:43:12.909929 27741 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:12.910396 27741 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:12.910487 27741 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:12.916438 27741 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:12.916541 27741 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:12.916649 27741 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.1
I20260812 17:43:12.922639 27741 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:36137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:39817
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27741
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.1
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:12.923941 27741 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:12.925062 27741 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:12.935441 27747 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:12.935526 27748 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:12.935658 27741 server_base.cc:1034] running on GCE node
W20260812 17:43:12.935751 27750 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:12.936338 27741 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:12.937106 27741 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:12.938344 27741 hybrid_clock.cc:648] HybridClock initialized: now 1786556592938268 us; error 72 us; skew 500 ppm
Aug 12 17:43:12 dist-test-slave-tk9z krb5kdc[27579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556592, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:12.941546 27741 init.cc:377] Logged in from keytab as kudu/127.17.255.1@KRBTEST.COM (short username kudu)
I20260812 17:43:12.942624 27741 webserver.cc:460] Webserver started at http://127.17.255.1:39077/ using document root <none> and password file <none>
I20260812 17:43:12.943250 27741 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:12.943349 27741 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:12.943598 27741 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:12.945986 27741 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-0/data/instance:
uuid: "a77e95f710cf45fc87e0e9570f1c71ea"
format_stamp: "Formatted at 2026-08-12 17:43:12 on dist-test-slave-tk9z"
server_key: "25047fb9844b10252d5db70dd7ca0d6d"
server_key_iv: "114f7762a1b871414ff1be7c73a89dfb"
server_key_version: "encryptionkey@0"
I20260812 17:43:12.946679 27741 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance:
uuid: "a77e95f710cf45fc87e0e9570f1c71ea"
format_stamp: "Formatted at 2026-08-12 17:43:12 on dist-test-slave-tk9z"
server_key: "25047fb9844b10252d5db70dd7ca0d6d"
server_key_iv: "114f7762a1b871414ff1be7c73a89dfb"
server_key_version: "encryptionkey@0"
I20260812 17:43:12.951555 27741 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260812 17:43:12.954366 27761 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:12.955776 27741 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 17:43:12.955945 27741 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-0/wal
uuid: "a77e95f710cf45fc87e0e9570f1c71ea"
format_stamp: "Formatted at 2026-08-12 17:43:12 on dist-test-slave-tk9z"
server_key: "25047fb9844b10252d5db70dd7ca0d6d"
server_key_iv: "114f7762a1b871414ff1be7c73a89dfb"
server_key_version: "encryptionkey@0"
I20260812 17:43:12.956085 27741 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:12.982578 27741 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:12.986326 27741 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:12.986590 27741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:12.987269 27741 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:43:12.988152 27741 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:43:12.988198 27741 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:12.988268 27741 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:43:12.988299 27741 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:12.997975 27741 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.1:35597
I20260812 17:43:12.998039 27936 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.1:35597 every 8 connection(s)
I20260812 17:43:12.999082 27741 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
I20260812 17:43:13.004969 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 27741
I20260812 17:43:13.005136 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance
I20260812 17:43:13.005504 18428 external_mini_cluster.cc:1428] Setting key 0f2e5593ae613a0f07779d27fde02747
Aug 12 17:43:13 dist-test-slave-tk9z krb5kdc[27579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556592, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:43:13.014940 27709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:13.001192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:59705 (local address 127.17.255.62:39817)
0812 17:43:13.001342 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:13.001345 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:13.002212 (+ 867us) server_negotiation.cc:407] Connection header received
0812 17:43:13.003684 (+ 1472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:13.003687 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:13.003741 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:13.003824 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:13.005194 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:13.005981 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:13.007399 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:13.007819 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:13.007956 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:13.010998 (+ 3042us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:13.011008 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:13.011012 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:13.011037 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:13.012595 (+ 1558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:13.013161 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:13.013165 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:13.013166 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:13.013247 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:13.013632 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:13.013635 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:13.013637 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:13.013852 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:13.013965 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:13.014597 (+ 632us) server_negotiation.cc:299] Negotiation successful
0812 17:43:13.014746 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
WARNING: no policy specified for kudu/127.17.255.2@KRBTEST.COM; defaulting to no policy
I20260812 17:43:13.015836 27941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:13.001565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:39817 (local address 127.17.255.1:59705)
0812 17:43:13.002030 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:13.002076 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:13.003416 (+ 1340us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:13.004008 (+ 592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:13.004016 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:13.004395 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:13.004954 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:13.004969 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:13.006149 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:13.006151 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:13.007257 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:13.007267 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:13.008023 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:13.008028 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:13.008238 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:13.008913 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:13.008931 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:13.010819 (+ 1888us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:13.012729 (+ 1910us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:13.012736 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:13.012753 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:13.013036 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:13.013345 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:13.013348 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:13.013350 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:13.013518 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:13.013966 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:13.013976 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:13.014276 (+ 300us) client_negotiation.cc:769] Sending connection context
0812 17:43:13.014535 (+ 259us) client_negotiation.cc:240] Negotiation successful
0812 17:43:13.014909 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":118,"threads_started":1}
I20260812 17:43:13.017206 27937 heartbeater.cc:347] Connected to a master server at 127.17.255.62:39817
I20260812 17:43:13.017481 27937 heartbeater.cc:464] Registering TS with master...
I20260812 17:43:13.018024 27937 heartbeater.cc:511] Master 127.17.255.62:39817 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.2@KRBTEST.COM" created.
I20260812 17:43:13.020118 27646 ts_manager.cc:194] Registered new tserver with Master: a77e95f710cf45fc87e0e9570f1c71ea (127.17.255.1:35597)
I20260812 17:43:13.021488 27646 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.1@KRBTEST.COM'} at 127.17.255.1:59705
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab.
Entry for principal kudu/127.17.255.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab.
I20260812 17:43:13.037595 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.2:0
--local_ip_for_outbound_sockets=127.17.255.2
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:39817
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:36137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:43:13.159376 27947 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:13.159718 27947 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:13.159812 27947 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:13.164108 27947 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:13.164214 27947 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:13.164315 27947 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.2
I20260812 17:43:13.169831 27947 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:36137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:39817
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27947
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.2
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:13.171155 27947 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:13.172252 27947 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:13.182682 27957 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:13.182667 27954 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:13.182667 27953 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:13.183281 27947 server_base.cc:1034] running on GCE node
I20260812 17:43:13.183802 27947 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:13.184552 27947 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:13.185910 27947 hybrid_clock.cc:648] HybridClock initialized: now 1786556593185887 us; error 48 us; skew 500 ppm
Aug 12 17:43:13 dist-test-slave-tk9z krb5kdc[27579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556593, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:13.189458 27947 init.cc:377] Logged in from keytab as kudu/127.17.255.2@KRBTEST.COM (short username kudu)
I20260812 17:43:13.190558 27947 webserver.cc:460] Webserver started at http://127.17.255.2:37809/ using document root <none> and password file <none>
I20260812 17:43:13.191322 27947 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:13.191486 27947 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:13.191784 27947 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:13.194082 27947 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-1/data/instance:
uuid: "7b85fded57a74cee921e9d8e97c63d07"
format_stamp: "Formatted at 2026-08-12 17:43:13 on dist-test-slave-tk9z"
server_key: "2175b91aaa1950e3d75b421919bbd6ef"
server_key_iv: "c2cf6bf5310cb6d1c39fc980120fe22c"
server_key_version: "encryptionkey@0"
I20260812 17:43:13.194767 27947 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance:
uuid: "7b85fded57a74cee921e9d8e97c63d07"
format_stamp: "Formatted at 2026-08-12 17:43:13 on dist-test-slave-tk9z"
server_key: "2175b91aaa1950e3d75b421919bbd6ef"
server_key_iv: "c2cf6bf5310cb6d1c39fc980120fe22c"
server_key_version: "encryptionkey@0"
I20260812 17:43:13.199138 27947 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.003s
I20260812 17:43:13.202090 27966 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:13.203615 27947 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:43:13.203783 27947 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-1/wal
uuid: "7b85fded57a74cee921e9d8e97c63d07"
format_stamp: "Formatted at 2026-08-12 17:43:13 on dist-test-slave-tk9z"
server_key: "2175b91aaa1950e3d75b421919bbd6ef"
server_key_iv: "c2cf6bf5310cb6d1c39fc980120fe22c"
server_key_version: "encryptionkey@0"
I20260812 17:43:13.203922 27947 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:13.236553 27947 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:13.239934 27947 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:13.240159 27947 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:13.240820 27947 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:43:13.241731 27947 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:43:13.241809 27947 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:13.241886 27947 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:43:13.241930 27947 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:13.251696 27947 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.2:36737
I20260812 17:43:13.251720 28146 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.2:36737 every 8 connection(s)
I20260812 17:43:13.252715 27947 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
I20260812 17:43:13.256091 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 27947
I20260812 17:43:13.256224 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance
I20260812 17:43:13.256572 18428 external_mini_cluster.cc:1428] Setting key 0b5f933080337ac9fd7168333391fcc5
Aug 12 17:43:13 dist-test-slave-tk9z krb5kdc[27579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556593, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.255.3@KRBTEST.COM; defaulting to no policy
I20260812 17:43:13.269285 27709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:13.254800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:58261 (local address 127.17.255.62:39817)
0812 17:43:13.254948 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:13.254952 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:13.255841 (+ 889us) server_negotiation.cc:407] Connection header received
0812 17:43:13.257700 (+ 1859us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:13.257704 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:13.257750 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:13.257841 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:13.259842 (+ 2001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:13.260460 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:13.261889 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:13.262121 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:13.262210 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:13.265340 (+ 3130us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:13.265344 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:13.265347 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:13.265384 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:13.266959 (+ 1575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:13.267558 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:13.267562 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:13.267565 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:13.267652 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:13.268033 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:13.268036 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:13.268038 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:13.268287 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:13.268406 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:13.268966 (+ 560us) server_negotiation.cc:299] Negotiation successful
0812 17:43:13.269108 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 17:43:13.270227 28149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:13.255163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:39817 (local address 127.17.255.2:58261)
0812 17:43:13.255653 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:13.255700 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:13.257468 (+ 1768us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:13.258131 (+ 663us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:13.258141 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:13.258798 (+ 657us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:13.259633 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:13.259688 (+ 55us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:13.260600 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:13.260603 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:13.261711 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:13.261722 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:13.262301 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:13.262308 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:13.262587 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:13.263273 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:13.263302 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:13.265144 (+ 1842us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:13.267101 (+ 1957us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:13.267108 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:13.267128 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:13.267433 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:13.267753 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:13.267756 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:13.267758 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:13.267926 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:13.268407 (+ 481us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:13.268418 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:13.268714 (+ 296us) client_negotiation.cc:769] Sending connection context
0812 17:43:13.268924 (+ 210us) client_negotiation.cc:240] Negotiation successful
0812 17:43:13.269317 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":133,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.3@KRBTEST.COM" created.
I20260812 17:43:13.271705 28147 heartbeater.cc:347] Connected to a master server at 127.17.255.62:39817
I20260812 17:43:13.272001 28147 heartbeater.cc:464] Registering TS with master...
I20260812 17:43:13.272578 28147 heartbeater.cc:511] Master 127.17.255.62:39817 requested a full tablet report, sending...
I20260812 17:43:13.273849 27646 ts_manager.cc:194] Registered new tserver with Master: 7b85fded57a74cee921e9d8e97c63d07 (127.17.255.2:36737)
I20260812 17:43:13.274520 27646 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.2@KRBTEST.COM'} at 127.17.255.2:58261
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab.
Entry for principal kudu/127.17.255.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab.
I20260812 17:43:13.290297 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.3:0
--local_ip_for_outbound_sockets=127.17.255.3
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:39817
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:36137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:43:13.410447 28154 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:13.410776 28154 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:13.410871 28154 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:13.415064 28154 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:13.415156 28154 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:13.415248 28154 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.3
I20260812 17:43:13.420846 28154 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:36137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:39817
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28154
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.3
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:13.422060 28154 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:13.423250 28154 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:13.433669 28166 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:13.433779 28154 server_base.cc:1034] running on GCE node
W20260812 17:43:13.433667 28161 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:13.433667 28168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:13.434535 28154 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:13.435195 28154 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:13.436424 28154 hybrid_clock.cc:648] HybridClock initialized: now 1786556593436387 us; error 47 us; skew 500 ppm
Aug 12 17:43:13 dist-test-slave-tk9z krb5kdc[27579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556593, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:13.439553 28154 init.cc:377] Logged in from keytab as kudu/127.17.255.3@KRBTEST.COM (short username kudu)
I20260812 17:43:13.440537 28154 webserver.cc:460] Webserver started at http://127.17.255.3:33873/ using document root <none> and password file <none>
I20260812 17:43:13.441128 28154 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:13.441190 28154 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:13.441440 28154 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:13.443591 28154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-2/data/instance:
uuid: "fc9fecf859e248d48a08a28c7184e93f"
format_stamp: "Formatted at 2026-08-12 17:43:13 on dist-test-slave-tk9z"
server_key: "0247ccb8e1f0cbdf65e2976417da5948"
server_key_iv: "7135a351595d76f8c6d977c6321ba229"
server_key_version: "encryptionkey@0"
I20260812 17:43:13.444181 28154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance:
uuid: "fc9fecf859e248d48a08a28c7184e93f"
format_stamp: "Formatted at 2026-08-12 17:43:13 on dist-test-slave-tk9z"
server_key: "0247ccb8e1f0cbdf65e2976417da5948"
server_key_iv: "7135a351595d76f8c6d977c6321ba229"
server_key_version: "encryptionkey@0"
I20260812 17:43:13.448058 28154 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 17:43:13.450646 28179 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:13.451900 28154 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 17:43:13.452033 28154 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-2/wal
uuid: "fc9fecf859e248d48a08a28c7184e93f"
format_stamp: "Formatted at 2026-08-12 17:43:13 on dist-test-slave-tk9z"
server_key: "0247ccb8e1f0cbdf65e2976417da5948"
server_key_iv: "7135a351595d76f8c6d977c6321ba229"
server_key_version: "encryptionkey@0"
I20260812 17:43:13.452147 28154 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:13.465687 28154 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:13.469058 28154 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:13.469265 28154 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:13.469863 28154 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:43:13.470780 28154 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:43:13.470852 28154 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:13.470921 28154 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:43:13.470973 28154 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:13.480135 28154 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.3:34323
I20260812 17:43:13.480158 28368 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.3:34323 every 8 connection(s)
I20260812 17:43:13.481165 28154 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
I20260812 17:43:13.488248 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 28154
I20260812 17:43:13.488381 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance
I20260812 17:43:13.488694 18428 external_mini_cluster.cc:1428] Setting key 286de692cbdae1f54fc8bd4e3df07362
Aug 12 17:43:13 dist-test-slave-tk9z krb5kdc[27579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556593, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:43:13.495918 27709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:13.483100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:39199 (local address 127.17.255.62:39817)
0812 17:43:13.483247 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:13.483251 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:13.484084 (+ 833us) server_negotiation.cc:407] Connection header received
0812 17:43:13.485491 (+ 1407us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:13.485494 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:13.485592 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:13.485725 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:13.487017 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:13.487549 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:13.489148 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:13.489382 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:13.489505 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:13.492394 (+ 2889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:13.492397 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:13.492399 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:13.492425 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:13.493852 (+ 1427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:13.494415 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:13.494419 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:13.494421 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:13.494511 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:13.494838 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:13.494841 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:13.494842 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:13.495042 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:13.495119 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:13.495680 (+ 561us) server_negotiation.cc:299] Negotiation successful
0812 17:43:13.495793 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 17:43:13.496922 28372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:13.483470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:39817 (local address 127.17.255.3:39199)
0812 17:43:13.483924 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:13.483969 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:13.485270 (+ 1301us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:13.485897 (+ 627us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:13.485904 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:13.486266 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:13.486877 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:13.486894 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:13.487666 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:13.487668 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:13.488996 (+ 1328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:13.489011 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:13.489583 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:13.489590 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:13.489831 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:13.490538 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:13.490556 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:13.492221 (+ 1665us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:13.493981 (+ 1760us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:13.493987 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:13.494001 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:13.494279 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:13.494598 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:13.494601 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:13.494602 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:13.494753 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:13.495165 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:13.495171 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:13.495439 (+ 268us) client_negotiation.cc:769] Sending connection context
0812 17:43:13.495623 (+ 184us) client_negotiation.cc:240] Negotiation successful
0812 17:43:13.495919 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":109,"threads_started":1}
I20260812 17:43:13.498270 28370 heartbeater.cc:347] Connected to a master server at 127.17.255.62:39817
I20260812 17:43:13.498622 28370 heartbeater.cc:464] Registering TS with master...
I20260812 17:43:13.499163 28370 heartbeater.cc:511] Master 127.17.255.62:39817 requested a full tablet report, sending...
I20260812 17:43:13.500303 27646 ts_manager.cc:194] Registered new tserver with Master: fc9fecf859e248d48a08a28c7184e93f (127.17.255.3:34323)
I20260812 17:43:13.500895 27646 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.3@KRBTEST.COM'} at 127.17.255.3:39199
I20260812 17:43:13.503075 18428 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/krb5kdc/test-admin.keytab.
Aug 12 17:43:13 dist-test-slave-tk9z krb5kdc[27579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556593, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:13.519874 18428 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260812 17:43:13.523087 28380 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:13.521444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49134 (local address 127.17.255.1:35597)
0812 17:43:13.521812 (+ 368us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:13.521819 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:13.521846 (+ 27us) server_negotiation.cc:407] Connection header received
0812 17:43:13.521900 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:13.521905 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:13.522095 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:13.522222 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:13.522883 (+ 661us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49134: BlockingRecv error: recv got EOF from 127.0.0.1:49134 (error 108)
Metrics: {"server-negotiator.queue_time_us":251,"thread_start_us":130,"threads_started":1}
W20260812 17:43:13.523149 18428 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/krb5kdc/krb5cc' of type FILE
Aug 12 17:43:13 dist-test-slave-tk9z krb5kdc[27579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556593, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:13.524245 18428 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 17:43:13 dist-test-slave-tk9z krb5kdc[27579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556593, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:13.525183 18428 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 17:43:13 dist-test-slave-tk9z krb5kdc[27579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556593, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.255.1@KRBTEST.COM
I20260812 17:43:13.535457 28380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:13.526145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49146 (local address 127.17.255.1:35597)
0812 17:43:13.526308 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:13.526312 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:13.526415 (+ 103us) server_negotiation.cc:407] Connection header received
0812 17:43:13.526602 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:13.526605 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:13.526654 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:13.526738 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:13.527338 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:13.528092 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:13.528905 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:13.529302 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:13.529394 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:13.531744 (+ 2350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:13.531753 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:13.531767 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:13.531794 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:13.533567 (+ 1773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:13.534030 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:13.534036 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:13.534038 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:13.534127 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:13.534432 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:13.534438 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:13.534443 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:13.534717 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:13.534892 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:13.535068 (+ 176us) server_negotiation.cc:299] Negotiation successful
0812 17:43:13.535236 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
W20260812 17:43:13.539525 28380 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:13.538594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49162 (local address 127.17.255.1:35597)
0812 17:43:13.538734 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:13.538737 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:13.538753 (+ 16us) server_negotiation.cc:407] Connection header received
0812 17:43:13.538875 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:13.538877 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:13.538915 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:13.538972 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:13.539365 (+ 393us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49162: BlockingRecv error: recv got EOF from 127.0.0.1:49162 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
W20260812 17:43:13.539806 18428 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/krb5kdc/krb5cc)
Aug 12 17:43:13 dist-test-slave-tk9z krb5kdc[27579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556593, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:13.541179 18428 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 17:43:13 dist-test-slave-tk9z krb5kdc[27579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556593, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:13.542321 18428 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 17:43:13 dist-test-slave-tk9z krb5kdc[27579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556593, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.255.1@KRBTEST.COM
I20260812 17:43:13.552100 28380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:13.543322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49170 (local address 127.17.255.1:35597)
0812 17:43:13.543504 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:13.543509 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:13.543648 (+ 139us) server_negotiation.cc:407] Connection header received
0812 17:43:13.543813 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:13.543816 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:13.543866 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:13.543956 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:13.544496 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:13.545015 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:13.545832 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:13.546066 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:13.546172 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:13.548634 (+ 2462us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:13.548637 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:13.548639 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:13.548665 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:13.550190 (+ 1525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:13.550720 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:13.550725 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:13.550726 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:13.550825 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:13.551123 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:13.551127 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:13.551129 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:13.551341 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:13.551513 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:13.551760 (+ 247us) server_negotiation.cc:299] Negotiation successful
0812 17:43:13.551928 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
W20260812 17:43:13.555442 28380 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:13.554193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49174 (local address 127.17.255.1:35597)
0812 17:43:13.554349 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:13.554353 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:13.554484 (+ 131us) server_negotiation.cc:407] Connection header received
0812 17:43:13.554632 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:13.554635 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:13.554676 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:13.554743 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:13.555346 (+ 603us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49174: BlockingRecv error: recv got EOF from 127.0.0.1:49174 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260812 17:43:13.555572 18428 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786556557564181-18428-0/krb5kdc/krb5cc' of type FILE
Aug 12 17:43:13 dist-test-slave-tk9z krb5kdc[27579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556593, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:13.556921 18428 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 17:43:13 dist-test-slave-tk9z krb5kdc[27579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556593, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:13.557935 18428 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 17:43:13 dist-test-slave-tk9z krb5kdc[27579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556593, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.255.1@KRBTEST.COM
I20260812 17:43:13.567148 28380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:13.558970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49186 (local address 127.17.255.1:35597)
0812 17:43:13.559103 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:13.559106 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:13.559120 (+ 14us) server_negotiation.cc:407] Connection header received
0812 17:43:13.559231 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:13.559233 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:13.559271 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:13.559372 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:13.559921 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:13.560476 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:13.561310 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:13.561522 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:13.561601 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:13.563988 (+ 2387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:13.563991 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:13.563994 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:13.564018 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:13.565497 (+ 1479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:13.565882 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:13.565885 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:13.565886 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:13.565960 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:13.566199 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:13.566201 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:13.566202 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:13.566360 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:13.566577 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:13.566822 (+ 245us) server_negotiation.cc:299] Negotiation successful
0812 17:43:13.566922 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 17:43:13.568271 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 27741
I20260812 17:43:13.589273 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 27947
I20260812 17:43:13.605338 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 28154
I20260812 17:43:13.627467 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 27601
2026-08-12T17:43:13Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2646 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:43:13 dist-test-slave-tk9z krb5kdc[28400](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:43:13 dist-test-slave-tk9z krb5kdc[28400](info): set up 2 sockets
Aug 12 17:43:13 dist-test-slave-tk9z krb5kdc[28400](info): commencing operation
krb5kdc: starting...
W20260812 17:43:14.933360 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.277s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:43:15 dist-test-slave-tk9z krb5kdc[28400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556595, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:43:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:43:15Z Disabled control of system clock
WARNING: no policy specified for oryx/127.17.255.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.255.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.255.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.62.keytab.
Entry for principal oryx/127.17.255.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.62.keytab.
I20260812 17:43:15.067001 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:40187
--webserver_interface=127.17.255.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.62.keytab
--principal=oryx/127.17.255.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:42861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:40187
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:43:15.184995 28419 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:15.185364 28419 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:15.185459 28419 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:15.189553 28419 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:43:15.189668 28419 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:15.189706 28419 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:15.189747 28419 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:43:15.189781 28419 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:43:15.195305 28419 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:42861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:40187
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.62.keytab
--principal=oryx/127.17.255.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:40187
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28419
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:15.196488 28419 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:15.197691 28419 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:15.206763 28428 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:15.206914 28427 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:15.206959 28430 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:15.206982 28419 server_base.cc:1034] running on GCE node
I20260812 17:43:15.207790 28419 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:15.208926 28419 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:15.210126 28419 hybrid_clock.cc:648] HybridClock initialized: now 1786556595210115 us; error 39 us; skew 500 ppm
Aug 12 17:43:15 dist-test-slave-tk9z krb5kdc[28400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556595, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.255.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:15.213018 28419 init.cc:377] Logged in from keytab as oryx/127.17.255.62@KRBTEST.COM (short username oryx)
I20260812 17:43:15.213999 28419 webserver.cc:460] Webserver started at http://127.17.255.62:39937/ using document root <none> and password file <none>
I20260812 17:43:15.214676 28419 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:15.214774 28419 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:15.215026 28419 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:15.217221 28419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "39d0a9a08559400f89e482c682e73ada"
format_stamp: "Formatted at 2026-08-12 17:43:15 on dist-test-slave-tk9z"
server_key: "99231e53dbb5b34aab7577c4c4ba8a64"
server_key_iv: "2c3bd6968f9cf7fc0e32933a849a7f12"
server_key_version: "encryptionkey@0"
I20260812 17:43:15.217830 28419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "39d0a9a08559400f89e482c682e73ada"
format_stamp: "Formatted at 2026-08-12 17:43:15 on dist-test-slave-tk9z"
server_key: "99231e53dbb5b34aab7577c4c4ba8a64"
server_key_iv: "2c3bd6968f9cf7fc0e32933a849a7f12"
server_key_version: "encryptionkey@0"
I20260812 17:43:15.221710 28419 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 17:43:15.224517 28440 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:15.225849 28419 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260812 17:43:15.226011 28419 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "39d0a9a08559400f89e482c682e73ada"
format_stamp: "Formatted at 2026-08-12 17:43:15 on dist-test-slave-tk9z"
server_key: "99231e53dbb5b34aab7577c4c4ba8a64"
server_key_iv: "2c3bd6968f9cf7fc0e32933a849a7f12"
server_key_version: "encryptionkey@0"
I20260812 17:43:15.226142 28419 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:15.242189 28419 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:15.245915 28419 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:15.246151 28419 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:15.253692 28419 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:40187
I20260812 17:43:15.254016 28537 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:40187 every 8 connection(s)
I20260812 17:43:15.254863 28419 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:43:15.257997 28538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:15.263761 28538 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada: Bootstrap starting.
I20260812 17:43:15.264897 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 28419
I20260812 17:43:15.265050 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:43:15.265321 18428 external_mini_cluster.cc:1428] Setting key b3093479f19f9960815f5deeee90a04e
I20260812 17:43:15.266742 28538 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:15.267534 28538 log.cc:824] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada: Log is configured to *not* fsync() on all Append() calls
I20260812 17:43:15.269824 28538 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada: No bootstrap required, opened a new log
Aug 12 17:43:15 dist-test-slave-tk9z krb5kdc[28400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556595, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM
I20260812 17:43:15.274634 28538 raft_consensus.cc:348] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } }
I20260812 17:43:15.274959 28538 raft_consensus.cc:374] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:15.275043 28538 raft_consensus.cc:729] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39d0a9a08559400f89e482c682e73ada, State: Initialized, Role: FOLLOWER
I20260812 17:43:15.275550 28538 consensus_queue.cc:260] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } }
I20260812 17:43:15.275713 28538 raft_consensus.cc:388] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:43:15.275786 28538 raft_consensus.cc:482] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:43:15.275903 28538 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:15.277223 28538 raft_consensus.cc:504] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } }
I20260812 17:43:15.277645 28538 leader_election.cc:302] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 39d0a9a08559400f89e482c682e73ada; no voters:
I20260812 17:43:15.278080 28538 leader_election.cc:288] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:43:15.278205 28548 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:43:15.278543 28548 raft_consensus.cc:686] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [term 1 LEADER]: Becoming Leader. State: Replica: 39d0a9a08559400f89e482c682e73ada, State: Running, Role: LEADER
I20260812 17:43:15.278914 28548 consensus_queue.cc:237] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } }
I20260812 17:43:15.279645 28538 sys_catalog.cc:564] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:43:15.280807 28549 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "39d0a9a08559400f89e482c682e73ada" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } }
I20260812 17:43:15.280944 28549 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [sys.catalog]: This master's current role is: LEADER
I20260812 17:43:15.281270 28551 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [sys.catalog]: SysCatalogTable state changed. Reason: New leader 39d0a9a08559400f89e482c682e73ada. Latest consensus state: current_term: 1 leader_uuid: "39d0a9a08559400f89e482c682e73ada" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } }
I20260812 17:43:15.281409 28551 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [sys.catalog]: This master's current role is: LEADER
I20260812 17:43:15.281704 28562 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:43:15.282249 28545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:15.266535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43780 (local address 127.17.255.62:40187)
0812 17:43:15.267036 (+ 501us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:15.267053 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:15.267090 (+ 37us) server_negotiation.cc:407] Connection header received
0812 17:43:15.267803 (+ 713us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:15.267824 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:15.268157 (+ 333us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:15.268437 (+ 280us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:15.269370 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:15.270504 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:15.271677 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:15.272150 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:15.272273 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:15.275367 (+ 3094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:15.275373 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:15.275387 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:15.275415 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:15.277555 (+ 2140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:15.278145 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:15.278152 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:15.278159 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:15.278334 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:15.278710 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:15.278713 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:15.278715 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:15.279260 (+ 545us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:15.279485 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:15.280270 (+ 785us) server_negotiation.cc:299] Negotiation successful
0812 17:43:15.280669 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":167,"threads_started":1}
I20260812 17:43:15.285703 28562 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:43:15.292215 28562 catalog_manager.cc:1347] Generated new cluster ID: 71dfef96b05640598e35d14e2687f57d
I20260812 17:43:15.292385 28562 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:43:15.317848 28562 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:43:15.319314 28562 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:43:15.326879 28562 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada: Generated new TSK 0
I20260812 17:43:15.327755 28562 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.17.255.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.255.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.255.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.1.keytab.
Entry for principal oryx/127.17.255.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.1.keytab.
I20260812 17:43:15.370009 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.1:0
--local_ip_for_outbound_sockets=127.17.255.1
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:40187
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.1.keytab
--principal=oryx/127.17.255.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:42861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:43:15.494498 28579 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:15.494807 28579 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:15.494853 28579 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:15.499264 28579 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:15.499336 28579 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:15.499396 28579 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.1
I20260812 17:43:15.504868 28579 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:42861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.1.keytab
--principal=oryx/127.17.255.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:40187
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28579
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.1
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:15.506052 28579 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:15.507243 28579 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:15.517335 28585 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:15.517303 28586 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:15.517658 28588 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:15.517454 28579 server_base.cc:1034] running on GCE node
I20260812 17:43:15.518157 28579 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:15.518906 28579 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:15.520092 28579 hybrid_clock.cc:648] HybridClock initialized: now 1786556595520073 us; error 35 us; skew 500 ppm
Aug 12 17:43:15 dist-test-slave-tk9z krb5kdc[28400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556595, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.255.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:15.523052 28579 init.cc:377] Logged in from keytab as oryx/127.17.255.1@KRBTEST.COM (short username oryx)
I20260812 17:43:15.523988 28579 webserver.cc:460] Webserver started at http://127.17.255.1:35041/ using document root <none> and password file <none>
I20260812 17:43:15.524535 28579 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:15.524595 28579 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:15.524765 28579 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:15.526865 28579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-0/data/instance:
uuid: "6be4cec5a2dd4f8797098bbff7094259"
format_stamp: "Formatted at 2026-08-12 17:43:15 on dist-test-slave-tk9z"
server_key: "54aa3c80f4f6365b1bcc6578ab32dffc"
server_key_iv: "afb4735e798d387f15fa9d7fb8101a96"
server_key_version: "encryptionkey@0"
I20260812 17:43:15.527396 28579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance:
uuid: "6be4cec5a2dd4f8797098bbff7094259"
format_stamp: "Formatted at 2026-08-12 17:43:15 on dist-test-slave-tk9z"
server_key: "54aa3c80f4f6365b1bcc6578ab32dffc"
server_key_iv: "afb4735e798d387f15fa9d7fb8101a96"
server_key_version: "encryptionkey@0"
I20260812 17:43:15.531531 28579 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 17:43:15.534016 28598 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:15.535343 28579 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 17:43:15.535496 28579 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-0/wal
uuid: "6be4cec5a2dd4f8797098bbff7094259"
format_stamp: "Formatted at 2026-08-12 17:43:15 on dist-test-slave-tk9z"
server_key: "54aa3c80f4f6365b1bcc6578ab32dffc"
server_key_iv: "afb4735e798d387f15fa9d7fb8101a96"
server_key_version: "encryptionkey@0"
I20260812 17:43:15.535615 28579 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:15.547677 28579 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:15.550902 28579 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:15.551115 28579 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:15.551766 28579 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:43:15.552655 28579 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:43:15.552727 28579 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:15.552803 28579 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:43:15.552857 28579 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:15.562477 28579 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.1:43215
I20260812 17:43:15.562498 28786 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.1:43215 every 8 connection(s)
I20260812 17:43:15.563426 28579 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
I20260812 17:43:15.568461 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 28579
I20260812 17:43:15.568578 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance
I20260812 17:43:15.568879 18428 external_mini_cluster.cc:1428] Setting key 7e8016aadedc1c7131e64f528118f5d6
Aug 12 17:43:15 dist-test-slave-tk9z krb5kdc[28400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556595, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.255.1@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM
WARNING: no policy specified for oryx/127.17.255.2@KRBTEST.COM; defaulting to no policy
I20260812 17:43:15.579087 28545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:15.565367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:55399 (local address 127.17.255.62:40187)
0812 17:43:15.565541 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:15.565547 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:15.566678 (+ 1131us) server_negotiation.cc:407] Connection header received
0812 17:43:15.568073 (+ 1395us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:15.568110 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:15.568180 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:15.568299 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:15.569787 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:15.570539 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:15.571697 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:15.572139 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:15.572262 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:15.575270 (+ 3008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:15.575273 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:15.575275 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:15.575300 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:15.576838 (+ 1538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:15.577379 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:15.577384 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:15.577386 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:15.577474 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:15.577829 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:15.577833 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:15.577835 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:15.578039 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:15.578150 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:15.578773 (+ 623us) server_negotiation.cc:299] Negotiation successful
0812 17:43:15.578905 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 17:43:15.580026 28791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:15.565915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.17.255.1:55399)
0812 17:43:15.566519 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:15.566566 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:15.567825 (+ 1259us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:15.568493 (+ 668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:15.568500 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:15.569010 (+ 510us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:15.569641 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:15.569659 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:15.570670 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:15.570673 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:15.571566 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:15.571576 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:15.572339 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:15.572345 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:15.572614 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:15.573263 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:15.573291 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:15.575091 (+ 1800us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:15.576972 (+ 1881us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:15.576979 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:15.576996 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:15.577271 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:15.577569 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:15.577573 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:15.577575 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:15.577730 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:15.578161 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:15.578170 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:15.578525 (+ 355us) client_negotiation.cc:769] Sending connection context
0812 17:43:15.578730 (+ 205us) client_negotiation.cc:240] Negotiation successful
0812 17:43:15.579078 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":130,"threads_started":1}
I20260812 17:43:15.581435 28787 heartbeater.cc:347] Connected to a master server at 127.17.255.62:40187
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.255.2@KRBTEST.COM" created.
I20260812 17:43:15.581789 28787 heartbeater.cc:464] Registering TS with master...
I20260812 17:43:15.582432 28787 heartbeater.cc:511] Master 127.17.255.62:40187 requested a full tablet report, sending...
I20260812 17:43:15.584286 28476 ts_manager.cc:194] Registered new tserver with Master: 6be4cec5a2dd4f8797098bbff7094259 (127.17.255.1:43215)
I20260812 17:43:15.585659 28476 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.255.1@KRBTEST.COM'} at 127.17.255.1:55399
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.255.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.2.keytab.
Entry for principal oryx/127.17.255.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.2.keytab.
I20260812 17:43:15.599575 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.2:0
--local_ip_for_outbound_sockets=127.17.255.2
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:40187
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.2.keytab
--principal=oryx/127.17.255.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:42861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:43:15.721345 28794 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:15.721637 28794 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:15.721681 28794 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:15.725776 28794 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:15.725837 28794 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:15.725896 28794 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.2
I20260812 17:43:15.731611 28794 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:42861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.2.keytab
--principal=oryx/127.17.255.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:40187
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28794
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.2
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:15.732761 28794 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:15.733790 28794 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 17:43:15.744463 28794 server_base.cc:1034] running on GCE node
W20260812 17:43:15.744369 28807 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:15.744402 28804 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:15.744412 28805 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:15.745204 28794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:15.745891 28794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:15.747092 28794 hybrid_clock.cc:648] HybridClock initialized: now 1786556595747059 us; error 45 us; skew 500 ppm
Aug 12 17:43:15 dist-test-slave-tk9z krb5kdc[28400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556595, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.255.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:15.750051 28794 init.cc:377] Logged in from keytab as oryx/127.17.255.2@KRBTEST.COM (short username oryx)
I20260812 17:43:15.751065 28794 webserver.cc:460] Webserver started at http://127.17.255.2:44873/ using document root <none> and password file <none>
I20260812 17:43:15.751631 28794 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:15.751693 28794 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:15.751863 28794 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:15.753943 28794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-1/data/instance:
uuid: "4e163f02b82c44979f1dd43899bcdc4f"
format_stamp: "Formatted at 2026-08-12 17:43:15 on dist-test-slave-tk9z"
server_key: "b7e22dba51f9217c8e694712f4c37d72"
server_key_iv: "01f036bcaea38f0f5b9c940712230e78"
server_key_version: "encryptionkey@0"
I20260812 17:43:15.754593 28794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance:
uuid: "4e163f02b82c44979f1dd43899bcdc4f"
format_stamp: "Formatted at 2026-08-12 17:43:15 on dist-test-slave-tk9z"
server_key: "b7e22dba51f9217c8e694712f4c37d72"
server_key_iv: "01f036bcaea38f0f5b9c940712230e78"
server_key_version: "encryptionkey@0"
I20260812 17:43:15.758726 28794 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 17:43:15.761116 28817 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:15.762455 28794 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 17:43:15.762605 28794 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-1/wal
uuid: "4e163f02b82c44979f1dd43899bcdc4f"
format_stamp: "Formatted at 2026-08-12 17:43:15 on dist-test-slave-tk9z"
server_key: "b7e22dba51f9217c8e694712f4c37d72"
server_key_iv: "01f036bcaea38f0f5b9c940712230e78"
server_key_version: "encryptionkey@0"
I20260812 17:43:15.762714 28794 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:15.773869 28794 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:15.777149 28794 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:15.777366 28794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:15.778018 28794 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:43:15.778986 28794 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:43:15.779035 28794 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:15.779100 28794 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:43:15.779134 28794 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:15.788793 28794 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.2:35191
I20260812 17:43:15.788815 29003 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.2:35191 every 8 connection(s)
I20260812 17:43:15.789740 28794 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
I20260812 17:43:15.797154 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 28794
I20260812 17:43:15.797284 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance
I20260812 17:43:15.797627 18428 external_mini_cluster.cc:1428] Setting key 9dc807907bd30b56a4436d38dee95758
Aug 12 17:43:15 dist-test-slave-tk9z krb5kdc[28400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556595, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.255.2@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM
I20260812 17:43:15.804172 28545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:15.791627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:39677 (local address 127.17.255.62:40187)
0812 17:43:15.791781 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:15.791786 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:15.792686 (+ 900us) server_negotiation.cc:407] Connection header received
0812 17:43:15.794058 (+ 1372us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:15.794061 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:15.794108 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:15.794185 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:15.795435 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:15.795955 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:15.797106 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:15.797446 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:15.797565 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:15.800228 (+ 2663us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:15.800235 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:15.800241 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:15.800277 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:15.801811 (+ 1534us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:15.802481 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:15.802484 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:15.802485 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:15.802560 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:15.802996 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:15.802999 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:15.803000 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:15.803171 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:15.803245 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:15.803940 (+ 695us) server_negotiation.cc:299] Negotiation successful
0812 17:43:15.804054 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 17:43:15.805496 29007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:15.792054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.17.255.2:39677)
0812 17:43:15.792528 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:15.792572 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:15.793844 (+ 1272us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:15.794355 (+ 511us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:15.794361 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:15.794784 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:15.795300 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:15.795314 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:15.796067 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:15.796069 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:15.796974 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:15.796984 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:15.797598 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:15.797601 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:15.797800 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:15.798480 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:15.798504 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:15.800058 (+ 1554us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:15.801942 (+ 1884us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:15.801949 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:15.801967 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:15.802351 (+ 384us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:15.802658 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:15.802664 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:15.802669 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:15.802863 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:15.803280 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:15.803289 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:15.803635 (+ 346us) client_negotiation.cc:769] Sending connection context
0812 17:43:15.803882 (+ 247us) client_negotiation.cc:240] Negotiation successful
0812 17:43:15.804298 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":120,"threads_started":1}
I20260812 17:43:15.807025 29004 heartbeater.cc:347] Connected to a master server at 127.17.255.62:40187
I20260812 17:43:15.807337 29004 heartbeater.cc:464] Registering TS with master...
I20260812 17:43:15.808066 29004 heartbeater.cc:511] Master 127.17.255.62:40187 requested a full tablet report, sending...
I20260812 17:43:15.809338 28476 ts_manager.cc:194] Registered new tserver with Master: 4e163f02b82c44979f1dd43899bcdc4f (127.17.255.2:35191)
WARNING: no policy specified for oryx/127.17.255.3@KRBTEST.COM; defaulting to no policy
I20260812 17:43:15.809973 28476 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.255.2@KRBTEST.COM'} at 127.17.255.2:39677
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.255.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.255.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.3.keytab.
Entry for principal oryx/127.17.255.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.3.keytab.
I20260812 17:43:15.830120 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.3:0
--local_ip_for_outbound_sockets=127.17.255.3
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:40187
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.3.keytab
--principal=oryx/127.17.255.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:42861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:43:15.954875 29011 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:15.955209 29011 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:15.955286 29011 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:15.959421 29011 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:15.959507 29011 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:15.959600 29011 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.3
I20260812 17:43:15.964977 29011 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:42861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.3.keytab
--principal=oryx/127.17.255.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:40187
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29011
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.3
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:15.966135 29011 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:15.967383 29011 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:15.977451 29020 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:15.977638 29011 server_base.cc:1034] running on GCE node
W20260812 17:43:15.977563 29028 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:15.977795 29023 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:15.978349 29011 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:15.979087 29011 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:15.980304 29011 hybrid_clock.cc:648] HybridClock initialized: now 1786556595980272 us; error 48 us; skew 500 ppm
Aug 12 17:43:15 dist-test-slave-tk9z krb5kdc[28400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556595, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.255.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:15.983398 29011 init.cc:377] Logged in from keytab as oryx/127.17.255.3@KRBTEST.COM (short username oryx)
I20260812 17:43:15.984361 29011 webserver.cc:460] Webserver started at http://127.17.255.3:33109/ using document root <none> and password file <none>
I20260812 17:43:15.984947 29011 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:15.985018 29011 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:15.985285 29011 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:15.987538 29011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-2/data/instance:
uuid: "3e5f6e4a466340ba89376d1ad9bfe4a6"
format_stamp: "Formatted at 2026-08-12 17:43:15 on dist-test-slave-tk9z"
server_key: "18834fa406fd2735af3d7c4b16e8d231"
server_key_iv: "9cbe923442b0ef25888dd62bad5d51cf"
server_key_version: "encryptionkey@0"
I20260812 17:43:15.988188 29011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance:
uuid: "3e5f6e4a466340ba89376d1ad9bfe4a6"
format_stamp: "Formatted at 2026-08-12 17:43:15 on dist-test-slave-tk9z"
server_key: "18834fa406fd2735af3d7c4b16e8d231"
server_key_iv: "9cbe923442b0ef25888dd62bad5d51cf"
server_key_version: "encryptionkey@0"
I20260812 17:43:15.992233 29011 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260812 17:43:15.994925 29048 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:15.996243 29011 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:43:15.996390 29011 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-2/wal
uuid: "3e5f6e4a466340ba89376d1ad9bfe4a6"
format_stamp: "Formatted at 2026-08-12 17:43:15 on dist-test-slave-tk9z"
server_key: "18834fa406fd2735af3d7c4b16e8d231"
server_key_iv: "9cbe923442b0ef25888dd62bad5d51cf"
server_key_version: "encryptionkey@0"
I20260812 17:43:15.996520 29011 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:16.024142 29011 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:16.027458 29011 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:16.027683 29011 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:16.028339 29011 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:43:16.029266 29011 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:43:16.029340 29011 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:16.029415 29011 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:43:16.029467 29011 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:16.038753 29011 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.3:35507
I20260812 17:43:16.038789 29233 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.3:35507 every 8 connection(s)
I20260812 17:43:16.039819 29011 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
I20260812 17:43:16.048882 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 29011
I20260812 17:43:16.049000 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance
I20260812 17:43:16.049252 18428 external_mini_cluster.cc:1428] Setting key 32a9658e2cd70d1f851756613cc2f81b
Aug 12 17:43:16 dist-test-slave-tk9z krb5kdc[28400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556595, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.255.3@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM
I20260812 17:43:16.057739 28545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:16.041775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:55267 (local address 127.17.255.62:40187)
0812 17:43:16.041922 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:16.041925 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:16.042791 (+ 866us) server_negotiation.cc:407] Connection header received
0812 17:43:16.044255 (+ 1464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:16.044258 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:16.044321 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:16.044431 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:16.045698 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.046240 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.047472 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.047703 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.047813 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:16.053667 (+ 5854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:16.053670 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:16.053672 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:16.053701 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:16.055360 (+ 1659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:16.056024 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:16.056027 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:16.056029 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:16.056131 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:16.056573 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:16.056581 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:16.056584 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:16.056821 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:16.056899 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:16.057483 (+ 584us) server_negotiation.cc:299] Negotiation successful
0812 17:43:16.057601 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 17:43:16.058743 29238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:16.042120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.17.255.3:55267)
0812 17:43:16.042638 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:16.042683 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:16.044023 (+ 1340us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:16.044629 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:16.044636 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:16.045034 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:16.045541 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:16.045555 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.046403 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.046409 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:16.047335 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:16.047345 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.047875 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.047879 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:16.048053 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:16.051742 (+ 3689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:16.051762 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:16.053479 (+ 1717us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:16.055556 (+ 2077us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:16.055563 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:16.055580 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:16.055887 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:16.056229 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:16.056231 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:16.056233 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:16.056409 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:16.056918 (+ 509us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:16.056924 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:16.057218 (+ 294us) client_negotiation.cc:769] Sending connection context
0812 17:43:16.057388 (+ 170us) client_negotiation.cc:240] Negotiation successful
0812 17:43:16.057724 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":110,"threads_started":1}
I20260812 17:43:16.060024 29235 heartbeater.cc:347] Connected to a master server at 127.17.255.62:40187
I20260812 17:43:16.060263 29235 heartbeater.cc:464] Registering TS with master...
I20260812 17:43:16.060773 29235 heartbeater.cc:511] Master 127.17.255.62:40187 requested a full tablet report, sending...
I20260812 17:43:16.061899 28476 ts_manager.cc:194] Registered new tserver with Master: 3e5f6e4a466340ba89376d1ad9bfe4a6 (127.17.255.3:35507)
I20260812 17:43:16.062649 28476 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.255.3@KRBTEST.COM'} at 127.17.255.3:55267
I20260812 17:43:16.063544 18428 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.17.255.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.255.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.255.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.61.keytab.
Entry for principal oryx/127.17.255.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.61.keytab.
I20260812 17:43:16.093936 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.61:42601
--webserver_interface=127.17.255.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.61.keytab
--principal=oryx/127.17.255.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:42861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:40187,127.17.255.61:42601
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:43:16.212997 29243 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:16.213279 29243 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:16.213322 29243 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:16.217376 29243 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:43:16.217440 29243 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:16.217460 29243 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:16.217483 29243 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:43:16.217499 29243 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:43:16.223284 29243 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:42861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:40187,127.17.255.61:42601
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.61.keytab
--principal=oryx/127.17.255.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.61:42601
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.17.255.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29243
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
W20260812 17:43:16.223519 29243 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.17.255.62:40187,127.17.255.61:42601'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260812 17:43:16.224407 29243 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:16.225409 29243 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:16.234849 29250 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:16.234876 29251 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:16.234862 29256 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:16.235136 29243 server_base.cc:1034] running on GCE node
I20260812 17:43:16.235828 29243 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:16.237057 29243 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:16.238276 29243 hybrid_clock.cc:648] HybridClock initialized: now 1786556596238259 us; error 33 us; skew 500 ppm
Aug 12 17:43:16 dist-test-slave-tk9z krb5kdc[28400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556596, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.255.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:16.242329 29243 init.cc:377] Logged in from keytab as oryx/127.17.255.61@KRBTEST.COM (short username oryx)
I20260812 17:43:16.243462 29243 webserver.cc:460] Webserver started at http://127.17.255.61:41987/ using document root <none> and password file <none>
I20260812 17:43:16.244088 29243 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:16.244154 29243 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:16.244433 29243 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:16.246812 29243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-1/data/instance:
uuid: "49c170a02d22493c91370a2f8ee1d8e5"
format_stamp: "Formatted at 2026-08-12 17:43:16 on dist-test-slave-tk9z"
server_key: "e8352a8460f979a05317fea113f2421f"
server_key_iv: "63d395854a0615e714f144d8c07b4279"
server_key_version: "encryptionkey@0"
I20260812 17:43:16.247431 29243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-1/wal/instance:
uuid: "49c170a02d22493c91370a2f8ee1d8e5"
format_stamp: "Formatted at 2026-08-12 17:43:16 on dist-test-slave-tk9z"
server_key: "e8352a8460f979a05317fea113f2421f"
server_key_iv: "63d395854a0615e714f144d8c07b4279"
server_key_version: "encryptionkey@0"
I20260812 17:43:16.251843 29243 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260812 17:43:16.254782 29267 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:16.256201 29243 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 17:43:16.256358 29243 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-1/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-1/wal
uuid: "49c170a02d22493c91370a2f8ee1d8e5"
format_stamp: "Formatted at 2026-08-12 17:43:16 on dist-test-slave-tk9z"
server_key: "e8352a8460f979a05317fea113f2421f"
server_key_iv: "63d395854a0615e714f144d8c07b4279"
server_key_version: "encryptionkey@0"
I20260812 17:43:16.256493 29243 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:16.280413 29243 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:16.284190 29243 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:16.284437 29243 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:16.296299 29243 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.61:42601
I20260812 17:43:16.296672 29354 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.61:42601 every 8 connection(s)
I20260812 17:43:16.297533 29243 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-1/data/info.pb
I20260812 17:43:16.300845 29355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:16.302093 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 29243
I20260812 17:43:16.305752 29355 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 17:43:16 dist-test-slave-tk9z krb5kdc[28400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556595, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.255.61@KRBTEST.COM
Aug 12 17:43:16 dist-test-slave-tk9z krb5kdc[28400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556596, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.255.61@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM
I20260812 17:43:16.319800 28545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:16.307661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43788 (local address 127.17.255.62:40187)
0812 17:43:16.307822 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:16.307827 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:16.308302 (+ 475us) server_negotiation.cc:407] Connection header received
0812 17:43:16.308494 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:16.308497 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:16.308543 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:16.308618 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:16.309568 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.310315 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.311784 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.312053 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.312197 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:16.315743 (+ 3546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:16.315748 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:16.315752 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:16.315789 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:16.317547 (+ 1758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:16.318143 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:16.318146 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:16.318148 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:16.318245 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:16.318634 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:16.318638 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:16.318639 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:16.318918 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:16.319033 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:16.319487 (+ 454us) server_negotiation.cc:299] Negotiation successful
0812 17:43:16.319622 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 17:43:16.320628 29364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:16.307584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.0.0.1:43788)
0812 17:43:16.308158 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:16.308210 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:16.308338 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:16.308726 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:16.308732 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:16.309304 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:16.309440 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:16.309446 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.310559 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.310563 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:16.311638 (+ 1075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:16.311646 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.312273 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.312277 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:16.312410 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:16.313177 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:16.313204 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:16.315523 (+ 2319us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:16.317684 (+ 2161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:16.317695 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:16.317708 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:16.318022 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:16.318345 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:16.318350 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:16.318355 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:16.318527 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:16.319033 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:16.319039 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:16.319229 (+ 190us) client_negotiation.cc:769] Sending connection context
0812 17:43:16.319421 (+ 192us) client_negotiation.cc:240] Negotiation successful
0812 17:43:16.319877 (+ 456us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":397,"mutex_wait_us":2,"thread_start_us":161,"threads_started":1}
I20260812 17:43:16.320638 29361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:16.304032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52116 (local address 127.17.255.61:42601)
0812 17:43:16.304627 (+ 595us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:16.304644 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:16.304681 (+ 37us) server_negotiation.cc:407] Connection header received
0812 17:43:16.305483 (+ 802us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:16.305505 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:16.305864 (+ 359us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:16.306277 (+ 413us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:16.307195 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.309082 (+ 1887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.310277 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.311207 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.311381 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:16.314764 (+ 3383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:16.314772 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:16.314796 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:16.314820 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:16.317244 (+ 2424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:16.317863 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:16.317868 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:16.317870 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:16.318039 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:16.318433 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:16.318437 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:16.318439 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:16.319012 (+ 573us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:16.319199 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:16.319464 (+ 265us) server_negotiation.cc:299] Negotiation successful
0812 17:43:16.319731 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":440,"spinlock_wait_cycles":33152,"thread_start_us":219,"threads_started":1}
I20260812 17:43:16.322252 29355 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42601 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 17:43:16 dist-test-slave-tk9z krb5kdc[28400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556596, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.255.61@KRBTEST.COM for oryx/127.17.255.61@KRBTEST.COM
I20260812 17:43:16.330556 29364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:16.322885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.61:42601 (local address 127.0.0.1:52122)
0812 17:43:16.323005 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:16.323022 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:16.323104 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:16.323344 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:16.323346 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:16.323491 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:16.323589 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:16.323594 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.324643 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.324646 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:16.325181 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:16.325189 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.325632 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.325635 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:16.325711 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:16.326213 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:16.326225 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:16.327579 (+ 1354us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:16.329047 (+ 1468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:16.329050 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:16.329051 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:16.329308 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:16.329566 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:16.329568 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:16.329569 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:16.329645 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:16.330039 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:16.330042 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:16.330119 (+ 77us) client_negotiation.cc:769] Sending connection context
0812 17:43:16.330202 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 17:43:16.330411 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260812 17:43:16.330638 29361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:16.322959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52122 (local address 127.17.255.61:42601)
0812 17:43:16.323073 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:16.323077 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:16.323088 (+ 11us) server_negotiation.cc:407] Connection header received
0812 17:43:16.323202 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:16.323204 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:16.323242 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:16.323307 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:16.323688 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.324537 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.325306 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.325534 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.325614 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:16.327700 (+ 2086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:16.327703 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:16.327705 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:16.327727 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:16.328944 (+ 1217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:16.329390 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:16.329393 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:16.329394 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:16.329482 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:16.329751 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:16.329754 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:16.329756 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:16.329950 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:16.330031 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:16.330271 (+ 240us) server_negotiation.cc:299] Negotiation successful
0812 17:43:16.330499 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":47,"server-negotiator.queue_time_us":41}
I20260812 17:43:16.333993 29355 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5: Bootstrap starting.
I20260812 17:43:16.336436 29355 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:16.337548 29355 log.cc:824] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5: Log is configured to *not* fsync() on all Append() calls
I20260812 17:43:16.339748 29355 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5: No bootstrap required, opened a new log
I20260812 17:43:16.343117 29355 raft_consensus.cc:348] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42601 } }
I20260812 17:43:16.343320 29355 raft_consensus.cc:374] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:16.343400 29355 raft_consensus.cc:729] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49c170a02d22493c91370a2f8ee1d8e5, State: Initialized, Role: FOLLOWER
I20260812 17:43:16.343822 29355 consensus_queue.cc:260] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42601 } }
I20260812 17:43:16.344461 29366 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42601 } } }
I20260812 17:43:16.344626 29366 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 17:43:16.345073 29355 sys_catalog.cc:564] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 17:43:16.350687 29382 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 17:43:16.350782 29382 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 17:43:16.352761 29243 master_runner.cc:428] Detected that this master 49c170a02d22493c91370a2f8ee1d8e5 is joining an existing cluster
I20260812 17:43:16.352841 29243 master_runner.cc:432] Initiating AddMaster RPC to add 127.17.255.61:42601
I20260812 17:43:16.364187 29361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:16.355831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52126 (local address 127.17.255.61:42601)
0812 17:43:16.355949 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:16.355953 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:16.356267 (+ 314us) server_negotiation.cc:407] Connection header received
0812 17:43:16.356389 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:16.356392 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:16.356440 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:16.356535 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:16.357251 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.358072 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.359010 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.359215 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.359323 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:16.360564 (+ 1241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:16.360568 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:16.360571 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:16.360599 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:16.362303 (+ 1704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:16.362831 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:16.362837 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:16.362839 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:16.362931 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:16.363244 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:16.363248 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:16.363249 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:16.363532 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:16.363623 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:16.363881 (+ 258us) server_negotiation.cc:299] Negotiation successful
0812 17:43:16.364066 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":81,"server-negotiator.queue_time_us":44}
I20260812 17:43:16.364202 29395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:16.355513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.61:42601 (local address 127.0.0.1:52126)
0812 17:43:16.356169 (+ 656us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:16.356181 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:16.356271 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:16.356572 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:16.356575 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:16.356893 (+ 318us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:16.357122 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:16.357143 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.358196 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.358199 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:16.358887 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:16.358896 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.359332 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.359335 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:16.359486 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:16.359993 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:16.360008 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:16.360437 (+ 429us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:16.362448 (+ 2011us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:16.362451 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:16.362453 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:16.362719 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:16.363040 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:16.363044 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:16.363045 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:16.363142 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:16.363664 (+ 522us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:16.363665 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:16.363731 (+ 66us) client_negotiation.cc:769] Sending connection context
0812 17:43:16.363835 (+ 104us) client_negotiation.cc:240] Negotiation successful
0812 17:43:16.363992 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":579,"mutex_wait_us":41,"thread_start_us":192,"threads_started":1}
I20260812 17:43:16.365084 28545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:16.355626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43796 (local address 127.17.255.62:40187)
0812 17:43:16.355760 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:16.355766 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:16.356682 (+ 916us) server_negotiation.cc:407] Connection header received
0812 17:43:16.356821 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:16.356824 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:16.356872 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:16.357088 (+ 216us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:16.357671 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.358236 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.359570 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.359886 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.360006 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:16.361472 (+ 1466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:16.361476 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:16.361480 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:16.361511 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:16.363133 (+ 1622us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:16.363634 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:16.363637 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:16.363639 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:16.363733 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:16.364074 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:16.364077 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:16.364079 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:16.364300 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:16.364378 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:16.364754 (+ 376us) server_negotiation.cc:299] Negotiation successful
0812 17:43:16.364930 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 17:43:16.365566 29391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:16.355513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.0.0.1:43796)
0812 17:43:16.356549 (+ 1036us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:16.356562 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:16.356705 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:16.357158 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:16.357162 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:16.357371 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:16.357546 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:16.357553 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.358362 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.358395 (+ 33us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:16.359441 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:16.359453 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.360022 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.360026 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:16.360126 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:16.360633 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:16.360649 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:16.361308 (+ 659us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:16.363232 (+ 1924us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:16.363237 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:16.363239 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:16.363522 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:16.363865 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:16.363868 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:16.363870 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:16.363964 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:16.364454 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:16.364457 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:16.364559 (+ 102us) client_negotiation.cc:769] Sending connection context
0812 17:43:16.365237 (+ 678us) client_negotiation.cc:240] Negotiation successful
0812 17:43:16.365383 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":928,"mutex_wait_us":408,"spinlock_wait_cycles":5632,"thread_start_us":96,"threads_started":1}
Aug 12 17:43:16 dist-test-slave-tk9z krb5kdc[28400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556595, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.255.62@KRBTEST.COM for oryx/127.17.255.61@KRBTEST.COM
I20260812 17:43:16.381945 29397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:16.370209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.61:42601 (local address 127.0.0.1:52140)
0812 17:43:16.370698 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:16.370761 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:16.370902 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:16.371209 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:16.371216 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:16.371687 (+ 471us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:16.371872 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:16.371882 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.372659 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.372662 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:16.373702 (+ 1040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:16.373714 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.374330 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.374334 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:16.374498 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:16.375154 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:16.375174 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:16.377248 (+ 2074us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:16.379513 (+ 2265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:16.379526 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:16.379535 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:16.379909 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:16.380324 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:16.380327 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:16.380330 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:16.380433 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:16.381128 (+ 695us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:16.381137 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:16.381295 (+ 158us) client_negotiation.cc:769] Sending connection context
0812 17:43:16.381467 (+ 172us) client_negotiation.cc:240] Negotiation successful
0812 17:43:16.381728 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":156,"threads_started":1}
I20260812 17:43:16.382030 29361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:16.370348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52140 (local address 127.17.255.61:42601)
0812 17:43:16.370918 (+ 570us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:16.370922 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:16.370935 (+ 13us) server_negotiation.cc:407] Connection header received
0812 17:43:16.371031 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:16.371033 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:16.371076 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:16.371142 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:16.372018 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.372544 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.373825 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.374088 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.374210 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:16.377422 (+ 3212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:16.377429 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:16.377434 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:16.377469 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:16.379381 (+ 1912us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:16.380036 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:16.380044 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:16.380049 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:16.380191 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:16.380677 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:16.380683 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:16.380689 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:16.381000 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:16.381112 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:16.381569 (+ 457us) server_negotiation.cc:299] Negotiation successful
0812 17:43:16.381780 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":489}
I20260812 17:43:16.384099 28476 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.17.255.61:42601: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5"
member_type: NON_VOTER
last_known_addr {
host: "127.17.255.61"
port: 42601
}
attrs {
promote: true
}
}
dest_uuid: "39d0a9a08559400f89e482c682e73ada"
cas_config_opid_index: -1
I20260812 17:43:16.385082 28476 consensus_queue.cc:237] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: NON_VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: true } }
WARNING: no policy specified for oryx/127.17.255.60@KRBTEST.COM; defaulting to no policy
I20260812 17:43:16.387543 29406 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 49c170a02d22493c91370a2f8ee1d8e5 (127.17.255.61) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: NON_VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: true } } }
I20260812 17:43:16.388535 29317 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [term 0 FOLLOWER]: Advancing to term 1
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.255.60@KRBTEST.COM" created.
I20260812 17:43:16.390333 29317 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [term 1 FOLLOWER]: Refusing update from remote peer 39d0a9a08559400f89e482c682e73ada: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260812 17:43:16.390733 29406 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.17.255.61:42601
I20260812 17:43:16.391197 29243 master.cc:537] Master@127.17.255.61:42601 shutting down...
I20260812 17:43:16.392052 29406 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [LEADER]: Connected to new peer: Peer: permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: NON_VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:43:16.393913 29405 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "39d0a9a08559400f89e482c682e73ada" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: NON_VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: true } } }
I20260812 17:43:16.394061 29405 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [sys.catalog]: This master's current role is: LEADER
W20260812 17:43:16.395308 28444 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260812 17:43:16.396258 28444 consensus_peers.cc:487] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada -> Peer 49c170a02d22493c91370a2f8ee1d8e5 (127.17.255.61:42601): Couldn't send request to peer 49c170a02d22493c91370a2f8ee1d8e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260812 17:43:16.397032 29243 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:43:16.397307 29243 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:43:16.397401 29243 tablet_replica.cc:330] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5: stopping tablet replica
I20260812 17:43:16.414050 29243 master.cc:552] Master@127.17.255.61:42601 shutdown complete.
I20260812 17:43:16.414134 29243 master_runner.cc:305] Clearing existing system tablet
I20260812 17:43:16.414466 29243 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:16.414548 29243 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:16.416111 29243 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.255.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.60.keytab.
Entry for principal oryx/127.17.255.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.60.keytab.
I20260812 17:43:16.417137 29414 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:16.417413 29243 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:16.417582 29243 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 17:43:16.417622 29243 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-1/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-1/wal
uuid: "49c170a02d22493c91370a2f8ee1d8e5"
format_stamp: "Formatted at 2026-08-12 17:43:16 on dist-test-slave-tk9z"
server_key: "e8352a8460f979a05317fea113f2421f"
server_key_iv: "63d395854a0615e714f144d8c07b4279"
server_key_version: "encryptionkey@0"
I20260812 17:43:16.417840 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.60:39043
--webserver_interface=127.17.255.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.60.keytab
--principal=oryx/127.17.255.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:42861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:40187,127.17.255.61:42601,127.17.255.60:39043
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 17:43:16.420058 29243 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:43:16.423403 29243 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260812 17:43:16.423538 29243 log.cc:1196] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260812 17:43:16.423870 29243 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5: Deleting consensus metadata
I20260812 17:43:16.424096 29243 master_runner.cc:315] Copying system tablet from 127.17.255.62:40187
I20260812 17:43:16.425870 29243 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5: tablet copy: Beginning tablet copy session from remote peer at address 127.17.255.62:40187
I20260812 17:43:16.439525 28545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:16.426858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43806 (local address 127.17.255.62:40187)
0812 17:43:16.427035 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:16.427044 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:16.429830 (+ 2786us) server_negotiation.cc:407] Connection header received
0812 17:43:16.430015 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:16.430019 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:16.430115 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:16.430232 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:16.431267 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.432114 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.433501 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.433878 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.433987 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:16.435458 (+ 1471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:16.435462 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:16.435466 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:16.435498 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:16.437429 (+ 1931us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:16.437982 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:16.437986 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:16.437988 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:16.438087 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:16.438427 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:16.438430 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:16.438432 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:16.438681 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:16.438798 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:16.439163 (+ 365us) server_negotiation.cc:299] Negotiation successful
0812 17:43:16.439310 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 17:43:16.439620 29423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:16.426764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.0.0.1:43806)
0812 17:43:16.429676 (+ 2912us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:16.429694 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:16.429865 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:16.430462 (+ 597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:16.430469 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:16.430787 (+ 318us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:16.431071 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:16.431089 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.432263 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.432267 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:16.433314 (+ 1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:16.433327 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.434015 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.434019 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:16.434139 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:16.434799 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:16.434817 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:16.435282 (+ 465us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:16.437564 (+ 2282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:16.437568 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:16.437570 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:16.437867 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:16.438189 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:16.438193 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:16.438195 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:16.438297 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:16.438789 (+ 492us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:16.438798 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:16.438961 (+ 163us) client_negotiation.cc:769] Sending connection context
0812 17:43:16.439082 (+ 121us) client_negotiation.cc:240] Negotiation successful
0812 17:43:16.439254 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2812,"thread_start_us":110,"threads_started":1}
I20260812 17:43:16.440971 28507 tablet_copy_service.cc:140] P 39d0a9a08559400f89e482c682e73ada: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 49c170a02d22493c91370a2f8ee1d8e5 ({username='oryx', principal='oryx/127.17.255.61@KRBTEST.COM'} at 127.0.0.1:43806)
I20260812 17:43:16.441215 28507 tablet_copy_service.cc:161] P 39d0a9a08559400f89e482c682e73ada: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 49c170a02d22493c91370a2f8ee1d8e5 at {username='oryx', principal='oryx/127.17.255.61@KRBTEST.COM'} at 127.0.0.1:43806: session id = 49c170a02d22493c91370a2f8ee1d8e5-00000000000000000000000000000000
I20260812 17:43:16.443408 28507 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 17:43:16.445657 29243 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 17:43:16.448441 29243 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5: tablet copy: Starting download of 0 data blocks...
I20260812 17:43:16.448697 29243 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5: tablet copy: Starting download of 1 WAL segments...
I20260812 17:43:16.450898 29243 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 17:43:16.452800 28507 tablet_copy_service.cc:342] P 39d0a9a08559400f89e482c682e73ada: Request end of tablet copy session 49c170a02d22493c91370a2f8ee1d8e5-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.17.255.61@KRBTEST.COM'} at 127.0.0.1:43806
I20260812 17:43:16.452950 28507 tablet_copy_service.cc:433] P 39d0a9a08559400f89e482c682e73ada: ending tablet copy session 49c170a02d22493c91370a2f8ee1d8e5-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 49c170a02d22493c91370a2f8ee1d8e5
I20260812 17:43:16.461756 29243 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:16.463877 29424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:16.464207 29431 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:16.463938 29426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:16.464461 29243 server_base.cc:1034] running on GCE node
I20260812 17:43:16.464766 29243 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:16.465090 29243 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:16.466243 29243 hybrid_clock.cc:648] HybridClock initialized: now 1786556596466219 us; error 40 us; skew 500 ppm
Aug 12 17:43:16 dist-test-slave-tk9z krb5kdc[28400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556596, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.255.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:16.468075 29243 init.cc:377] Logged in from keytab as oryx/127.17.255.61@KRBTEST.COM (short username oryx)
I20260812 17:43:16.468652 29243 webserver.cc:460] Webserver started at http://127.17.255.61:33157/ using document root <none> and password file <none>
I20260812 17:43:16.468873 29243 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:16.468916 29243 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:16.470332 29243 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 17:43:16.471529 29440 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:16.471807 29243 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 17:43:16.471886 29243 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-1/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-1/wal
uuid: "49c170a02d22493c91370a2f8ee1d8e5"
format_stamp: "Formatted at 2026-08-12 17:43:16 on dist-test-slave-tk9z"
server_key: "e8352a8460f979a05317fea113f2421f"
server_key_iv: "63d395854a0615e714f144d8c07b4279"
server_key_version: "encryptionkey@0"
I20260812 17:43:16.471966 29243 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:16.487011 29243 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:16.489502 29243 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:16.497599 29243 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.61:42601
I20260812 17:43:16.498526 29243 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-1/data/info.pb
I20260812 17:43:16.497630 29526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.61:42601 every 8 connection(s)
I20260812 17:43:16.501441 29527 sys_catalog.cc:263] Verifying existing consensus state
I20260812 17:43:16.502703 29527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5: Bootstrap starting.
I20260812 17:43:16.514667 29527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 17:43:16.515131 29527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5: Bootstrap complete.
I20260812 17:43:16.515772 29527 raft_consensus.cc:348] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: NON_VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: true } }
I20260812 17:43:16.515916 29527 raft_consensus.cc:729] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 49c170a02d22493c91370a2f8ee1d8e5, State: Initialized, Role: LEARNER
I20260812 17:43:16.516022 29527 consensus_queue.cc:260] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: NON_VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: true } }
I20260812 17:43:16.516390 29530 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: NON_VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: true } } }
I20260812 17:43:16.516585 29530 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [sys.catalog]: This master's current role is: LEARNER
I20260812 17:43:16.516590 29527 sys_catalog.cc:564] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:43:16.521005 29546 catalog_manager.cc:1259] Loaded cluster ID: 71dfef96b05640598e35d14e2687f57d
I20260812 17:43:16.521081 29546 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5: loading cluster ID for follower catalog manager: success
I20260812 17:43:16.523388 29546 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5: acquiring CA information for follower catalog manager: success
I20260812 17:43:16.524876 29546 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260812 17:43:16.578347 29416 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:16.578727 29416 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:16.578840 29416 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:16.583262 29416 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:43:16.583353 29416 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:16.583390 29416 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:16.583447 29416 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:43:16.583485 29416 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:43:16.588721 28787 heartbeater.cc:503] Master 127.17.255.62:40187 was elected leader, sending a full tablet report...
I20260812 17:43:16.589071 29416 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:42861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:40187,127.17.255.61:42601,127.17.255.60:39043
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.60.keytab
--principal=oryx/127.17.255.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.60:39043
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.17.255.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29416
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:16.590534 29416 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:16.591573 29416 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:16.601610 29561 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:16.601873 29416 server_base.cc:1034] running on GCE node
W20260812 17:43:16.601682 29555 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:16.601642 29558 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:16.602675 29416 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:16.603832 29416 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:16.605036 29416 hybrid_clock.cc:648] HybridClock initialized: now 1786556596604994 us; error 53 us; skew 500 ppm
Aug 12 17:43:16 dist-test-slave-tk9z krb5kdc[28400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556596, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.255.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:16.608203 29416 init.cc:377] Logged in from keytab as oryx/127.17.255.60@KRBTEST.COM (short username oryx)
I20260812 17:43:16.609133 29416 webserver.cc:460] Webserver started at http://127.17.255.60:45315/ using document root <none> and password file <none>
I20260812 17:43:16.609719 29416 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:16.609812 29416 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:16.610059 29416 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:16.612237 29416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-2/data/instance:
uuid: "5c516b82a7a54204b11fbd229b8ede87"
format_stamp: "Formatted at 2026-08-12 17:43:16 on dist-test-slave-tk9z"
server_key: "e8582a72269008a74950d52c56eaef43"
server_key_iv: "878ed6c080d86f933af75a8d9eaa055f"
server_key_version: "encryptionkey@0"
I20260812 17:43:16.612870 29416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-2/wal/instance:
uuid: "5c516b82a7a54204b11fbd229b8ede87"
format_stamp: "Formatted at 2026-08-12 17:43:16 on dist-test-slave-tk9z"
server_key: "e8582a72269008a74950d52c56eaef43"
server_key_iv: "878ed6c080d86f933af75a8d9eaa055f"
server_key_version: "encryptionkey@0"
I20260812 17:43:16.617074 29416 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 17:43:16.620201 29570 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:16.621573 29416 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 17:43:16.621732 29416 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-2/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-2/wal
uuid: "5c516b82a7a54204b11fbd229b8ede87"
format_stamp: "Formatted at 2026-08-12 17:43:16 on dist-test-slave-tk9z"
server_key: "e8582a72269008a74950d52c56eaef43"
server_key_iv: "878ed6c080d86f933af75a8d9eaa055f"
server_key_version: "encryptionkey@0"
I20260812 17:43:16.621865 29416 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:16.649914 29416 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:16.653684 29416 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:16.653982 29416 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:16.666575 29416 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.60:39043
I20260812 17:43:16.666962 29649 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.60:39043 every 8 connection(s)
I20260812 17:43:16.667943 29416 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-2/data/info.pb
I20260812 17:43:16.668514 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 29416
I20260812 17:43:16.671618 29651 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:16.676681 29651 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 17:43:16 dist-test-slave-tk9z krb5kdc[28400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556595, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.255.60@KRBTEST.COM
Aug 12 17:43:16 dist-test-slave-tk9z krb5kdc[28400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556596, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.255.60@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM
I20260812 17:43:16.686623 29653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:16.670188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33116 (local address 127.17.255.60:39043)
0812 17:43:16.670782 (+ 594us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:16.670836 (+ 54us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:16.670881 (+ 45us) server_negotiation.cc:407] Connection header received
0812 17:43:16.672111 (+ 1230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:16.672160 (+ 49us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:16.672607 (+ 447us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:16.673004 (+ 397us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:16.673904 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.675662 (+ 1758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.676553 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.677337 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.677493 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:16.681374 (+ 3881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:16.681380 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:16.681390 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:16.681421 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:16.683429 (+ 2008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:16.683901 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:16.683910 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:16.683916 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:16.684078 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:16.684489 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:16.684494 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:16.684496 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:16.684913 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:16.685118 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:16.685433 (+ 315us) server_negotiation.cc:299] Negotiation successful
0812 17:43:16.685722 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":448,"thread_start_us":279,"threads_started":1}
I20260812 17:43:16.689925 28545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:16.679008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43810 (local address 127.17.255.62:40187)
0812 17:43:16.679165 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:16.679170 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:16.679959 (+ 789us) server_negotiation.cc:407] Connection header received
0812 17:43:16.680216 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:16.680220 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:16.680280 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:16.680400 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:16.681681 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.682662 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.683592 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.683812 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.683937 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:16.686545 (+ 2608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:16.686556 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:16.686558 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:16.686584 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:16.688098 (+ 1514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:16.688593 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:16.688596 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:16.688598 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:16.688710 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:16.689003 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:16.689007 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:16.689008 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:16.689188 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:16.689300 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:16.689629 (+ 329us) server_negotiation.cc:299] Negotiation successful
0812 17:43:16.689751 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 17:43:16.689951 29655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:16.679058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.0.0.1:43810)
0812 17:43:16.679791 (+ 733us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:16.679869 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:16.680027 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:16.680485 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:16.680492 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:16.681322 (+ 830us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:16.681527 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:16.681535 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.682786 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.682789 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:16.683431 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:16.683441 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.683952 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.683955 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:16.684081 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:16.684737 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:16.684749 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:16.686354 (+ 1605us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:16.688218 (+ 1864us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:16.688228 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:16.688234 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:16.688474 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:16.688813 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:16.688816 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:16.688818 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:16.688906 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:16.689302 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:16.689310 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:16.689428 (+ 118us) client_negotiation.cc:769] Sending connection context
0812 17:43:16.689571 (+ 143us) client_negotiation.cc:240] Negotiation successful
0812 17:43:16.689751 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":300,"threads_started":1}
I20260812 17:43:16.691187 29651 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42601 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 17:43:16 dist-test-slave-tk9z krb5kdc[28400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556596, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.255.60@KRBTEST.COM for oryx/127.17.255.61@KRBTEST.COM
I20260812 17:43:16.699965 29655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:16.691715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.61:42601 (local address 127.0.0.1:52150)
0812 17:43:16.691843 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:16.691858 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:16.691932 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:16.692390 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:16.692392 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:16.692531 (+ 139us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:16.692706 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:16.692711 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.693641 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.693644 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:16.694163 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:16.694171 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.694680 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.694683 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:16.694843 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:16.695295 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:16.695307 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:16.696616 (+ 1309us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:16.698630 (+ 2014us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:16.698633 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:16.698635 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:16.698834 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:16.699103 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:16.699105 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:16.699106 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:16.699182 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:16.699524 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:16.699526 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:16.699609 (+ 83us) client_negotiation.cc:769] Sending connection context
0812 17:43:16.699689 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 17:43:16.699797 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260812 17:43:16.699990 29657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:16.691854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52150 (local address 127.17.255.61:42601)
0812 17:43:16.692107 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:16.692110 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:16.692123 (+ 13us) server_negotiation.cc:407] Connection header received
0812 17:43:16.692161 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:16.692162 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:16.692200 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:16.692284 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:16.692825 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.693520 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.694274 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.694563 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.694647 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:16.696762 (+ 2115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:16.696765 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:16.696767 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:16.696793 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:16.698513 (+ 1720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:16.698927 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:16.698929 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:16.698930 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:16.699020 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:16.699260 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:16.699262 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:16.699263 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:16.699441 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:16.699517 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:16.699748 (+ 231us) server_negotiation.cc:299] Negotiation successful
0812 17:43:16.699850 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":110,"threads_started":1}
I20260812 17:43:16.701052 29651 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.255.60" port: 39043 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 17:43:16 dist-test-slave-tk9z krb5kdc[28400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556596, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.255.60@KRBTEST.COM for oryx/127.17.255.60@KRBTEST.COM
I20260812 17:43:16.709347 29655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:16.701669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:39043 (local address 127.0.0.1:33120)
0812 17:43:16.701813 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:16.701828 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:16.701916 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:16.702153 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:16.702156 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:16.702329 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:16.702483 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:16.702489 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.703748 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.703751 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:16.704242 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:16.704250 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.704729 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.704732 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:16.704809 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:16.705235 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:16.705247 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:16.706589 (+ 1342us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:16.708109 (+ 1520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:16.708111 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:16.708113 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:16.708296 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:16.708533 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:16.708535 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:16.708537 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:16.708609 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:16.708951 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:16.708953 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:16.709028 (+ 75us) client_negotiation.cc:769] Sending connection context
0812 17:43:16.709106 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 17:43:16.709201 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260812 17:43:16.709374 29653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:16.701700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33120 (local address 127.17.255.60:39043)
0812 17:43:16.701813 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:16.701819 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:16.701873 (+ 54us) server_negotiation.cc:407] Connection header received
0812 17:43:16.702013 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:16.702016 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:16.702060 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:16.702143 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:16.702592 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.703150 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.704366 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.704617 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.704730 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:16.706715 (+ 1985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:16.706718 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:16.706719 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:16.706741 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:16.708010 (+ 1269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:16.708378 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:16.708381 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:16.708382 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:16.708450 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:16.708693 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:16.708695 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:16.708697 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:16.708871 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:16.708946 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:16.709165 (+ 219us) server_negotiation.cc:299] Negotiation successful
0812 17:43:16.709254 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 17:43:16.712623 29651 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87: Bootstrap starting.
I20260812 17:43:16.715395 29651 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:16.716264 29651 log.cc:824] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87: Log is configured to *not* fsync() on all Append() calls
I20260812 17:43:16.718325 29651 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87: No bootstrap required, opened a new log
I20260812 17:43:16.721853 29651 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42601 } } peers { permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 39043 } }
I20260812 17:43:16.722069 29651 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:16.722105 29651 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c516b82a7a54204b11fbd229b8ede87, State: Initialized, Role: FOLLOWER
I20260812 17:43:16.722613 29651 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42601 } } peers { permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 39043 } }
I20260812 17:43:16.723119 29660 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42601 } } peers { permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 39043 } } }
I20260812 17:43:16.723245 29660 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 17:43:16.724361 29651 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 17:43:16.730561 29678 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 17:43:16.730652 29678 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 17:43:16.734742 29416 master_runner.cc:428] Detected that this master 5c516b82a7a54204b11fbd229b8ede87 is joining an existing cluster
I20260812 17:43:16.734822 29416 master_runner.cc:432] Initiating AddMaster RPC to add 127.17.255.60:39043
I20260812 17:43:16.740109 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 28579
I20260812 17:43:16.753450 29653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:16.738757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33128 (local address 127.17.255.60:39043)
0812 17:43:16.739037 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:16.739042 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:16.739950 (+ 908us) server_negotiation.cc:407] Connection header received
0812 17:43:16.740106 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:16.740109 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:16.740143 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:16.740189 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:16.746042 (+ 5853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.746602 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.747636 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.747860 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.747915 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:16.749533 (+ 1618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:16.749536 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:16.749539 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:16.749555 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:16.751248 (+ 1693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:16.751888 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:16.751891 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:16.751893 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:16.751980 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:16.752350 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:16.752353 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:16.752354 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:16.752556 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:16.752641 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:16.753025 (+ 384us) server_negotiation.cc:299] Negotiation successful
0812 17:43:16.753279 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":119,"server-negotiator.queue_time_us":215}
I20260812 17:43:16.753886 29691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:16.738735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:39043 (local address 127.0.0.1:33128)
0812 17:43:16.739858 (+ 1123us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:16.739872 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:16.740014 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:16.745481 (+ 5467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:16.745483 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:16.745789 (+ 306us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:16.745922 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:16.745928 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.746698 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.746700 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:16.747518 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:16.747531 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.748121 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.748124 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:16.748231 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:16.748848 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:16.748862 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:16.749406 (+ 544us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:16.751381 (+ 1975us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:16.751388 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:16.751404 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:16.751766 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:16.752094 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:16.752100 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:16.752105 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:16.752244 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:16.752664 (+ 420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:16.752669 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:16.752815 (+ 146us) client_negotiation.cc:769] Sending connection context
0812 17:43:16.752962 (+ 147us) client_negotiation.cc:240] Negotiation successful
0812 17:43:16.753192 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1007,"mutex_wait_us":34,"thread_start_us":149,"threads_started":1}
I20260812 17:43:16.764394 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.1:43215
--local_ip_for_outbound_sockets=127.17.255.1
--tserver_master_addrs=127.17.255.62:40187
--webserver_port=35041
--webserver_interface=127.17.255.1
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.1.keytab
--principal=oryx/127.17.255.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:42861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.17.255.62:40187,127.17.255.61:42601
--tserver_master_addrs=127.17.255.62:40187,127.17.255.61:42601,127.17.255.60:39043 with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 17:43:16.768563 28545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:16.738074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43812 (local address 127.17.255.62:40187)
0812 17:43:16.738210 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:16.738215 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:16.738596 (+ 381us) server_negotiation.cc:407] Connection header received
0812 17:43:16.738848 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:16.738852 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:16.738930 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:16.738991 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:16.759840 (+ 20849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.760731 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.762197 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.762610 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.762728 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:16.764284 (+ 1556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:16.764287 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:16.764289 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:16.764317 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:16.766199 (+ 1882us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:16.766871 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:16.766878 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:16.766881 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:16.767002 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:16.767431 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:16.767435 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:16.767437 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:16.767706 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:16.767821 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:16.768233 (+ 412us) server_negotiation.cc:299] Negotiation successful
0812 17:43:16.768373 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 17:43:16.768617 29689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:16.737979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.0.0.1:43812)
0812 17:43:16.738488 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:16.738503 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:16.738712 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:16.739161 (+ 449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:16.739166 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:16.758934 (+ 19768us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:16.759615 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:16.759635 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.760889 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.760894 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:16.762038 (+ 1144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:16.762057 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.762759 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.762766 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:16.762899 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:16.763576 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:16.763599 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:16.764100 (+ 501us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:16.766430 (+ 2330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:16.766437 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:16.766441 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:16.766702 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:16.767161 (+ 459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:16.767167 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:16.767170 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:16.767290 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:16.767844 (+ 554us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:16.767850 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:16.768001 (+ 151us) client_negotiation.cc:769] Sending connection context
0812 17:43:16.768129 (+ 128us) client_negotiation.cc:240] Negotiation successful
0812 17:43:16.768336 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":104,"threads_started":1}
I20260812 17:43:16.775395 29692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:16.738130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.61:42601 (local address 127.0.0.1:52164)
0812 17:43:16.739333 (+ 1203us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:16.739348 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:16.739517 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:16.739878 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:16.739880 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:16.740101 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:16.745281 (+ 5180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:16.745292 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.746848 (+ 1556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.746855 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:16.748330 (+ 1475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:16.748348 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.749763 (+ 1415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.749769 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:16.750315 (+ 546us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:16.770939 (+ 20624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:16.770955 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:16.771416 (+ 461us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:16.773545 (+ 2129us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:16.773549 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:16.773551 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:16.773806 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:16.774141 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:16.774145 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:16.774147 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:16.774233 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:16.774749 (+ 516us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:16.774752 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:16.774930 (+ 178us) client_negotiation.cc:769] Sending connection context
0812 17:43:16.775028 (+ 98us) client_negotiation.cc:240] Negotiation successful
0812 17:43:16.775189 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1138,"mutex_wait_us":4849,"thread_start_us":164,"threads_started":1}
I20260812 17:43:16.775998 29657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:16.738560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52164 (local address 127.17.255.61:42601)
0812 17:43:16.738703 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:16.738707 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:16.739486 (+ 779us) server_negotiation.cc:407] Connection header received
0812 17:43:16.739605 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:16.739607 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:16.739659 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:16.739740 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:16.745493 (+ 5753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.746662 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.748913 (+ 2251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.749441 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.749552 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:16.771623 (+ 22071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:16.771627 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:16.771630 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:16.771664 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:16.773377 (+ 1713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:16.773940 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:16.773943 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:16.773945 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:16.774035 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:16.774330 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:16.774333 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:16.774335 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:16.774608 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:16.774702 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:16.775689 (+ 987us) server_negotiation.cc:299] Negotiation successful
0812 17:43:16.775830 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
Aug 12 17:43:16 dist-test-slave-tk9z krb5kdc[28400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556595, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.255.62@KRBTEST.COM for oryx/127.17.255.60@KRBTEST.COM
I20260812 17:43:16.786051 29397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:16.773810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:39043 (local address 127.0.0.1:33140)
0812 17:43:16.774122 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:16.774140 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:16.774234 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:16.775325 (+ 1091us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:16.775331 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:16.775579 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:16.775727 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:16.775738 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.777377 (+ 1639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.777383 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:16.778465 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:16.778481 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.779093 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.779098 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:16.779251 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:16.779819 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:16.779839 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:16.781828 (+ 1989us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:16.784184 (+ 2356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:16.784187 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:16.784190 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:16.784466 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:16.784805 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:16.784809 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:16.784811 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:16.784923 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:16.785446 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:16.785449 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:16.785563 (+ 114us) client_negotiation.cc:769] Sending connection context
0812 17:43:16.785676 (+ 113us) client_negotiation.cc:240] Negotiation successful
0812 17:43:16.785859 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206}
I20260812 17:43:16.786087 29653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:16.774457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33140 (local address 127.17.255.60:39043)
0812 17:43:16.774892 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:16.774896 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:16.774912 (+ 16us) server_negotiation.cc:407] Connection header received
0812 17:43:16.775002 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:16.775007 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:16.775081 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:16.775167 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:16.776367 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.777223 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.778588 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.778948 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.779058 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:16.782007 (+ 2949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:16.782011 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:16.782014 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:16.782044 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:16.784031 (+ 1987us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:16.784584 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:16.784588 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:16.784590 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:16.784692 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:16.785023 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:16.785026 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:16.785028 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:16.785276 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:16.785377 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:16.785767 (+ 390us) server_negotiation.cc:299] Negotiation successful
0812 17:43:16.785922 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334}
I20260812 17:43:16.787688 28476 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.17.255.60:39043: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87"
member_type: NON_VOTER
last_known_addr {
host: "127.17.255.60"
port: 39043
}
attrs {
promote: true
}
}
dest_uuid: "39d0a9a08559400f89e482c682e73ada"
cas_config_opid_index: 5
I20260812 17:43:16.788419 28476 consensus_queue.cc:237] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: NON_VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: true } } peers { permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87" member_type: NON_VOTER last_known_addr { host: "127.17.255.60" port: 39043 } attrs { promote: true } }
I20260812 17:43:16.794584 29406 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 5c516b82a7a54204b11fbd229b8ede87 (127.17.255.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: NON_VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: true } } peers { permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87" member_type: NON_VOTER last_known_addr { host: "127.17.255.60" port: 39043 } attrs { promote: true } } }
I20260812 17:43:16.795332 29620 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:16.796252 29406 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.17.255.60:39043
I20260812 17:43:16.796483 29406 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "39d0a9a08559400f89e482c682e73ada" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: NON_VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: true } } peers { permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87" member_type: NON_VOTER last_known_addr { host: "127.17.255.60" port: 39043 } attrs { promote: true } } }
I20260812 17:43:16.796583 29406 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [sys.catalog]: This master's current role is: LEADER
I20260812 17:43:16.796916 29620 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [term 1 FOLLOWER]: Refusing update from remote peer 39d0a9a08559400f89e482c682e73ada: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260812 17:43:16.797233 29416 master.cc:537] Master@127.17.255.60:39043 shutting down...
I20260812 17:43:16.797941 29405 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87" member_type: NON_VOTER last_known_addr { host: "127.17.255.60" port: 39043 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 17:43:16.800558 28444 consensus_peers.cc:487] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada -> Peer 5c516b82a7a54204b11fbd229b8ede87 (127.17.255.60:39043): Couldn't send request to peer 5c516b82a7a54204b11fbd229b8ede87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260812 17:43:16.802539 29416 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:43:16.802871 29416 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:43:16.803153 29416 tablet_replica.cc:330] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87: stopping tablet replica
I20260812 17:43:16.803589 29397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:16.789866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.61:42601 (local address 127.0.0.1:52168)
0812 17:43:16.790236 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:16.790275 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:16.790411 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:16.798109 (+ 7698us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:16.798113 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:16.798136 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:43:16.798235 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:16.798245 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.799556 (+ 1311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.799560 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:16.801894 (+ 2334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:16.801908 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.803131 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.803134 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:16.803233 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:16.803287 (+ 54us) client_negotiation.cc:769] Sending connection context
0812 17:43:16.803358 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 17:43:16.803439 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263}
I20260812 17:43:16.804023 29657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:16.794546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52168 (local address 127.17.255.61:42601)
0812 17:43:16.797699 (+ 3153us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:16.797705 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:16.797722 (+ 17us) server_negotiation.cc:407] Connection header received
0812 17:43:16.797783 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:16.797786 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:16.797853 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:16.797956 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:43:16.798400 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.799403 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.802062 (+ 2659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.802769 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.802857 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:16.803021 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:16.803815 (+ 794us) server_negotiation.cc:299] Negotiation successful
0812 17:43:16.803903 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3041}
I20260812 17:43:16.804508 29481 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [term 1 LEARNER]: Refusing update from remote peer 39d0a9a08559400f89e482c682e73ada: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260812 17:43:16.804983 29405 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [LEADER]: Connected to new peer: Peer: permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: NON_VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260812 17:43:16.807111 29481 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 5c516b82a7a54204b11fbd229b8ede87 (127.17.255.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: NON_VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: true } } peers { permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87" member_type: NON_VOTER last_known_addr { host: "127.17.255.60" port: 39043 } attrs { promote: true } } }
I20260812 17:43:16.809728 29530 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 39d0a9a08559400f89e482c682e73ada. Latest consensus state: current_term: 1 leader_uuid: "39d0a9a08559400f89e482c682e73ada" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: NON_VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: true } } peers { permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87" member_type: NON_VOTER last_known_addr { host: "127.17.255.60" port: 39043 } attrs { promote: true } } }
I20260812 17:43:16.809880 29530 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [sys.catalog]: This master's current role is: LEARNER
I20260812 17:43:16.809984 29530 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "39d0a9a08559400f89e482c682e73ada" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: NON_VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: true } } peers { permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87" member_type: NON_VOTER last_known_addr { host: "127.17.255.60" port: 39043 } attrs { promote: true } } }
I20260812 17:43:16.810063 29530 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [sys.catalog]: This master's current role is: LEARNER
I20260812 17:43:16.810222 29416 master.cc:552] Master@127.17.255.60:39043 shutdown complete.
I20260812 17:43:16.810300 29416 master_runner.cc:305] Clearing existing system tablet
I20260812 17:43:16.810586 29416 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:16.810674 29416 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:16.812096 29416 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 17:43:16.812390 29004 heartbeater.cc:503] Master 127.17.255.62:40187 was elected leader, sending a full tablet report...
I20260812 17:43:16.814620 29704 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:16.814721 29406 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada: attempting to promote NON_VOTER 49c170a02d22493c91370a2f8ee1d8e5 to VOTER
I20260812 17:43:16.814823 29416 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:16.814934 29416 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 17:43:16.814966 29416 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-2/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-2/wal
uuid: "5c516b82a7a54204b11fbd229b8ede87"
format_stamp: "Formatted at 2026-08-12 17:43:16 on dist-test-slave-tk9z"
server_key: "e8582a72269008a74950d52c56eaef43"
server_key_iv: "878ed6c080d86f933af75a8d9eaa055f"
server_key_version: "encryptionkey@0"
I20260812 17:43:16.815213 29406 consensus_queue.cc:237] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: false } } peers { permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87" member_type: NON_VOTER last_known_addr { host: "127.17.255.60" port: 39043 } attrs { promote: true } }
I20260812 17:43:16.817340 29397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:16.816898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:39043 (local address 127.0.0.1:33154)
0812 17:43:16.817163 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:16.817248 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.60:39043: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184}
I20260812 17:43:16.817312 29416 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:43:16.817888 29481 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [term 1 LEARNER]: Refusing update from remote peer 39d0a9a08559400f89e482c682e73ada: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260812 17:43:16.818850 29405 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [LEADER]: Connected to new peer: Peer: permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260812 17:43:16.819809 29397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:16.819454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:39043 (local address 127.0.0.1:33164)
0812 17:43:16.819681 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:16.819732 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.60:39043: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154}
I20260812 17:43:16.820233 29416 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260812 17:43:16.820335 29416 log.cc:1196] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260812 17:43:16.820673 29416 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87: Deleting consensus metadata
W20260812 17:43:16.820813 28444 consensus_peers.cc:487] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada -> Peer 5c516b82a7a54204b11fbd229b8ede87 (127.17.255.60:39043): Couldn't send request to peer 5c516b82a7a54204b11fbd229b8ede87. Status: Network error: Client connection negotiation failed: client connection to 127.17.255.60:39043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 17:43:16.820863 29416 master_runner.cc:315] Copying system tablet from 127.17.255.62:40187
I20260812 17:43:16.822131 29416 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87: tablet copy: Beginning tablet copy session from remote peer at address 127.17.255.62:40187
I20260812 17:43:16.823396 29405 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 49c170a02d22493c91370a2f8ee1d8e5 (127.17.255.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: false } } peers { permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87" member_type: NON_VOTER last_known_addr { host: "127.17.255.60" port: 39043 } attrs { promote: true } } }
I20260812 17:43:16.824922 29405 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "39d0a9a08559400f89e482c682e73ada" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: false } } peers { permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87" member_type: NON_VOTER last_known_addr { host: "127.17.255.60" port: 39043 } attrs { promote: true } } }
I20260812 17:43:16.825029 29405 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [sys.catalog]: This master's current role is: LEADER
I20260812 17:43:16.825147 29405 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "39d0a9a08559400f89e482c682e73ada" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: false } } peers { permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87" member_type: NON_VOTER last_known_addr { host: "127.17.255.60" port: 39043 } attrs { promote: true } } }
I20260812 17:43:16.825210 29405 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [sys.catalog]: This master's current role is: LEADER
I20260812 17:43:16.826167 29481 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 49c170a02d22493c91370a2f8ee1d8e5 (127.17.255.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: false } } peers { permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87" member_type: NON_VOTER last_known_addr { host: "127.17.255.60" port: 39043 } attrs { promote: true } } }
I20260812 17:43:16.827801 29698 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "39d0a9a08559400f89e482c682e73ada" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: false } } peers { permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87" member_type: NON_VOTER last_known_addr { host: "127.17.255.60" port: 39043 } attrs { promote: true } } }
I20260812 17:43:16.827926 29698 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 17:43:16.832912 28545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:16.822742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43814 (local address 127.17.255.62:40187)
0812 17:43:16.822859 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:16.822865 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:16.823381 (+ 516us) server_negotiation.cc:407] Connection header received
0812 17:43:16.823600 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:16.823605 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:16.823667 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:16.823721 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:16.824433 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.825243 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.826741 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.827071 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.827162 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:16.828889 (+ 1727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:16.828893 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:16.828896 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:16.828925 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:16.830936 (+ 2011us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:16.831481 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:16.831485 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:16.831487 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:16.831583 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:16.831901 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:16.831904 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:16.831906 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:16.832157 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:16.832263 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:16.832608 (+ 345us) server_negotiation.cc:299] Negotiation successful
0812 17:43:16.832741 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 17:43:16.832937 29714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:16.822963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.0.0.1:43814)
0812 17:43:16.823291 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:16.823306 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:16.823481 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:16.823891 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:16.823894 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:16.824131 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:16.824270 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:16.824278 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.825459 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.825462 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:16.826543 (+ 1081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:16.826555 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:16.827436 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:16.827439 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:16.827535 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:16.828168 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:16.828186 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:16.828657 (+ 471us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:16.831068 (+ 2411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:16.831072 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:16.831074 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:16.831355 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:16.831686 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:16.831688 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:16.831690 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:16.831790 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:16.832272 (+ 482us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:16.832275 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:16.832404 (+ 129us) client_negotiation.cc:769] Sending connection context
0812 17:43:16.832531 (+ 127us) client_negotiation.cc:240] Negotiation successful
0812 17:43:16.832719 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":99,"threads_started":1}
I20260812 17:43:16.833600 28507 tablet_copy_service.cc:140] P 39d0a9a08559400f89e482c682e73ada: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 5c516b82a7a54204b11fbd229b8ede87 ({username='oryx', principal='oryx/127.17.255.60@KRBTEST.COM'} at 127.0.0.1:43814)
I20260812 17:43:16.833743 28507 tablet_copy_service.cc:161] P 39d0a9a08559400f89e482c682e73ada: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 5c516b82a7a54204b11fbd229b8ede87 at {username='oryx', principal='oryx/127.17.255.60@KRBTEST.COM'} at 127.0.0.1:43814: session id = 5c516b82a7a54204b11fbd229b8ede87-00000000000000000000000000000000
I20260812 17:43:16.835220 28507 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 17:43:16.836807 29416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 17:43:16.839411 29416 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87: tablet copy: Starting download of 0 data blocks...
I20260812 17:43:16.839645 29416 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87: tablet copy: Starting download of 1 WAL segments...
I20260812 17:43:16.841591 29416 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 17:43:16.843802 28507 tablet_copy_service.cc:342] P 39d0a9a08559400f89e482c682e73ada: Request end of tablet copy session 5c516b82a7a54204b11fbd229b8ede87-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.17.255.60@KRBTEST.COM'} at 127.0.0.1:43814
I20260812 17:43:16.843919 28507 tablet_copy_service.cc:433] P 39d0a9a08559400f89e482c682e73ada: ending tablet copy session 5c516b82a7a54204b11fbd229b8ede87-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 5c516b82a7a54204b11fbd229b8ede87
I20260812 17:43:16.852092 29416 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:16.854110 29715 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:16.855919 29717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:16.856037 29719 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:16.858598 29416 server_base.cc:1034] running on GCE node
I20260812 17:43:16.858816 29416 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:16.859184 29416 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:16.860339 29416 hybrid_clock.cc:648] HybridClock initialized: now 1786556596860315 us; error 45 us; skew 500 ppm
Aug 12 17:43:16 dist-test-slave-tk9z krb5kdc[28400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556596, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.255.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:16.862097 29416 init.cc:377] Logged in from keytab as oryx/127.17.255.60@KRBTEST.COM (short username oryx)
I20260812 17:43:16.862653 29416 webserver.cc:460] Webserver started at http://127.17.255.60:40429/ using document root <none> and password file <none>
I20260812 17:43:16.862856 29416 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:16.862910 29416 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:16.864475 29416 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 17:43:16.865630 29739 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:16.865998 29416 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 17:43:16.866091 29416 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-2/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-2/wal
uuid: "5c516b82a7a54204b11fbd229b8ede87"
format_stamp: "Formatted at 2026-08-12 17:43:16 on dist-test-slave-tk9z"
server_key: "e8582a72269008a74950d52c56eaef43"
server_key_iv: "878ed6c080d86f933af75a8d9eaa055f"
server_key_version: "encryptionkey@0"
I20260812 17:43:16.866187 29416 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:16.878715 29416 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:16.881206 29416 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:16.886683 29416 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.60:39043
I20260812 17:43:16.886835 29833 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.60:39043 every 8 connection(s)
I20260812 17:43:16.887367 29416 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/master-2/data/info.pb
I20260812 17:43:16.889292 29834 sys_catalog.cc:263] Verifying existing consensus state
I20260812 17:43:16.890496 29834 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87: Bootstrap starting.
I20260812 17:43:16.904320 29834 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 17:43:16.904719 29834 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87: Bootstrap complete.
I20260812 17:43:16.905364 29834 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: false } } peers { permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87" member_type: NON_VOTER last_known_addr { host: "127.17.255.60" port: 39043 } attrs { promote: true } }
I20260812 17:43:16.905534 29834 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5c516b82a7a54204b11fbd229b8ede87, State: Initialized, Role: LEARNER
I20260812 17:43:16.905660 29834 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: false } } peers { permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87" member_type: NON_VOTER last_known_addr { host: "127.17.255.60" port: 39043 } attrs { promote: true } }
I20260812 17:43:16.906060 29837 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: false } } peers { permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87" member_type: NON_VOTER last_known_addr { host: "127.17.255.60" port: 39043 } attrs { promote: true } } }
I20260812 17:43:16.906195 29834 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:43:16.906275 29837 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [sys.catalog]: This master's current role is: LEARNER
I20260812 17:43:16.909552 29858 catalog_manager.cc:1259] Loaded cluster ID: 71dfef96b05640598e35d14e2687f57d
I20260812 17:43:16.909612 29858 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87: loading cluster ID for follower catalog manager: success
I20260812 17:43:16.911897 29858 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87: acquiring CA information for follower catalog manager: success
I20260812 17:43:16.913426 29858 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260812 17:43:16.940040 29694 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:16.940579 29694 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:16.940719 29694 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:16.945182 29694 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:16.945290 29694 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:16.945389 29694 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.1
I20260812 17:43:16.951284 29694 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:42861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.1.keytab
--principal=oryx/127.17.255.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.1:43215
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.255.1
--webserver_port=35041
--tserver_master_addrs=127.17.255.62:40187,127.17.255.61:42601,127.17.255.60:39043
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29694
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.1
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:16.952629 29694 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:16.954105 29694 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:16.965952 29867 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:16.966028 29864 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:16.965996 29878 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:16.966430 29694 server_base.cc:1034] running on GCE node
I20260812 17:43:16.967002 29694 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:16.967805 29694 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:16.969038 29694 hybrid_clock.cc:648] HybridClock initialized: now 1786556596969004 us; error 49 us; skew 500 ppm
Aug 12 17:43:16 dist-test-slave-tk9z krb5kdc[28400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556596, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.255.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:16.972882 29694 init.cc:377] Logged in from keytab as oryx/127.17.255.1@KRBTEST.COM (short username oryx)
I20260812 17:43:16.974054 29694 webserver.cc:460] Webserver started at http://127.17.255.1:35041/ using document root <none> and password file <none>
I20260812 17:43:16.974771 29694 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:16.974890 29694 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:16.980087 29694 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.002s
I20260812 17:43:16.983067 29893 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:16.984740 29694 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:43:16.984890 29694 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-0/wal
uuid: "6be4cec5a2dd4f8797098bbff7094259"
format_stamp: "Formatted at 2026-08-12 17:43:15 on dist-test-slave-tk9z"
server_key: "54aa3c80f4f6365b1bcc6578ab32dffc"
server_key_iv: "afb4735e798d387f15fa9d7fb8101a96"
server_key_version: "encryptionkey@0"
I20260812 17:43:16.985646 29694 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:17.000065 29694 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:17.003875 29694 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:17.004097 29694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:17.004845 29694 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:43:17.005921 29694 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:43:17.005983 29694 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:17.006052 29694 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:43:17.006081 29694 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:17.021422 29694 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.1:43215
I20260812 17:43:17.021585 30084 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.1:43215 every 8 connection(s)
I20260812 17:43:17.022671 29694 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
I20260812 17:43:17.025022 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 29694
I20260812 17:43:17.025280 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 28794
Aug 12 17:43:17 dist-test-slave-tk9z krb5kdc[28400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556596, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.255.1@KRBTEST.COM for oryx/127.17.255.60@KRBTEST.COM
Aug 12 17:43:17 dist-test-slave-tk9z krb5kdc[28400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556596, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.255.1@KRBTEST.COM for oryx/127.17.255.61@KRBTEST.COM
I20260812 17:43:17.048715 30093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:17.025086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:33761 (local address 127.17.255.60:39043)
0812 17:43:17.025345 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:17.025348 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:17.030465 (+ 5117us) server_negotiation.cc:407] Connection header received
0812 17:43:17.030560 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:17.030564 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:17.030649 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:17.030743 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:17.033186 (+ 2443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.033984 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.036702 (+ 2718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.037079 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.037163 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:17.042131 (+ 4968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:17.042138 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:17.042143 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:17.042181 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:17.044468 (+ 2287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:17.046804 (+ 2336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:17.046810 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:17.046814 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:17.046904 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:17.047200 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:17.047205 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:17.047209 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:17.047431 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:17.047512 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:17.048296 (+ 784us) server_negotiation.cc:299] Negotiation successful
0812 17:43:17.048457 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":101,"threads_started":1}
I20260812 17:43:17.048868 29657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:17.029378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:43559 (local address 127.17.255.61:42601)
0812 17:43:17.029581 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:17.029586 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:17.030871 (+ 1285us) server_negotiation.cc:407] Connection header received
0812 17:43:17.031022 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:17.031025 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:17.031108 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:17.031231 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:17.033171 (+ 1940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.034341 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.036233 (+ 1892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.036613 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.036726 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:17.042155 (+ 5429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:17.042164 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:17.042172 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:17.042222 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:17.045023 (+ 2801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:17.046068 (+ 1045us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:17.046076 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:17.046081 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:17.046219 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:17.046954 (+ 735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:17.046962 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:17.046967 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:17.047336 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:17.047442 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:17.048366 (+ 924us) server_negotiation.cc:299] Negotiation successful
0812 17:43:17.048566 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127}
I20260812 17:43:17.050594 30102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:17.026347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:39043 (local address 127.17.255.1:33761)
0812 17:43:17.028601 (+ 2254us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:17.028659 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:17.029842 (+ 1183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:17.031094 (+ 1252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:17.031101 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:17.031887 (+ 786us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:17.032979 (+ 1092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:17.033001 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.034225 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.034228 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:17.036504 (+ 2276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:17.036521 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.037330 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.037336 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:17.037573 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:17.038666 (+ 1093us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:17.038684 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:17.041486 (+ 2802us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:17.046411 (+ 4925us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:17.046417 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:17.046421 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:17.046685 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:17.047026 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:17.047031 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:17.047035 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:17.047114 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:17.047564 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:17.047574 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:17.048012 (+ 438us) client_negotiation.cc:769] Sending connection context
0812 17:43:17.048973 (+ 961us) client_negotiation.cc:240] Negotiation successful
0812 17:43:17.049390 (+ 417us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1981,"mutex_wait_us":270,"spinlock_wait_cycles":3840,"thread_start_us":1804,"threads_started":1}
I20260812 17:43:17.051067 30108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:17.029379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.61:42601 (local address 127.17.255.1:43559)
0812 17:43:17.030760 (+ 1381us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:17.030773 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:17.030920 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:17.031248 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:17.031251 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:17.031887 (+ 636us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:17.032979 (+ 1092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:17.033001 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.034559 (+ 1558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.034567 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:17.036067 (+ 1500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:17.036084 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.037068 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.037079 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:17.037572 (+ 493us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:17.038406 (+ 834us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:17.038444 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:17.041938 (+ 3494us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:17.045222 (+ 3284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:17.045235 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:17.045266 (+ 31us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:17.045884 (+ 618us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:17.046414 (+ 530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:17.046421 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:17.046426 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:17.046769 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:17.047567 (+ 798us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:17.047579 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:17.048030 (+ 451us) client_negotiation.cc:769] Sending connection context
0812 17:43:17.049592 (+ 1562us) client_negotiation.cc:240] Negotiation successful
0812 17:43:17.049876 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1271,"mutex_wait_us":168,"spinlock_wait_cycles":16512,"thread_start_us":1080,"threads_started":1}
I20260812 17:43:17.052104 30090 heartbeater.cc:347] Connected to a master server at 127.17.255.60:39043
I20260812 17:43:17.052501 30090 heartbeater.cc:464] Registering TS with master...
I20260812 17:43:17.053493 30090 heartbeater.cc:511] Master 127.17.255.60:39043 requested a full tablet report, sending...
I20260812 17:43:17.055768 29757 ts_manager.cc:194] Registered new tserver with Master: 6be4cec5a2dd4f8797098bbff7094259 (127.17.255.1:43215)
I20260812 17:43:17.056327 30091 heartbeater.cc:347] Connected to a master server at 127.17.255.61:42601
I20260812 17:43:17.056424 30091 heartbeater.cc:464] Registering TS with master...
I20260812 17:43:17.056648 30091 heartbeater.cc:511] Master 127.17.255.61:42601 requested a full tablet report, sending...
I20260812 17:43:17.057914 29469 ts_manager.cc:194] Registered new tserver with Master: 6be4cec5a2dd4f8797098bbff7094259 (127.17.255.1:43215)
Aug 12 17:43:17 dist-test-slave-tk9z krb5kdc[28400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556596, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.255.1@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM
I20260812 17:43:17.064966 29235 heartbeater.cc:503] Master 127.17.255.62:40187 was elected leader, sending a full tablet report...
I20260812 17:43:17.065099 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.2:35191
--local_ip_for_outbound_sockets=127.17.255.2
--tserver_master_addrs=127.17.255.62:40187
--webserver_port=44873
--webserver_interface=127.17.255.2
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.2.keytab
--principal=oryx/127.17.255.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:42861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.17.255.62:40187,127.17.255.61:42601
--tserver_master_addrs=127.17.255.62:40187,127.17.255.61:42601,127.17.255.60:39043 with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 17:43:17.068625 30107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:17.026750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.17.255.1:45409)
0812 17:43:17.030216 (+ 3466us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:17.030228 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:17.030345 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:17.058951 (+ 28606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:17.058955 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:17.059170 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:17.059392 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:17.059399 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.060248 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.060253 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:17.060915 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:17.060925 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.061502 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.061507 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:17.061617 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:17.062208 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:17.062221 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:17.064277 (+ 2056us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:17.066817 (+ 2540us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:17.066827 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:17.066829 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:17.067061 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:17.067438 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:17.067442 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:17.067444 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:17.067557 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:17.068084 (+ 527us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:17.068086 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:17.068189 (+ 103us) client_negotiation.cc:769] Sending connection context
0812 17:43:17.068286 (+ 97us) client_negotiation.cc:240] Negotiation successful
0812 17:43:17.068468 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3396,"thread_start_us":1556,"threads_started":1}
I20260812 17:43:17.068638 28545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:17.055431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:45409 (local address 127.17.255.62:40187)
0812 17:43:17.058605 (+ 3174us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:17.058613 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:17.058638 (+ 25us) server_negotiation.cc:407] Connection header received
0812 17:43:17.058698 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:17.058704 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:17.058772 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:17.058893 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:17.059569 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.060121 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.061061 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.061287 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.061403 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:17.064458 (+ 3055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:17.064462 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:17.064464 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:17.064516 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:17.066641 (+ 2125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:17.067227 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:17.067230 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:17.067232 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:17.067318 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:17.067670 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:17.067676 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:17.067678 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:17.067962 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:17.068086 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:17.068388 (+ 302us) server_negotiation.cc:299] Negotiation successful
0812 17:43:17.068516 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3019}
I20260812 17:43:17.069458 30089 heartbeater.cc:347] Connected to a master server at 127.17.255.62:40187
I20260812 17:43:17.069593 30089 heartbeater.cc:464] Registering TS with master...
I20260812 17:43:17.069806 30089 heartbeater.cc:511] Master 127.17.255.62:40187 requested a full tablet report, sending...
I20260812 17:43:17.070802 28476 ts_manager.cc:194] Re-registered known tserver with Master: 6be4cec5a2dd4f8797098bbff7094259 (127.17.255.1:43215)
I20260812 17:43:17.071394 28476 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.255.1@KRBTEST.COM'} at 127.17.255.1:45409
W20260812 17:43:17.195019 30111 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:17.195333 30111 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:17.195418 30111 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:17.199544 30111 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:17.199607 30111 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:17.199707 30111 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.2
I20260812 17:43:17.205598 30111 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:42861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.2.keytab
--principal=oryx/127.17.255.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.2:35191
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.255.2
--webserver_port=44873
--tserver_master_addrs=127.17.255.62:40187,127.17.255.61:42601,127.17.255.60:39043
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30111
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.2
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:17.206861 30111 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:17.208107 30111 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:17.218758 30123 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:17.218783 30120 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:17.218936 30111 server_base.cc:1034] running on GCE node
W20260812 17:43:17.219131 30121 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:17.219568 30111 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:17.220268 30111 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:17.221472 30111 hybrid_clock.cc:648] HybridClock initialized: now 1786556597221457 us; error 35 us; skew 500 ppm
Aug 12 17:43:17 dist-test-slave-tk9z krb5kdc[28400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556597, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.255.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:17.224510 30111 init.cc:377] Logged in from keytab as oryx/127.17.255.2@KRBTEST.COM (short username oryx)
I20260812 17:43:17.225459 30111 webserver.cc:460] Webserver started at http://127.17.255.2:44873/ using document root <none> and password file <none>
I20260812 17:43:17.226073 30111 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:17.226189 30111 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:17.230513 30111 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 17:43:17.233072 30135 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:17.234766 30111 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:43:17.234906 30111 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-1/wal
uuid: "4e163f02b82c44979f1dd43899bcdc4f"
format_stamp: "Formatted at 2026-08-12 17:43:15 on dist-test-slave-tk9z"
server_key: "b7e22dba51f9217c8e694712f4c37d72"
server_key_iv: "01f036bcaea38f0f5b9c940712230e78"
server_key_version: "encryptionkey@0"
I20260812 17:43:17.235574 30111 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:17.241154 30093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:17.237371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33170 (local address 127.17.255.60:39043)
0812 17:43:17.237534 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:17.237537 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:17.237555 (+ 18us) server_negotiation.cc:407] Connection header received
0812 17:43:17.237612 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:17.237614 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:17.237669 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:17.237754 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:43:17.238058 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.238663 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.240154 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.240613 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.240701 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:17.240821 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:17.240983 (+ 162us) server_negotiation.cc:299] Negotiation successful
0812 17:43:17.241050 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 17:43:17.241197 29397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:17.237219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:39043 (local address 127.0.0.1:33170)
0812 17:43:17.237393 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:17.237411 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:17.237527 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:17.237796 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:17.237799 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:17.237818 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:43:17.237937 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:17.237943 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.238787 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.238791 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:17.240011 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:17.240024 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.240750 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.240754 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:17.240845 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:17.240873 (+ 28us) client_negotiation.cc:769] Sending connection context
0812 17:43:17.240970 (+ 97us) client_negotiation.cc:240] Negotiation successful
0812 17:43:17.241051 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":75}
I20260812 17:43:17.241966 29795 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260812 17:43:17.242359 29837 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 39d0a9a08559400f89e482c682e73ada. Latest consensus state: current_term: 1 leader_uuid: "39d0a9a08559400f89e482c682e73ada" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: false } } peers { permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87" member_type: NON_VOTER last_known_addr { host: "127.17.255.60" port: 39043 } attrs { promote: true } } }
I20260812 17:43:17.242614 29837 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [sys.catalog]: This master's current role is: LEARNER
I20260812 17:43:17.256276 30111 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:17.260088 30111 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:17.260325 30111 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:17.261070 30111 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:43:17.262036 30111 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:43:17.262112 30111 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:17.262194 30111 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:43:17.262238 30111 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:17.271898 30111 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.2:35191
I20260812 17:43:17.271924 30339 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.2:35191 every 8 connection(s)
I20260812 17:43:17.273241 30111 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
I20260812 17:43:17.274808 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 30111
I20260812 17:43:17.274999 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 29011
Aug 12 17:43:17 dist-test-slave-tk9z krb5kdc[28400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556597, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.255.2@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM
I20260812 17:43:17.294849 28545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:17.280231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:37221 (local address 127.17.255.62:40187)
0812 17:43:17.280408 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:17.280415 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:17.280497 (+ 82us) server_negotiation.cc:407] Connection header received
0812 17:43:17.280564 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:17.280570 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:17.280636 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:17.280771 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:17.282175 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.283311 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.285558 (+ 2247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.286051 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.286206 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:17.290437 (+ 4231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:17.290443 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:17.290449 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:17.290485 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:17.292248 (+ 1763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:17.292939 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:17.292944 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:17.292948 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:17.293047 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:17.293432 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:17.293438 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:17.293442 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:17.293686 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:17.293753 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:17.294494 (+ 741us) server_negotiation.cc:299] Negotiation successful
0812 17:43:17.294670 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 17:43:17.297041 30345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:17.278766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.17.255.2:37221)
0812 17:43:17.280311 (+ 1545us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:17.280325 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:17.280415 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:17.280922 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:17.280929 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:17.281397 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:17.282017 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:17.282032 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.283455 (+ 1423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.283462 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:17.285401 (+ 1939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:17.285417 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.286226 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.286231 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:17.286464 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:17.287998 (+ 1534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:17.288024 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:17.290178 (+ 2154us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:17.292410 (+ 2232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:17.292419 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:17.292441 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:17.292824 (+ 383us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:17.293149 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:17.293154 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:17.293159 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:17.293337 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:17.293831 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:17.293840 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:17.294185 (+ 345us) client_negotiation.cc:769] Sending connection context
0812 17:43:17.295377 (+ 1192us) client_negotiation.cc:240] Negotiation successful
0812 17:43:17.295792 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1468,"thread_start_us":1153,"threads_started":1}
I20260812 17:43:17.298698 30340 heartbeater.cc:347] Connected to a master server at 127.17.255.62:40187
I20260812 17:43:17.298959 30340 heartbeater.cc:464] Registering TS with master...
I20260812 17:43:17.300179 30340 heartbeater.cc:511] Master 127.17.255.62:40187 requested a full tablet report, sending...
Aug 12 17:43:17 dist-test-slave-tk9z krb5kdc[28400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556597, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.255.2@KRBTEST.COM for oryx/127.17.255.60@KRBTEST.COM
I20260812 17:43:17.301667 28476 ts_manager.cc:194] Re-registered known tserver with Master: 4e163f02b82c44979f1dd43899bcdc4f (127.17.255.2:35191)
I20260812 17:43:17.303043 28476 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.255.2@KRBTEST.COM'} at 127.17.255.2:37221
I20260812 17:43:17.305961 30093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:17.294842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:51483 (local address 127.17.255.60:39043)
0812 17:43:17.295001 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:17.295006 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:17.295738 (+ 732us) server_negotiation.cc:407] Connection header received
0812 17:43:17.295924 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:17.295927 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:17.295980 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:17.296031 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:17.296649 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.297418 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.298605 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.298921 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.299013 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:17.302091 (+ 3078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:17.302095 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:17.302098 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:17.302130 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:17.304099 (+ 1969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:17.304597 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:17.304601 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:17.304603 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:17.304692 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:17.305010 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:17.305013 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:17.305015 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:17.305225 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:17.305295 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:17.305650 (+ 355us) server_negotiation.cc:299] Negotiation successful
0812 17:43:17.305807 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 17:43:17.306715 30348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:17.295103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:39043 (local address 127.17.255.2:51483)
0812 17:43:17.295644 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:17.295658 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:17.295816 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:17.296177 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:17.296180 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:17.296385 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:17.296505 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:17.296512 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.297602 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.297605 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:17.298460 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:17.298479 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.299184 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.299187 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:17.299342 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:17.300033 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:17.300049 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:17.301855 (+ 1806us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:17.304220 (+ 2365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:17.304222 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:17.304224 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:17.304476 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:17.304807 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:17.304810 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:17.304812 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:17.304900 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:17.305367 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:17.305370 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:17.305445 (+ 75us) client_negotiation.cc:769] Sending connection context
0812 17:43:17.306181 (+ 736us) client_negotiation.cc:240] Negotiation successful
0812 17:43:17.306350 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":220,"threads_started":1}
I20260812 17:43:17.307453 30341 heartbeater.cc:347] Connected to a master server at 127.17.255.60:39043
I20260812 17:43:17.307559 30341 heartbeater.cc:464] Registering TS with master...
I20260812 17:43:17.307869 30341 heartbeater.cc:511] Master 127.17.255.60:39043 requested a full tablet report, sending...
I20260812 17:43:17.308856 29757 ts_manager.cc:194] Registered new tserver with Master: 4e163f02b82c44979f1dd43899bcdc4f (127.17.255.2:35191)
Aug 12 17:43:17 dist-test-slave-tk9z krb5kdc[28400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556597, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.255.2@KRBTEST.COM for oryx/127.17.255.61@KRBTEST.COM
I20260812 17:43:17.314800 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.3:35507
--local_ip_for_outbound_sockets=127.17.255.3
--tserver_master_addrs=127.17.255.62:40187
--webserver_port=33109
--webserver_interface=127.17.255.3
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.3.keytab
--principal=oryx/127.17.255.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:42861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.17.255.62:40187,127.17.255.61:42601
--tserver_master_addrs=127.17.255.62:40187,127.17.255.61:42601,127.17.255.60:39043 with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 17:43:17.316952 29657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:17.306670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:52375 (local address 127.17.255.61:42601)
0812 17:43:17.306887 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:17.306895 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:17.306917 (+ 22us) server_negotiation.cc:407] Connection header received
0812 17:43:17.306973 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:17.306979 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:17.307045 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:17.307167 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:17.307953 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.308799 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.310162 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.310539 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.310636 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:17.313304 (+ 2668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:17.313308 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:17.313310 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:17.313339 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:17.315092 (+ 1753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:17.315563 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:17.315567 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:17.315569 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:17.315664 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:17.315987 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:17.315993 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:17.315995 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:17.316211 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:17.316333 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:17.316660 (+ 327us) server_negotiation.cc:299] Negotiation successful
0812 17:43:17.316788 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 17:43:17.316972 30344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:17.275828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.61:42601 (local address 127.17.255.2:52375)
0812 17:43:17.278153 (+ 2325us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:17.278199 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:17.279629 (+ 1430us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:17.307412 (+ 27783us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:17.307419 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:17.307665 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:17.307807 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:17.307819 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.308944 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.308951 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:17.310023 (+ 1072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:17.310038 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.310689 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.310696 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:17.310825 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:17.311499 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:17.311518 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:17.313127 (+ 1609us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:17.315214 (+ 2087us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:17.315219 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:17.315221 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:17.315448 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:17.315785 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:17.315788 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:17.315790 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:17.315884 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:17.316334 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:17.316339 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:17.316447 (+ 108us) client_negotiation.cc:769] Sending connection context
0812 17:43:17.316570 (+ 123us) client_negotiation.cc:240] Negotiation successful
0812 17:43:17.316746 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2113,"thread_start_us":1872,"threads_started":1}
I20260812 17:43:17.317729 30342 heartbeater.cc:347] Connected to a master server at 127.17.255.61:42601
I20260812 17:43:17.317859 30342 heartbeater.cc:464] Registering TS with master...
I20260812 17:43:17.318053 30342 heartbeater.cc:511] Master 127.17.255.61:42601 requested a full tablet report, sending...
I20260812 17:43:17.319115 29469 ts_manager.cc:194] Registered new tserver with Master: 4e163f02b82c44979f1dd43899bcdc4f (127.17.255.2:35191)
W20260812 17:43:17.440416 30350 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:17.440712 30350 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:17.440757 30350 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:17.445036 30350 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:17.445103 30350 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:17.445165 30350 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.3
I20260812 17:43:17.450639 30350 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:42861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.3.keytab
--principal=oryx/127.17.255.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.3:35507
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.255.3
--webserver_port=33109
--tserver_master_addrs=127.17.255.62:40187,127.17.255.61:42601,127.17.255.60:39043
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30350
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.3
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:17.451761 30350 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:17.452914 30350 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:17.463236 30363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:17.463284 30361 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:17.463239 30368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:17.463729 30350 server_base.cc:1034] running on GCE node
I20260812 17:43:17.464195 30350 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:17.464901 30350 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:17.466114 30350 hybrid_clock.cc:648] HybridClock initialized: now 1786556597466076 us; error 48 us; skew 500 ppm
Aug 12 17:43:17 dist-test-slave-tk9z krb5kdc[28400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556597, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.255.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:17.469344 30350 init.cc:377] Logged in from keytab as oryx/127.17.255.3@KRBTEST.COM (short username oryx)
I20260812 17:43:17.470311 30350 webserver.cc:460] Webserver started at http://127.17.255.3:33109/ using document root <none> and password file <none>
I20260812 17:43:17.470984 30350 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:17.471107 30350 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:17.475777 30350 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 17:43:17.478108 30378 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:17.479511 30350 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:43:17.479666 30350 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-2/wal
uuid: "3e5f6e4a466340ba89376d1ad9bfe4a6"
format_stamp: "Formatted at 2026-08-12 17:43:15 on dist-test-slave-tk9z"
server_key: "18834fa406fd2735af3d7c4b16e8d231"
server_key_iv: "9cbe923442b0ef25888dd62bad5d51cf"
server_key_version: "encryptionkey@0"
I20260812 17:43:17.480352 30350 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:17.498448 30350 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:17.502431 30350 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:17.502635 30350 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:17.503358 30350 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:43:17.504469 30350 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:43:17.504534 30350 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:17.504593 30350 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:43:17.504632 30350 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:17.515398 30350 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.3:35507
I20260812 17:43:17.515501 30584 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.3:35507 every 8 connection(s)
I20260812 17:43:17.516513 30350 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
I20260812 17:43:17.523828 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 30350
Aug 12 17:43:17 dist-test-slave-tk9z krb5kdc[28400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556597, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.255.3@KRBTEST.COM for oryx/127.17.255.60@KRBTEST.COM
Aug 12 17:43:17 dist-test-slave-tk9z krb5kdc[28400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556597, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.255.3@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM
Aug 12 17:43:17 dist-test-slave-tk9z krb5kdc[28400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556597, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.255.3@KRBTEST.COM for oryx/127.17.255.61@KRBTEST.COM
I20260812 17:43:17.535215 30093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:17.520664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:45539 (local address 127.17.255.60:39043)
0812 17:43:17.520791 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:17.520795 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:17.521525 (+ 730us) server_negotiation.cc:407] Connection header received
0812 17:43:17.521701 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:17.521704 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:17.521762 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:17.521892 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:17.523106 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.523922 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.525813 (+ 1891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.526062 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.526191 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:17.530000 (+ 3809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:17.530006 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:17.530012 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:17.530050 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:17.531957 (+ 1907us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:17.532676 (+ 719us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:17.532682 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:17.532685 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:17.532784 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:17.533295 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:17.533300 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:17.533317 (+ 17us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:17.533548 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:17.533629 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:17.534895 (+ 1266us) server_negotiation.cc:299] Negotiation successful
0812 17:43:17.535033 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 17:43:17.536218 29657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:17.518770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:42441 (local address 127.17.255.61:42601)
0812 17:43:17.518907 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:17.518918 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:17.520027 (+ 1109us) server_negotiation.cc:407] Connection header received
0812 17:43:17.521247 (+ 1220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:17.521250 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:17.521355 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:17.521437 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:17.523080 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.523730 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.527537 (+ 3807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.527897 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.527971 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:17.531563 (+ 3592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:17.531567 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:17.531570 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:17.531600 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:17.533696 (+ 2096us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:17.534236 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:17.534240 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:17.534242 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:17.534344 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:17.534729 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:17.534732 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:17.534734 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:17.535006 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:17.535109 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:17.535924 (+ 815us) server_negotiation.cc:299] Negotiation successful
0812 17:43:17.536051 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 17:43:17.537539 30595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:17.519199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.61:42601 (local address 127.17.255.3:42441)
0812 17:43:17.519866 (+ 667us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:17.519912 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:17.521017 (+ 1105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:17.521593 (+ 576us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:17.521600 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:17.522252 (+ 652us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:17.522928 (+ 676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:17.522943 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.524015 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.524019 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:17.526737 (+ 2718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:17.526749 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.528198 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.528202 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:17.528317 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:17.529294 (+ 977us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:17.529309 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:17.531396 (+ 2087us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:17.533827 (+ 2431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:17.533832 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:17.533834 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:17.534102 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:17.534494 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:17.534497 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:17.534499 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:17.534603 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:17.535165 (+ 562us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:17.535168 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:17.535284 (+ 116us) client_negotiation.cc:769] Sending connection context
0812 17:43:17.535391 (+ 107us) client_negotiation.cc:240] Negotiation successful
0812 17:43:17.535790 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":461,"mutex_wait_us":1440,"spinlock_wait_cycles":11136,"thread_start_us":243,"threads_started":1}
I20260812 17:43:17.539167 30588 heartbeater.cc:347] Connected to a master server at 127.17.255.61:42601
I20260812 17:43:17.539448 30588 heartbeater.cc:464] Registering TS with master...
I20260812 17:43:17.539746 30594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:17.520480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:39043 (local address 127.17.255.3:45539)
0812 17:43:17.521441 (+ 961us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:17.521454 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:17.521587 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:17.521944 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:17.521948 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:17.522255 (+ 307us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:17.522930 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:17.522948 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.524079 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.524082 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:17.525635 (+ 1553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:17.525646 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.526234 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.526239 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:17.526501 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:17.527195 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:17.527218 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:17.529773 (+ 2555us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:17.532118 (+ 2345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:17.532125 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:17.532144 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:17.532557 (+ 413us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:17.532914 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:17.532920 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:17.532923 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:17.533155 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:17.533720 (+ 565us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:17.533727 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:17.534066 (+ 339us) client_negotiation.cc:769] Sending connection context
0812 17:43:17.535381 (+ 1315us) client_negotiation.cc:240] Negotiation successful
0812 17:43:17.539420 (+ 4039us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":889,"mutex_wait_us":198,"spinlock_wait_cycles":10112,"thread_start_us":112,"threads_started":1}
I20260812 17:43:17.540356 30587 heartbeater.cc:347] Connected to a master server at 127.17.255.60:39043
I20260812 17:43:17.540463 30587 heartbeater.cc:464] Registering TS with master...
I20260812 17:43:17.540587 30588 heartbeater.cc:511] Master 127.17.255.61:42601 requested a full tablet report, sending...
I20260812 17:43:17.540704 30587 heartbeater.cc:511] Master 127.17.255.60:39043 requested a full tablet report, sending...
I20260812 17:43:17.541930 29469 ts_manager.cc:194] Registered new tserver with Master: 3e5f6e4a466340ba89376d1ad9bfe4a6 (127.17.255.3:35507)
I20260812 17:43:17.541931 29757 ts_manager.cc:194] Registered new tserver with Master: 3e5f6e4a466340ba89376d1ad9bfe4a6 (127.17.255.3:35507)
I20260812 17:43:17.542884 30606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:17.525983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43816 (local address 127.17.255.62:40187)
0812 17:43:17.526352 (+ 369us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:17.526387 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:17.526646 (+ 259us) server_negotiation.cc:407] Connection header received
0812 17:43:17.526757 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:17.526763 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:17.526836 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:17.526943 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:17.528266 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.529128 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.531283 (+ 2155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.531595 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.531694 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:17.533876 (+ 2182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:17.533883 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:17.533887 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:17.533921 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:17.537974 (+ 4053us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:17.538551 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:17.538558 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:17.538561 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:17.538656 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:17.541702 (+ 3046us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:17.541706 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:17.541708 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:17.541951 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:17.542086 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:17.542588 (+ 502us) server_negotiation.cc:299] Negotiation successful
0812 17:43:17.542718 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":96,"threads_started":1}
I20260812 17:43:17.542884 30607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:17.528861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52180 (local address 127.17.255.61:42601)
0812 17:43:17.529800 (+ 939us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:17.529805 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:17.532521 (+ 2716us) server_negotiation.cc:407] Connection header received
0812 17:43:17.532565 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:17.532568 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:17.532628 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:17.532708 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:17.533661 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.534439 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.535559 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.535887 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.535983 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:17.538059 (+ 2076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:17.538066 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:17.538069 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:17.538100 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:17.539929 (+ 1829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:17.540477 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:17.540481 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:17.540483 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:17.540636 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:17.540980 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:17.540984 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:17.540985 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:17.541262 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:17.541401 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:17.541964 (+ 563us) server_negotiation.cc:299] Negotiation successful
0812 17:43:17.542714 (+ 750us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":785,"thread_start_us":171,"threads_started":1}
I20260812 17:43:17.543720 28545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:17.518542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:57675 (local address 127.17.255.62:40187)
0812 17:43:17.518686 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:17.518693 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:17.521029 (+ 2336us) server_negotiation.cc:407] Connection header received
0812 17:43:17.521243 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:17.521246 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:17.521304 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:17.521402 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:17.523107 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.523928 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.527485 (+ 3557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.527828 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.527941 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:17.534614 (+ 6673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:17.534618 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:17.534620 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:17.534650 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:17.536745 (+ 2095us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:17.538779 (+ 2034us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:17.538782 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:17.538784 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:17.538863 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:17.542159 (+ 3296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:17.542163 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:17.542165 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:17.542405 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:17.542494 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:17.543428 (+ 934us) server_negotiation.cc:299] Negotiation successful
0812 17:43:17.543577 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 17:43:17.544257 30596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:17.519199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.17.255.3:57675)
0812 17:43:17.520911 (+ 1712us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:17.520926 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:17.521042 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:17.521591 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:17.521600 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:17.522259 (+ 659us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:17.522930 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:17.522948 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.524079 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.524082 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:17.527352 (+ 3270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:17.527363 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.528075 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.528079 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:17.528197 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:17.528922 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:17.528939 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:17.534461 (+ 5522us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:17.538109 (+ 3648us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:17.538115 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:17.538120 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:17.538446 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:17.538976 (+ 530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:17.538979 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:17.538981 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:17.539071 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:17.543101 (+ 4030us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:17.543107 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:17.543205 (+ 98us) client_negotiation.cc:769] Sending connection context
0812 17:43:17.543898 (+ 693us) client_negotiation.cc:240] Negotiation successful
0812 17:43:17.544077 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1620,"mutex_wait_us":291,"spinlock_wait_cycles":82048,"thread_start_us":216,"threads_started":1}
I20260812 17:43:17.545058 30585 heartbeater.cc:347] Connected to a master server at 127.17.255.62:40187
I20260812 17:43:17.545171 30585 heartbeater.cc:464] Registering TS with master...
I20260812 17:43:17.545364 30585 heartbeater.cc:511] Master 127.17.255.62:40187 requested a full tablet report, sending...
I20260812 17:43:17.546090 28476 ts_manager.cc:194] Re-registered known tserver with Master: 3e5f6e4a466340ba89376d1ad9bfe4a6 (127.17.255.3:35507)
I20260812 17:43:17.547005 28476 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.255.3@KRBTEST.COM'} at 127.17.255.3:57675
I20260812 17:43:17.546691 28474 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43816:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 17:43:17.550208 28474 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 17:43:17.550724 30614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:17.530872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33176 (local address 127.17.255.60:39043)
0812 17:43:17.532000 (+ 1128us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:17.532007 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:17.536708 (+ 4701us) server_negotiation.cc:407] Connection header received
0812 17:43:17.536810 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:17.536816 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:17.536876 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:17.536972 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:17.538582 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.539461 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.541308 (+ 1847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.542490 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.542590 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:17.545567 (+ 2977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:17.545571 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:17.545573 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:17.545602 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:17.547594 (+ 1992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:17.549385 (+ 1791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:17.549391 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:17.549392 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:17.549488 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:17.549768 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:17.549771 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:17.549773 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:17.549971 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:17.550121 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:17.550405 (+ 284us) server_negotiation.cc:299] Negotiation successful
0812 17:43:17.550545 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1053,"thread_start_us":131,"threads_started":1}
I20260812 17:43:17.553463 29406 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "39d0a9a08559400f89e482c682e73ada" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: false } } peers { permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87" member_type: NON_VOTER last_known_addr { host: "127.17.255.60" port: 39043 } attrs { promote: true } } }
I20260812 17:43:17.553650 29406 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [sys.catalog]: This master's current role is: LEADER
I20260812 17:43:17.558019 30626 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada: attempting to promote NON_VOTER 5c516b82a7a54204b11fbd229b8ede87 to VOTER
I20260812 17:43:17.558354 30626 consensus_queue.cc:237] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: false } } peers { permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 39043 } attrs { promote: false } }
I20260812 17:43:17.559806 29481 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [term 1 FOLLOWER]: Refusing update from remote peer 39d0a9a08559400f89e482c682e73ada: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260812 17:43:17.559854 29795 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [term 1 LEARNER]: Refusing update from remote peer 39d0a9a08559400f89e482c682e73ada: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260812 17:43:17.560377 30627 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 39043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 17:43:17.560739 30627 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [LEADER]: Connected to new peer: Peer: permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 17:43:17.562562 30627 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 5c516b82a7a54204b11fbd229b8ede87 (127.17.255.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: false } } peers { permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 39043 } attrs { promote: false } } }
I20260812 17:43:17.563006 29481 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 5c516b82a7a54204b11fbd229b8ede87 (127.17.255.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: false } } peers { permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 39043 } attrs { promote: false } } }
I20260812 17:43:17.564236 30627 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "39d0a9a08559400f89e482c682e73ada" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: false } } peers { permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 39043 } attrs { promote: false } } }
I20260812 17:43:17.564357 30627 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [sys.catalog]: This master's current role is: LEADER
I20260812 17:43:17.564504 30627 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "39d0a9a08559400f89e482c682e73ada" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: false } } peers { permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 39043 } attrs { promote: false } } }
I20260812 17:43:17.564597 30627 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [sys.catalog]: This master's current role is: LEADER
I20260812 17:43:17.565570 30626 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "39d0a9a08559400f89e482c682e73ada" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: false } } peers { permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 39043 } attrs { promote: false } } }
I20260812 17:43:17.565689 30626 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada [sys.catalog]: This master's current role is: LEADER
I20260812 17:43:17.566305 29795 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 5c516b82a7a54204b11fbd229b8ede87 (127.17.255.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: false } } peers { permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 39043 } attrs { promote: false } } }
I20260812 17:43:17.567006 30639 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "39d0a9a08559400f89e482c682e73ada" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: false } } peers { permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 39043 } attrs { promote: false } } }
I20260812 17:43:17.567593 30639 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 17:43:17.569314 29837 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "39d0a9a08559400f89e482c682e73ada" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: false } } peers { permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 39043 } attrs { promote: false } } }
I20260812 17:43:17.569444 29837 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 17:43:17.576215 30642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:17.570403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.3:35507 (local address 127.0.0.1:35900)
0812 17:43:17.571465 (+ 1062us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:17.571479 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:17.571579 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:17.572234 (+ 655us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:17.572237 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:17.572253 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:43:17.572374 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:17.572381 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.573651 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.573655 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:17.574621 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:17.574632 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.575733 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.575737 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:17.575851 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:17.575881 (+ 30us) client_negotiation.cc:769] Sending connection context
0812 17:43:17.575969 (+ 88us) client_negotiation.cc:240] Negotiation successful
0812 17:43:17.576045 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":993,"thread_start_us":106,"threads_started":1}
I20260812 17:43:17.576853 30647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:17.570768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35900 (local address 127.17.255.3:35507)
0812 17:43:17.571258 (+ 490us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:17.571393 (+ 135us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:17.571560 (+ 167us) server_negotiation.cc:407] Connection header received
0812 17:43:17.571705 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:17.571711 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:17.571917 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:17.572075 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:43:17.572489 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.573533 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.574745 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.575590 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.575708 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:17.575865 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:17.576024 (+ 159us) server_negotiation.cc:299] Negotiation successful
0812 17:43:17.576138 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":118,"threads_started":1}
I20260812 17:43:17.577437 29397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:17.570039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:35191 (local address 127.0.0.1:45946)
0812 17:43:17.570180 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:17.570196 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:17.570287 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:17.571931 (+ 1644us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:17.571935 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:17.571952 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:43:17.572097 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:17.572105 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.574820 (+ 2715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.574823 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:17.575955 (+ 1132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:17.575969 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.577071 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.577075 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:17.577170 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:17.577196 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 17:43:17.577248 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 17:43:17.577313 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51,"mutex_wait_us":26}
I20260812 17:43:17.578190 30641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:17.570282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45946 (local address 127.17.255.2:35191)
0812 17:43:17.571258 (+ 976us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:17.571272 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:17.571302 (+ 30us) server_negotiation.cc:407] Connection header received
0812 17:43:17.571440 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:17.571448 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:17.571721 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:17.571941 (+ 220us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:43:17.572307 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.574664 (+ 2357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.576103 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.576929 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.577716 (+ 787us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:17.577877 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:17.577943 (+ 66us) server_negotiation.cc:299] Negotiation successful
0812 17:43:17.578041 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":859,"thread_start_us":174,"threads_started":1}
I20260812 17:43:17.578425 30644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:17.570601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:43215 (local address 127.0.0.1:37360)
0812 17:43:17.572908 (+ 2307us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:17.572926 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:17.573031 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:17.573851 (+ 820us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:17.573856 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:17.573879 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:43:17.573985 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:17.573992 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.575337 (+ 1345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.575344 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:17.576651 (+ 1307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:17.576660 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.577966 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.577970 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:17.578065 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:17.578090 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 17:43:17.578171 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 17:43:17.578244 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2225,"mutex_wait_us":21,"thread_start_us":115,"threads_started":1}
I20260812 17:43:17.578719 30646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:17.570758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37360 (local address 127.17.255.1:43215)
0812 17:43:17.572758 (+ 2000us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:17.572767 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:17.573137 (+ 370us) server_negotiation.cc:407] Connection header received
0812 17:43:17.573232 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:17.573238 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:17.573532 (+ 294us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:17.573691 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:43:17.574127 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.575207 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.576782 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.577627 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.577740 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:17.577874 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:17.578489 (+ 615us) server_negotiation.cc:299] Negotiation successful
0812 17:43:17.578596 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1855,"thread_start_us":81,"threads_started":1}
I20260812 17:43:17.580683 30465 tablet_service.cc:1467] Processing CreateTablet for tablet 7bdfa46605084cab8fc836cca37ca0a8 (DEFAULT_TABLE table=test-table [id=da984b55660347739c86040be5661512]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:43:17.580965 30210 tablet_service.cc:1467] Processing CreateTablet for tablet 7bdfa46605084cab8fc836cca37ca0a8 (DEFAULT_TABLE table=test-table [id=da984b55660347739c86040be5661512]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:43:17.581929 30465 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bdfa46605084cab8fc836cca37ca0a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:17.582131 30210 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bdfa46605084cab8fc836cca37ca0a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:17.584528 29974 tablet_service.cc:1467] Processing CreateTablet for tablet 7bdfa46605084cab8fc836cca37ca0a8 (DEFAULT_TABLE table=test-table [id=da984b55660347739c86040be5661512]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:43:17.585593 29974 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bdfa46605084cab8fc836cca37ca0a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:17.589833 30653 tablet_bootstrap.cc:492] T 7bdfa46605084cab8fc836cca37ca0a8 P 3e5f6e4a466340ba89376d1ad9bfe4a6: Bootstrap starting.
I20260812 17:43:17.590762 30654 tablet_bootstrap.cc:492] T 7bdfa46605084cab8fc836cca37ca0a8 P 4e163f02b82c44979f1dd43899bcdc4f: Bootstrap starting.
I20260812 17:43:17.593268 30654 tablet_bootstrap.cc:654] T 7bdfa46605084cab8fc836cca37ca0a8 P 4e163f02b82c44979f1dd43899bcdc4f: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:17.593654 30653 tablet_bootstrap.cc:654] T 7bdfa46605084cab8fc836cca37ca0a8 P 3e5f6e4a466340ba89376d1ad9bfe4a6: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:17.594319 30654 log.cc:824] T 7bdfa46605084cab8fc836cca37ca0a8 P 4e163f02b82c44979f1dd43899bcdc4f: Log is configured to *not* fsync() on all Append() calls
I20260812 17:43:17.594605 30655 tablet_bootstrap.cc:492] T 7bdfa46605084cab8fc836cca37ca0a8 P 6be4cec5a2dd4f8797098bbff7094259: Bootstrap starting.
I20260812 17:43:17.594658 30653 log.cc:824] T 7bdfa46605084cab8fc836cca37ca0a8 P 3e5f6e4a466340ba89376d1ad9bfe4a6: Log is configured to *not* fsync() on all Append() calls
I20260812 17:43:17.596596 30654 tablet_bootstrap.cc:492] T 7bdfa46605084cab8fc836cca37ca0a8 P 4e163f02b82c44979f1dd43899bcdc4f: No bootstrap required, opened a new log
I20260812 17:43:17.596861 30654 ts_tablet_manager.cc:1397] T 7bdfa46605084cab8fc836cca37ca0a8 P 4e163f02b82c44979f1dd43899bcdc4f: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20260812 17:43:17.596932 30653 tablet_bootstrap.cc:492] T 7bdfa46605084cab8fc836cca37ca0a8 P 3e5f6e4a466340ba89376d1ad9bfe4a6: No bootstrap required, opened a new log
I20260812 17:43:17.597133 30653 ts_tablet_manager.cc:1397] T 7bdfa46605084cab8fc836cca37ca0a8 P 3e5f6e4a466340ba89376d1ad9bfe4a6: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260812 17:43:17.597188 30655 tablet_bootstrap.cc:654] T 7bdfa46605084cab8fc836cca37ca0a8 P 6be4cec5a2dd4f8797098bbff7094259: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:17.598021 30655 log.cc:824] T 7bdfa46605084cab8fc836cca37ca0a8 P 6be4cec5a2dd4f8797098bbff7094259: Log is configured to *not* fsync() on all Append() calls
I20260812 17:43:17.600569 30655 tablet_bootstrap.cc:492] T 7bdfa46605084cab8fc836cca37ca0a8 P 6be4cec5a2dd4f8797098bbff7094259: No bootstrap required, opened a new log
I20260812 17:43:17.600780 30655 ts_tablet_manager.cc:1397] T 7bdfa46605084cab8fc836cca37ca0a8 P 6be4cec5a2dd4f8797098bbff7094259: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 17:43:17.601850 30654 raft_consensus.cc:348] T 7bdfa46605084cab8fc836cca37ca0a8 P 4e163f02b82c44979f1dd43899bcdc4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be4cec5a2dd4f8797098bbff7094259" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 43215 } } peers { permanent_uuid: "4e163f02b82c44979f1dd43899bcdc4f" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 35191 } } peers { permanent_uuid: "3e5f6e4a466340ba89376d1ad9bfe4a6" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 35507 } }
I20260812 17:43:17.602203 30654 raft_consensus.cc:374] T 7bdfa46605084cab8fc836cca37ca0a8 P 4e163f02b82c44979f1dd43899bcdc4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:17.602270 30654 raft_consensus.cc:729] T 7bdfa46605084cab8fc836cca37ca0a8 P 4e163f02b82c44979f1dd43899bcdc4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e163f02b82c44979f1dd43899bcdc4f, State: Initialized, Role: FOLLOWER
I20260812 17:43:17.602113 30653 raft_consensus.cc:348] T 7bdfa46605084cab8fc836cca37ca0a8 P 3e5f6e4a466340ba89376d1ad9bfe4a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be4cec5a2dd4f8797098bbff7094259" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 43215 } } peers { permanent_uuid: "4e163f02b82c44979f1dd43899bcdc4f" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 35191 } } peers { permanent_uuid: "3e5f6e4a466340ba89376d1ad9bfe4a6" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 35507 } }
I20260812 17:43:17.602556 30653 raft_consensus.cc:374] T 7bdfa46605084cab8fc836cca37ca0a8 P 3e5f6e4a466340ba89376d1ad9bfe4a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:17.602625 30653 raft_consensus.cc:729] T 7bdfa46605084cab8fc836cca37ca0a8 P 3e5f6e4a466340ba89376d1ad9bfe4a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e5f6e4a466340ba89376d1ad9bfe4a6, State: Initialized, Role: FOLLOWER
I20260812 17:43:17.602887 30654 consensus_queue.cc:260] T 7bdfa46605084cab8fc836cca37ca0a8 P 4e163f02b82c44979f1dd43899bcdc4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be4cec5a2dd4f8797098bbff7094259" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 43215 } } peers { permanent_uuid: "4e163f02b82c44979f1dd43899bcdc4f" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 35191 } } peers { permanent_uuid: "3e5f6e4a466340ba89376d1ad9bfe4a6" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 35507 } }
I20260812 17:43:17.603120 30653 consensus_queue.cc:260] T 7bdfa46605084cab8fc836cca37ca0a8 P 3e5f6e4a466340ba89376d1ad9bfe4a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be4cec5a2dd4f8797098bbff7094259" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 43215 } } peers { permanent_uuid: "4e163f02b82c44979f1dd43899bcdc4f" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 35191 } } peers { permanent_uuid: "3e5f6e4a466340ba89376d1ad9bfe4a6" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 35507 } }
I20260812 17:43:17.603722 30340 heartbeater.cc:503] Master 127.17.255.62:40187 was elected leader, sending a full tablet report...
I20260812 17:43:17.604135 30654 ts_tablet_manager.cc:1428] T 7bdfa46605084cab8fc836cca37ca0a8 P 4e163f02b82c44979f1dd43899bcdc4f: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260812 17:43:17.604140 30653 ts_tablet_manager.cc:1428] T 7bdfa46605084cab8fc836cca37ca0a8 P 3e5f6e4a466340ba89376d1ad9bfe4a6: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260812 17:43:17.604512 30585 heartbeater.cc:503] Master 127.17.255.62:40187 was elected leader, sending a full tablet report...
I20260812 17:43:17.605027 30655 raft_consensus.cc:348] T 7bdfa46605084cab8fc836cca37ca0a8 P 6be4cec5a2dd4f8797098bbff7094259 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be4cec5a2dd4f8797098bbff7094259" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 43215 } } peers { permanent_uuid: "4e163f02b82c44979f1dd43899bcdc4f" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 35191 } } peers { permanent_uuid: "3e5f6e4a466340ba89376d1ad9bfe4a6" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 35507 } }
I20260812 17:43:17.605286 30655 raft_consensus.cc:374] T 7bdfa46605084cab8fc836cca37ca0a8 P 6be4cec5a2dd4f8797098bbff7094259 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:17.605338 30655 raft_consensus.cc:729] T 7bdfa46605084cab8fc836cca37ca0a8 P 6be4cec5a2dd4f8797098bbff7094259 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6be4cec5a2dd4f8797098bbff7094259, State: Initialized, Role: FOLLOWER
I20260812 17:43:17.605756 30655 consensus_queue.cc:260] T 7bdfa46605084cab8fc836cca37ca0a8 P 6be4cec5a2dd4f8797098bbff7094259 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be4cec5a2dd4f8797098bbff7094259" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 43215 } } peers { permanent_uuid: "4e163f02b82c44979f1dd43899bcdc4f" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 35191 } } peers { permanent_uuid: "3e5f6e4a466340ba89376d1ad9bfe4a6" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 35507 } }
I20260812 17:43:17.607059 30655 ts_tablet_manager.cc:1428] T 7bdfa46605084cab8fc836cca37ca0a8 P 6be4cec5a2dd4f8797098bbff7094259: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260812 17:43:17.607476 30089 heartbeater.cc:503] Master 127.17.255.62:40187 was elected leader, sending a full tablet report...
W20260812 17:43:17.768522 30591 tablet.cc:2369] T 7bdfa46605084cab8fc836cca37ca0a8 P 3e5f6e4a466340ba89376d1ad9bfe4a6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 17:43:17.775233 30343 tablet.cc:2369] T 7bdfa46605084cab8fc836cca37ca0a8 P 4e163f02b82c44979f1dd43899bcdc4f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 17:43:17.775357 30092 tablet.cc:2369] T 7bdfa46605084cab8fc836cca37ca0a8 P 6be4cec5a2dd4f8797098bbff7094259: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 17:43:17.801580 30662 raft_consensus.cc:482] T 7bdfa46605084cab8fc836cca37ca0a8 P 3e5f6e4a466340ba89376d1ad9bfe4a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:43:17.801843 30662 raft_consensus.cc:504] T 7bdfa46605084cab8fc836cca37ca0a8 P 3e5f6e4a466340ba89376d1ad9bfe4a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be4cec5a2dd4f8797098bbff7094259" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 43215 } } peers { permanent_uuid: "4e163f02b82c44979f1dd43899bcdc4f" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 35191 } } peers { permanent_uuid: "3e5f6e4a466340ba89376d1ad9bfe4a6" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 35507 } }
I20260812 17:43:17.803375 30662 leader_election.cc:288] T 7bdfa46605084cab8fc836cca37ca0a8 P 3e5f6e4a466340ba89376d1ad9bfe4a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6be4cec5a2dd4f8797098bbff7094259 (127.17.255.1:43215), 4e163f02b82c44979f1dd43899bcdc4f (127.17.255.2:35191)
I20260812 17:43:17.807622 30641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:17.804027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:56825 (local address 127.17.255.2:35191)
0812 17:43:17.804167 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:17.804170 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:17.804182 (+ 12us) server_negotiation.cc:407] Connection header received
0812 17:43:17.804233 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:17.804235 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:17.804309 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:17.804405 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:43:17.804736 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.805247 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.806469 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.806935 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.807096 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:17.807154 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:17.807418 (+ 264us) server_negotiation.cc:299] Negotiation successful
0812 17:43:17.807496 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 17:43:17.807623 30594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:17.803765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:35191 (local address 127.17.255.3:56825)
0812 17:43:17.803957 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:17.803970 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:17.804034 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:17.804431 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:17.804434 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:17.804450 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:43:17.804592 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:17.804619 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.805382 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.805385 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:17.806287 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:17.806298 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.807108 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.807112 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:17.807250 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:17.807297 (+ 47us) client_negotiation.cc:769] Sending connection context
0812 17:43:17.807398 (+ 101us) client_negotiation.cc:240] Negotiation successful
0812 17:43:17.807489 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"mutex_wait_us":83,"spinlock_wait_cycles":9472}
I20260812 17:43:17.807652 30596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:17.803728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:43215 (local address 127.17.255.3:54883)
0812 17:43:17.803888 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:17.803907 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:17.804030 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:17.804334 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:17.804340 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:17.804368 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:43:17.804548 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:17.804555 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.805336 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.805343 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:17.806276 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:17.806287 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.807136 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.807140 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:17.807262 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:17.807305 (+ 43us) client_negotiation.cc:769] Sending connection context
0812 17:43:17.807380 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 17:43:17.807468 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64,"mutex_wait_us":28}
I20260812 17:43:17.808175 30646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:17.803817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:54883 (local address 127.17.255.1:43215)
0812 17:43:17.803951 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:17.803955 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:17.803975 (+ 20us) server_negotiation.cc:407] Connection header received
0812 17:43:17.804180 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:17.804183 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:17.804226 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:17.804285 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:43:17.804675 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.805213 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.806509 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.807002 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.807136 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:17.807192 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:17.807921 (+ 729us) server_negotiation.cc:299] Negotiation successful
0812 17:43:17.808033 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 17:43:17.808653 30245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bdfa46605084cab8fc836cca37ca0a8" candidate_uuid: "3e5f6e4a466340ba89376d1ad9bfe4a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e163f02b82c44979f1dd43899bcdc4f" is_pre_election: true
I20260812 17:43:17.808804 30005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bdfa46605084cab8fc836cca37ca0a8" candidate_uuid: "3e5f6e4a466340ba89376d1ad9bfe4a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6be4cec5a2dd4f8797098bbff7094259" is_pre_election: true
I20260812 17:43:17.809026 30245 raft_consensus.cc:2454] T 7bdfa46605084cab8fc836cca37ca0a8 P 4e163f02b82c44979f1dd43899bcdc4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e5f6e4a466340ba89376d1ad9bfe4a6 in term 0.
I20260812 17:43:17.809155 30005 raft_consensus.cc:2454] T 7bdfa46605084cab8fc836cca37ca0a8 P 6be4cec5a2dd4f8797098bbff7094259 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e5f6e4a466340ba89376d1ad9bfe4a6 in term 0.
I20260812 17:43:17.809615 30380 leader_election.cc:302] T 7bdfa46605084cab8fc836cca37ca0a8 P 3e5f6e4a466340ba89376d1ad9bfe4a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 3e5f6e4a466340ba89376d1ad9bfe4a6, 4e163f02b82c44979f1dd43899bcdc4f, 6be4cec5a2dd4f8797098bbff7094259; no voters:
I20260812 17:43:17.809895 30662 raft_consensus.cc:2781] T 7bdfa46605084cab8fc836cca37ca0a8 P 3e5f6e4a466340ba89376d1ad9bfe4a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 17:43:17.809991 30662 raft_consensus.cc:482] T 7bdfa46605084cab8fc836cca37ca0a8 P 3e5f6e4a466340ba89376d1ad9bfe4a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 17:43:17.810038 30662 raft_consensus.cc:3037] T 7bdfa46605084cab8fc836cca37ca0a8 P 3e5f6e4a466340ba89376d1ad9bfe4a6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:17.811225 30662 raft_consensus.cc:504] T 7bdfa46605084cab8fc836cca37ca0a8 P 3e5f6e4a466340ba89376d1ad9bfe4a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be4cec5a2dd4f8797098bbff7094259" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 43215 } } peers { permanent_uuid: "4e163f02b82c44979f1dd43899bcdc4f" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 35191 } } peers { permanent_uuid: "3e5f6e4a466340ba89376d1ad9bfe4a6" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 35507 } }
I20260812 17:43:17.811579 30662 leader_election.cc:288] T 7bdfa46605084cab8fc836cca37ca0a8 P 3e5f6e4a466340ba89376d1ad9bfe4a6 [CANDIDATE]: Term 1 election: Requested vote from peers 6be4cec5a2dd4f8797098bbff7094259 (127.17.255.1:43215), 4e163f02b82c44979f1dd43899bcdc4f (127.17.255.2:35191)
I20260812 17:43:17.811966 30005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bdfa46605084cab8fc836cca37ca0a8" candidate_uuid: "3e5f6e4a466340ba89376d1ad9bfe4a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6be4cec5a2dd4f8797098bbff7094259"
I20260812 17:43:17.811968 30245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bdfa46605084cab8fc836cca37ca0a8" candidate_uuid: "3e5f6e4a466340ba89376d1ad9bfe4a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e163f02b82c44979f1dd43899bcdc4f"
I20260812 17:43:17.812112 30005 raft_consensus.cc:3037] T 7bdfa46605084cab8fc836cca37ca0a8 P 6be4cec5a2dd4f8797098bbff7094259 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:17.812124 30245 raft_consensus.cc:3037] T 7bdfa46605084cab8fc836cca37ca0a8 P 4e163f02b82c44979f1dd43899bcdc4f [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:17.813197 30245 raft_consensus.cc:2454] T 7bdfa46605084cab8fc836cca37ca0a8 P 4e163f02b82c44979f1dd43899bcdc4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e5f6e4a466340ba89376d1ad9bfe4a6 in term 1.
I20260812 17:43:17.813344 30005 raft_consensus.cc:2454] T 7bdfa46605084cab8fc836cca37ca0a8 P 6be4cec5a2dd4f8797098bbff7094259 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e5f6e4a466340ba89376d1ad9bfe4a6 in term 1.
I20260812 17:43:17.813510 30380 leader_election.cc:302] T 7bdfa46605084cab8fc836cca37ca0a8 P 3e5f6e4a466340ba89376d1ad9bfe4a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e5f6e4a466340ba89376d1ad9bfe4a6, 4e163f02b82c44979f1dd43899bcdc4f; no voters:
I20260812 17:43:17.813759 30662 raft_consensus.cc:2781] T 7bdfa46605084cab8fc836cca37ca0a8 P 3e5f6e4a466340ba89376d1ad9bfe4a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:43:17.813946 30662 raft_consensus.cc:686] T 7bdfa46605084cab8fc836cca37ca0a8 P 3e5f6e4a466340ba89376d1ad9bfe4a6 [term 1 LEADER]: Becoming Leader. State: Replica: 3e5f6e4a466340ba89376d1ad9bfe4a6, State: Running, Role: LEADER
I20260812 17:43:17.814334 30662 consensus_queue.cc:237] T 7bdfa46605084cab8fc836cca37ca0a8 P 3e5f6e4a466340ba89376d1ad9bfe4a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be4cec5a2dd4f8797098bbff7094259" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 43215 } } peers { permanent_uuid: "4e163f02b82c44979f1dd43899bcdc4f" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 35191 } } peers { permanent_uuid: "3e5f6e4a466340ba89376d1ad9bfe4a6" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 35507 } }
I20260812 17:43:17.818521 28476 catalog_manager.cc:5495] T 7bdfa46605084cab8fc836cca37ca0a8 P 3e5f6e4a466340ba89376d1ad9bfe4a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e5f6e4a466340ba89376d1ad9bfe4a6 (127.17.255.3). New cstate: current_term: 1 leader_uuid: "3e5f6e4a466340ba89376d1ad9bfe4a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6be4cec5a2dd4f8797098bbff7094259" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 43215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e163f02b82c44979f1dd43899bcdc4f" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 35191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e5f6e4a466340ba89376d1ad9bfe4a6" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 35507 } health_report { overall_health: HEALTHY } } }
I20260812 17:43:17.875077 30647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:17.871134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35908 (local address 127.17.255.3:35507)
0812 17:43:17.871292 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:17.871297 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:17.871335 (+ 38us) server_negotiation.cc:407] Connection header received
0812 17:43:17.871458 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:17.871460 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:17.871520 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:17.871655 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:43:17.871993 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.872542 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.873501 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.873721 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.873813 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:17.874150 (+ 337us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:43:17.874683 (+ 533us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:43:17.874781 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:17.874843 (+ 62us) server_negotiation.cc:299] Negotiation successful
0812 17:43:17.874898 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 17:43:17.881435 30005 raft_consensus.cc:1261] T 7bdfa46605084cab8fc836cca37ca0a8 P 6be4cec5a2dd4f8797098bbff7094259 [term 1 FOLLOWER]: Refusing update from remote peer 3e5f6e4a466340ba89376d1ad9bfe4a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:43:17.881438 30245 raft_consensus.cc:1261] T 7bdfa46605084cab8fc836cca37ca0a8 P 4e163f02b82c44979f1dd43899bcdc4f [term 1 FOLLOWER]: Refusing update from remote peer 3e5f6e4a466340ba89376d1ad9bfe4a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:43:17.882177 30662 consensus_queue.cc:1035] T 7bdfa46605084cab8fc836cca37ca0a8 P 3e5f6e4a466340ba89376d1ad9bfe4a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e163f02b82c44979f1dd43899bcdc4f" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 35191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:43:17.882408 30669 consensus_queue.cc:1035] T 7bdfa46605084cab8fc836cca37ca0a8 P 3e5f6e4a466340ba89376d1ad9bfe4a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6be4cec5a2dd4f8797098bbff7094259" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 43215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:43:17.892681 30678 mvcc.cc:205] Tried to move back new op lower bound from 7317735824913817600 to 7317735824650788864. Current Snapshot: MvccSnapshot[applied={T|T < 7317735824913817600}]
I20260812 17:43:17.894699 30676 mvcc.cc:205] Tried to move back new op lower bound from 7317735824913817600 to 7317735824650788864. Current Snapshot: MvccSnapshot[applied={T|T < 7317735824913817600}]
I20260812 17:43:17.902567 30680 mvcc.cc:205] Tried to move back new op lower bound from 7317735824913817600 to 7317735824650788864. Current Snapshot: MvccSnapshot[applied={T|T < 7317735824913817600}]
I20260812 17:43:17.908483 28476 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43816:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:43:17.908692 28476 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43816:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:43:17.913964 28476 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 39d0a9a08559400f89e482c682e73ada: Sending DeleteTablet for 3 replicas of tablet 7bdfa46605084cab8fc836cca37ca0a8
I20260812 17:43:17.914786 29974 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bdfa46605084cab8fc836cca37ca0a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:43:17 UTC) from {username='oryx', principal='oryx/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:37360
I20260812 17:43:17.915009 30210 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bdfa46605084cab8fc836cca37ca0a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:43:17 UTC) from {username='oryx', principal='oryx/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:45946
I20260812 17:43:17.915423 30691 tablet_replica.cc:330] T 7bdfa46605084cab8fc836cca37ca0a8 P 4e163f02b82c44979f1dd43899bcdc4f: stopping tablet replica
I20260812 17:43:17.915791 30691 raft_consensus.cc:2229] T 7bdfa46605084cab8fc836cca37ca0a8 P 4e163f02b82c44979f1dd43899bcdc4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:43:17.915959 30465 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bdfa46605084cab8fc836cca37ca0a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:43:17 UTC) from {username='oryx', principal='oryx/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:35900
I20260812 17:43:17.916184 30691 raft_consensus.cc:2258] T 7bdfa46605084cab8fc836cca37ca0a8 P 4e163f02b82c44979f1dd43899bcdc4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:43:17.916640 30693 tablet_replica.cc:330] T 7bdfa46605084cab8fc836cca37ca0a8 P 3e5f6e4a466340ba89376d1ad9bfe4a6: stopping tablet replica
I20260812 17:43:17.916957 30693 raft_consensus.cc:2229] T 7bdfa46605084cab8fc836cca37ca0a8 P 3e5f6e4a466340ba89376d1ad9bfe4a6 [term 1 LEADER]: Raft consensus shutting down.
I20260812 17:43:17.917191 30690 tablet_replica.cc:330] T 7bdfa46605084cab8fc836cca37ca0a8 P 6be4cec5a2dd4f8797098bbff7094259: stopping tablet replica
I20260812 17:43:17.917502 30690 raft_consensus.cc:2229] T 7bdfa46605084cab8fc836cca37ca0a8 P 6be4cec5a2dd4f8797098bbff7094259 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:43:17.917747 30693 raft_consensus.cc:2258] T 7bdfa46605084cab8fc836cca37ca0a8 P 3e5f6e4a466340ba89376d1ad9bfe4a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:43:17.917863 30690 raft_consensus.cc:2258] T 7bdfa46605084cab8fc836cca37ca0a8 P 6be4cec5a2dd4f8797098bbff7094259 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:43:17.918131 30691 ts_tablet_manager.cc:1905] T 7bdfa46605084cab8fc836cca37ca0a8 P 4e163f02b82c44979f1dd43899bcdc4f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:43:17.918764 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 28419
I20260812 17:43:17.926499 30690 ts_tablet_manager.cc:1905] T 7bdfa46605084cab8fc836cca37ca0a8 P 6be4cec5a2dd4f8797098bbff7094259: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:43:17.926498 30693 ts_tablet_manager.cc:1905] T 7bdfa46605084cab8fc836cca37ca0a8 P 3e5f6e4a466340ba89376d1ad9bfe4a6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:43:17.927853 30691 ts_tablet_manager.cc:1918] T 7bdfa46605084cab8fc836cca37ca0a8 P 4e163f02b82c44979f1dd43899bcdc4f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 17:43:17.927978 30691 log.cc:1196] T 7bdfa46605084cab8fc836cca37ca0a8 P 4e163f02b82c44979f1dd43899bcdc4f: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-1/wal/wals/7bdfa46605084cab8fc836cca37ca0a8
I20260812 17:43:17.928351 30691 ts_tablet_manager.cc:1939] T 7bdfa46605084cab8fc836cca37ca0a8 P 4e163f02b82c44979f1dd43899bcdc4f: Deleting consensus metadata
I20260812 17:43:17.929500 30690 ts_tablet_manager.cc:1918] T 7bdfa46605084cab8fc836cca37ca0a8 P 6be4cec5a2dd4f8797098bbff7094259: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 17:43:17.929597 30690 log.cc:1196] T 7bdfa46605084cab8fc836cca37ca0a8 P 6be4cec5a2dd4f8797098bbff7094259: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-0/wal/wals/7bdfa46605084cab8fc836cca37ca0a8
I20260812 17:43:17.930114 30690 ts_tablet_manager.cc:1939] T 7bdfa46605084cab8fc836cca37ca0a8 P 6be4cec5a2dd4f8797098bbff7094259: Deleting consensus metadata
I20260812 17:43:17.930315 30693 ts_tablet_manager.cc:1918] T 7bdfa46605084cab8fc836cca37ca0a8 P 3e5f6e4a466340ba89376d1ad9bfe4a6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 17:43:17.930470 30693 log.cc:1196] T 7bdfa46605084cab8fc836cca37ca0a8 P 3e5f6e4a466340ba89376d1ad9bfe4a6: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-2/wal/wals/7bdfa46605084cab8fc836cca37ca0a8
I20260812 17:43:17.930836 30693 ts_tablet_manager.cc:1939] T 7bdfa46605084cab8fc836cca37ca0a8 P 3e5f6e4a466340ba89376d1ad9bfe4a6: Deleting consensus metadata
W20260812 17:43:17.935892 29896 connection.cc:535] server connection from 127.0.0.1:37360 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 17:43:17.936337 30137 connection.cc:535] server connection from 127.0.0.1:45946 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 17:43:17.937407 30383 connection.cc:535] server connection from 127.0.0.1:35900 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 17:43:17.943750 30607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:17.916839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52184 (local address 127.17.255.61:42601)
0812 17:43:17.916957 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:17.916962 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:17.932602 (+ 15640us) server_negotiation.cc:407] Connection header received
0812 17:43:17.932786 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:17.932790 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:17.932868 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:17.932969 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:17.934729 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.935587 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.936810 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.937190 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.937299 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:17.939405 (+ 2106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:17.939411 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:17.939414 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:17.939448 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:17.941546 (+ 2098us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:17.942096 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:17.942102 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:17.942104 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:17.942201 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:17.942601 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:17.942605 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:17.942607 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:17.942864 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:17.942980 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:17.943432 (+ 452us) server_negotiation.cc:299] Negotiation successful
0812 17:43:17.943579 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 17:43:17.950927 29657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:17.939741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52194 (local address 127.17.255.61:42601)
0812 17:43:17.939876 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:17.939879 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:17.940842 (+ 963us) server_negotiation.cc:407] Connection header received
0812 17:43:17.941051 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:17.941056 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:17.941114 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:17.941210 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:17.942115 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.943014 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.944616 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.944942 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.945014 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:17.946900 (+ 1886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:17.946904 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:17.946906 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:17.946935 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:17.948642 (+ 1707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:17.949180 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:17.949183 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:17.949186 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:17.949281 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:17.949749 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:17.949755 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:17.949758 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:17.950011 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:17.950135 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:17.950588 (+ 453us) server_negotiation.cc:299] Negotiation successful
0812 17:43:17.950716 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 17:43:17.952366 30093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:17.940517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33196 (local address 127.17.255.60:39043)
0812 17:43:17.940670 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:17.940676 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:17.942723 (+ 2047us) server_negotiation.cc:407] Connection header received
0812 17:43:17.942912 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:17.942915 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:17.942966 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:17.943019 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:17.943922 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.944681 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.946047 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.946486 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.946579 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:17.948574 (+ 1995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:17.948579 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:17.948582 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:17.948612 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:17.950413 (+ 1801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:17.950909 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:17.950912 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:17.950914 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:17.951009 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:17.951362 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:17.951365 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:17.951367 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:17.951593 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:17.951704 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:17.952065 (+ 361us) server_negotiation.cc:299] Negotiation successful
0812 17:43:17.952186 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 17:43:17.954432 30614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:17.917271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33184 (local address 127.17.255.60:39043)
0812 17:43:17.917413 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:17.917417 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:17.945347 (+ 27930us) server_negotiation.cc:407] Connection header received
0812 17:43:17.945539 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:17.945543 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:17.945607 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:17.945697 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:17.946490 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.947327 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.948525 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:17.948887 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:17.948963 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:17.950836 (+ 1873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:17.950840 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:17.950843 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:17.950879 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:17.952514 (+ 1635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:17.952997 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:17.953000 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:17.953003 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:17.953091 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:17.953522 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:17.953525 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:17.953526 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:17.953723 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:17.953874 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:17.954115 (+ 241us) server_negotiation.cc:299] Negotiation successful
0812 17:43:17.954245 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 17:43:18.895606 30717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:18.895088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.17.255.1:45903)
0812 17:43:18.895382 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:18.895492 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":90,"threads_started":1}
W20260812 17:43:18.896051 30089 heartbeater.cc:644] Failed to heartbeat to 127.17.255.62:40187 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
I20260812 17:43:18.902117 30719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:18.901525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.17.255.2:54769)
0812 17:43:18.901844 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:18.901971 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":113,"threads_started":1}
W20260812 17:43:18.902666 30340 heartbeater.cc:644] Failed to heartbeat to 127.17.255.62:40187 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
I20260812 17:43:18.903864 30720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:18.903489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.17.255.3:49901)
0812 17:43:18.903711 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:18.903783 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":78,"threads_started":1}
W20260812 17:43:18.904127 30585 heartbeater.cc:644] Failed to heartbeat to 127.17.255.62:40187 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
I20260812 17:43:19.413931 30721 raft_consensus.cc:482] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39d0a9a08559400f89e482c682e73ada)
I20260812 17:43:19.414207 30721 raft_consensus.cc:504] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: false } } peers { permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 39043 } attrs { promote: false } }
I20260812 17:43:19.414542 30722 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39d0a9a08559400f89e482c682e73ada)
I20260812 17:43:19.414767 30722 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: false } } peers { permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 39043 } attrs { promote: false } }
I20260812 17:43:19.415580 30721 leader_election.cc:288] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39d0a9a08559400f89e482c682e73ada (127.17.255.62:40187), 5c516b82a7a54204b11fbd229b8ede87 (127.17.255.60:39043)
I20260812 17:43:19.415699 30722 leader_election.cc:288] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39d0a9a08559400f89e482c682e73ada (127.17.255.62:40187), 49c170a02d22493c91370a2f8ee1d8e5 (127.17.255.61:42601)
I20260812 17:43:19.416270 30725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:19.415722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.0.0.1:44286)
0812 17:43:19.416047 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:19.416138 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":67,"threads_started":1}
W20260812 17:43:19.416447 29450 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
I20260812 17:43:19.417150 30729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:19.415883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.0.0.1:44292)
0812 17:43:19.416962 (+ 1079us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:19.417035 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":717,"thread_start_us":74,"threads_started":1}
I20260812 17:43:19.417443 30725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:19.417161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.0.0.1:44308)
0812 17:43:19.417310 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:19.417372 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
W20260812 17:43:19.417443 29746 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
W20260812 17:43:19.417564 29450 leader_election.cc:334] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 39d0a9a08559400f89e482c682e73ada (127.17.255.62:40187): Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
I20260812 17:43:19.418555 30729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:19.418280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.0.0.1:44322)
0812 17:43:19.418445 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:19.418491 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
W20260812 17:43:19.418651 29746 leader_election.cc:334] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 39d0a9a08559400f89e482c682e73ada (127.17.255.62:40187): Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
I20260812 17:43:19.420831 30726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:19.415859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:39043 (local address 127.0.0.1:33212)
0812 17:43:19.416227 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:19.416245 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:19.416360 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:19.416898 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:19.416902 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:19.416924 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:43:19.417088 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:19.417100 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:19.418364 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:19.418391 (+ 27us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:19.419618 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:19.419627 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:19.420456 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:19.420459 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:19.420566 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:19.420590 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 17:43:19.420655 (+ 65us) client_negotiation.cc:240] Negotiation successful
0812 17:43:19.420718 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":87,"threads_started":1}
I20260812 17:43:19.420910 30730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:19.416116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33212 (local address 127.17.255.60:39043)
0812 17:43:19.416571 (+ 455us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:19.416576 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:19.416591 (+ 15us) server_negotiation.cc:407] Connection header received
0812 17:43:19.416646 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:19.416649 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:19.416706 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:19.417219 (+ 513us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:43:19.417427 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:19.418237 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:19.419763 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:19.420322 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:19.420444 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:19.420506 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:19.420696 (+ 190us) server_negotiation.cc:299] Negotiation successful
0812 17:43:19.420773 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":374,"thread_start_us":71,"threads_started":1}
I20260812 17:43:19.421429 29795 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "49c170a02d22493c91370a2f8ee1d8e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "5c516b82a7a54204b11fbd229b8ede87" is_pre_election: true
I20260812 17:43:19.421584 30731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:19.416141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.61:42601 (local address 127.0.0.1:52208)
0812 17:43:19.416696 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:19.416715 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:19.416828 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:19.417245 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:19.417248 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:19.417267 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:43:19.417450 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:19.417460 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:19.418947 (+ 1487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:19.418952 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:19.420105 (+ 1153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:19.420115 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:19.421167 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:19.421170 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:19.421259 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:19.421285 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 17:43:19.421368 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 17:43:19.421448 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":473,"mutex_wait_us":54,"thread_start_us":67,"threads_started":1}
I20260812 17:43:19.421586 30732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:19.416421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52208 (local address 127.17.255.61:42601)
0812 17:43:19.416663 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:19.416667 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:19.416917 (+ 250us) server_negotiation.cc:407] Connection header received
0812 17:43:19.417023 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:19.417026 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:19.417071 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:19.417360 (+ 289us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:43:19.417653 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:19.418794 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:19.420227 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:19.420823 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:19.420946 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:19.421012 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:19.421409 (+ 397us) server_negotiation.cc:299] Negotiation successful
0812 17:43:19.421483 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":67,"threads_started":1}
I20260812 17:43:19.421685 29795 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49c170a02d22493c91370a2f8ee1d8e5 in term 1.
I20260812 17:43:19.422006 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5c516b82a7a54204b11fbd229b8ede87" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "49c170a02d22493c91370a2f8ee1d8e5" is_pre_election: true
I20260812 17:43:19.422134 29443 leader_election.cc:302] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 49c170a02d22493c91370a2f8ee1d8e5, 5c516b82a7a54204b11fbd229b8ede87; no voters: 39d0a9a08559400f89e482c682e73ada
I20260812 17:43:19.422212 29481 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c516b82a7a54204b11fbd229b8ede87 in term 1.
I20260812 17:43:19.422459 30721 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 17:43:19.422523 30721 raft_consensus.cc:482] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 39d0a9a08559400f89e482c682e73ada)
I20260812 17:43:19.422569 30721 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [term 1 FOLLOWER]: Advancing to term 2
I20260812 17:43:19.422621 29742 leader_election.cc:302] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 49c170a02d22493c91370a2f8ee1d8e5, 5c516b82a7a54204b11fbd229b8ede87; no voters: 39d0a9a08559400f89e482c682e73ada
I20260812 17:43:19.422823 30722 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 17:43:19.422874 30722 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 39d0a9a08559400f89e482c682e73ada)
I20260812 17:43:19.422914 30722 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [term 1 FOLLOWER]: Advancing to term 2
I20260812 17:43:19.423915 30721 raft_consensus.cc:504] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: false } } peers { permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 39043 } attrs { promote: false } }
I20260812 17:43:19.424382 30721 leader_election.cc:288] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [CANDIDATE]: Term 2 election: Requested vote from peers 39d0a9a08559400f89e482c682e73ada (127.17.255.62:40187), 5c516b82a7a54204b11fbd229b8ede87 (127.17.255.60:39043)
I20260812 17:43:19.424346 30722 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: false } } peers { permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 39043 } attrs { promote: false } }
I20260812 17:43:19.424775 30722 leader_election.cc:288] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [CANDIDATE]: Term 2 election: Requested vote from peers 39d0a9a08559400f89e482c682e73ada (127.17.255.62:40187), 49c170a02d22493c91370a2f8ee1d8e5 (127.17.255.61:42601)
I20260812 17:43:19.424918 30726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:19.424527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.0.0.1:44332)
0812 17:43:19.424750 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:19.424816 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144}
I20260812 17:43:19.424973 29795 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "49c170a02d22493c91370a2f8ee1d8e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "5c516b82a7a54204b11fbd229b8ede87"
I20260812 17:43:19.425138 29795 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 49c170a02d22493c91370a2f8ee1d8e5 in current term 2: Already voted for candidate 5c516b82a7a54204b11fbd229b8ede87 in this term.
I20260812 17:43:19.425108 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5c516b82a7a54204b11fbd229b8ede87" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "49c170a02d22493c91370a2f8ee1d8e5"
I20260812 17:43:19.425257 29481 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c516b82a7a54204b11fbd229b8ede87 in current term 2: Already voted for candidate 49c170a02d22493c91370a2f8ee1d8e5 in this term.
I20260812 17:43:19.425534 30731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:19.424865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.0.0.1:44334)
0812 17:43:19.425392 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:19.425456 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":455}
I20260812 17:43:19.425704 30726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:19.425401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.0.0.1:44346)
0812 17:43:19.425586 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:19.425640 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116}
W20260812 17:43:19.425825 29450 leader_election.cc:334] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 39d0a9a08559400f89e482c682e73ada (127.17.255.62:40187): Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
I20260812 17:43:19.425906 29450 leader_election.cc:302] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 49c170a02d22493c91370a2f8ee1d8e5; no voters: 39d0a9a08559400f89e482c682e73ada, 5c516b82a7a54204b11fbd229b8ede87
I20260812 17:43:19.426043 30721 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 17:43:19.426298 30731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:19.426036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.0.0.1:44358)
0812 17:43:19.426196 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:19.426250 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260812 17:43:19.426429 29746 leader_election.cc:334] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 39d0a9a08559400f89e482c682e73ada (127.17.255.62:40187): Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
I20260812 17:43:19.426497 29746 leader_election.cc:302] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c516b82a7a54204b11fbd229b8ede87; no voters: 39d0a9a08559400f89e482c682e73ada, 49c170a02d22493c91370a2f8ee1d8e5
I20260812 17:43:19.426631 30722 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 17:43:19.897249 30736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:19.896704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.17.255.1:59571)
0812 17:43:19.897064 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:19.897137 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":162,"threads_started":1}
I20260812 17:43:19.903811 30740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:19.903311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.17.255.2:41719)
0812 17:43:19.903611 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:19.903693 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":114,"threads_started":1}
I20260812 17:43:19.905043 30743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:19.904627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.17.255.3:47705)
0812 17:43:19.904910 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:19.904965 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":106,"threads_started":1}
I20260812 17:43:20.898705 30744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:20.898135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.17.255.1:39641)
0812 17:43:20.898493 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:20.898576 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":130,"threads_started":1}
I20260812 17:43:20.905489 30745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:20.904911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.17.255.2:44435)
0812 17:43:20.905277 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:20.905355 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":91,"threads_started":1}
I20260812 17:43:20.906432 30746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:20.905996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.17.255.3:49773)
0812 17:43:20.906250 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:20.906303 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":85,"threads_started":1}
I20260812 17:43:21.022110 30748 raft_consensus.cc:482] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:43:21.022233 30748 raft_consensus.cc:504] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: false } } peers { permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 39043 } attrs { promote: false } }
I20260812 17:43:21.022746 30748 leader_election.cc:288] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39d0a9a08559400f89e482c682e73ada (127.17.255.62:40187), 5c516b82a7a54204b11fbd229b8ede87 (127.17.255.60:39043)
I20260812 17:43:21.023171 29795 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "49c170a02d22493c91370a2f8ee1d8e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "5c516b82a7a54204b11fbd229b8ede87" is_pre_election: true
I20260812 17:43:21.023339 29795 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49c170a02d22493c91370a2f8ee1d8e5 in term 2.
I20260812 17:43:21.023360 30749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:21.022929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.0.0.1:44576)
0812 17:43:21.023211 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:21.023270 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":84,"threads_started":1}
I20260812 17:43:21.023680 29443 leader_election.cc:302] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49c170a02d22493c91370a2f8ee1d8e5, 5c516b82a7a54204b11fbd229b8ede87; no voters:
I20260812 17:43:21.023860 30748 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 17:43:21.023941 30748 raft_consensus.cc:482] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 17:43:21.024019 30748 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [term 2 FOLLOWER]: Advancing to term 3
I20260812 17:43:21.024202 30749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:21.023969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.0.0.1:44582)
0812 17:43:21.024097 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:21.024140 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260812 17:43:21.024288 29450 leader_election.cc:334] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 39d0a9a08559400f89e482c682e73ada (127.17.255.62:40187): Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
I20260812 17:43:21.025318 30748 raft_consensus.cc:504] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: false } } peers { permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 39043 } attrs { promote: false } }
I20260812 17:43:21.025669 30748 leader_election.cc:288] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [CANDIDATE]: Term 3 election: Requested vote from peers 39d0a9a08559400f89e482c682e73ada (127.17.255.62:40187), 5c516b82a7a54204b11fbd229b8ede87 (127.17.255.60:39043)
I20260812 17:43:21.025988 30749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:21.025777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.0.0.1:44584)
0812 17:43:21.025870 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:21.025923 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260812 17:43:21.026028 29795 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "49c170a02d22493c91370a2f8ee1d8e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "5c516b82a7a54204b11fbd229b8ede87"
I20260812 17:43:21.026199 29795 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [term 2 FOLLOWER]: Advancing to term 3
I20260812 17:43:21.027107 30749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:21.026889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.0.0.1:44590)
0812 17:43:21.026999 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:21.027048 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260812 17:43:21.027216 29450 leader_election.cc:334] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 39d0a9a08559400f89e482c682e73ada (127.17.255.62:40187): Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
I20260812 17:43:21.027271 29795 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49c170a02d22493c91370a2f8ee1d8e5 in term 3.
I20260812 17:43:21.027593 29443 leader_election.cc:302] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 49c170a02d22493c91370a2f8ee1d8e5, 5c516b82a7a54204b11fbd229b8ede87; no voters: 39d0a9a08559400f89e482c682e73ada
I20260812 17:43:21.027769 30748 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 17:43:21.027943 30748 raft_consensus.cc:686] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [term 3 LEADER]: Becoming Leader. State: Replica: 49c170a02d22493c91370a2f8ee1d8e5, State: Running, Role: LEADER
I20260812 17:43:21.028220 30748 consensus_queue.cc:237] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: false } } peers { permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 39043 } attrs { promote: false } }
I20260812 17:43:21.029350 30753 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 49c170a02d22493c91370a2f8ee1d8e5. Latest consensus state: current_term: 3 leader_uuid: "49c170a02d22493c91370a2f8ee1d8e5" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: false } } peers { permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 39043 } attrs { promote: false } } }
I20260812 17:43:21.029484 30753 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [sys.catalog]: This master's current role is: LEADER
I20260812 17:43:21.029788 30757 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:43:21.032444 30757 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:43:21.032868 30757 catalog_manager.cc:1259] Loaded cluster ID: 71dfef96b05640598e35d14e2687f57d
I20260812 17:43:21.032965 30757 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:43:21.033593 30757 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:43:21.034003 30757 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5: Loaded TSK: 0
I20260812 17:43:21.034796 30757 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 17:43:21.105729 29465 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52194:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 17:43:21.109403 29465 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 17:43:21.113163 30749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:21.112877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.0.0.1:44606)
0812 17:43:21.113011 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:21.113082 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260812 17:43:21.113345 29795 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [term 3 FOLLOWER]: Refusing update from remote peer 49c170a02d22493c91370a2f8ee1d8e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260812 17:43:21.113951 30749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:21.113687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.0.0.1:44620)
0812 17:43:21.113808 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:21.113866 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260812 17:43:21.113951 30753 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 39043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260812 17:43:21.114131 29450 consensus_peers.cc:487] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 -> Peer 39d0a9a08559400f89e482c682e73ada (127.17.255.62:40187): Couldn't send request to peer 39d0a9a08559400f89e482c682e73ada. Status: Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 17:43:21.115525 30762 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 49c170a02d22493c91370a2f8ee1d8e5. Latest consensus state: current_term: 3 leader_uuid: "49c170a02d22493c91370a2f8ee1d8e5" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: false } } peers { permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 39043 } attrs { promote: false } } }
I20260812 17:43:21.115684 30762 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 17:43:21.116767 30748 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "49c170a02d22493c91370a2f8ee1d8e5" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: false } } peers { permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 39043 } attrs { promote: false } } }
I20260812 17:43:21.116912 30748 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5 [sys.catalog]: This master's current role is: LEADER
I20260812 17:43:21.117163 30762 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "49c170a02d22493c91370a2f8ee1d8e5" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "39d0a9a08559400f89e482c682e73ada" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40187 } } peers { permanent_uuid: "49c170a02d22493c91370a2f8ee1d8e5" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42601 } attrs { promote: false } } peers { permanent_uuid: "5c516b82a7a54204b11fbd229b8ede87" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 39043 } attrs { promote: false } } }
I20260812 17:43:21.117304 30762 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c516b82a7a54204b11fbd229b8ede87 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 17:43:21.127215 30749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:21.123216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.3:35507 (local address 127.0.0.1:35924)
0812 17:43:21.123531 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:21.123546 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:21.123637 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:21.123935 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:21.123938 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:21.123954 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:43:21.124063 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:21.124069 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:21.125078 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:21.125082 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:21.125850 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:21.125858 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:21.126768 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:21.126772 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:21.126866 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:21.126900 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 17:43:21.126982 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 17:43:21.127060 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233,"mutex_wait_us":1}
I20260812 17:43:21.127234 30773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:21.123328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35924 (local address 127.17.255.3:35507)
0812 17:43:21.123701 (+ 373us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:21.123707 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:21.123723 (+ 16us) server_negotiation.cc:407] Connection header received
0812 17:43:21.123773 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:21.123786 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:21.123829 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:21.123924 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:43:21.124189 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:21.124962 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:21.125974 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:21.126640 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:21.126751 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:21.126826 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:21.127013 (+ 187us) server_negotiation.cc:299] Negotiation successful
0812 17:43:21.127087 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":80,"threads_started":1}
I20260812 17:43:21.128171 30465 tablet_service.cc:1467] Processing CreateTablet for tablet e0489050887543798a33d0d801523d15 (DEFAULT_TABLE table=test-table [id=ef8765f9bcea4c219a8a566949ab8e33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:43:21.128360 30779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:21.123684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:43215 (local address 127.0.0.1:37366)
0812 17:43:21.124304 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:21.124315 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:21.124377 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:21.124893 (+ 516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:21.124895 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:21.124908 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:43:21.124985 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:21.124993 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:21.126056 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:21.126060 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:21.127051 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:21.127060 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:21.127948 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:21.127952 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:21.128042 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:21.128064 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 17:43:21.128160 (+ 96us) client_negotiation.cc:240] Negotiation successful
0812 17:43:21.128227 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":559,"mutex_wait_us":24,"thread_start_us":85,"threads_started":1}
I20260812 17:43:21.128361 30783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:21.124271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37366 (local address 127.17.255.1:43215)
0812 17:43:21.124566 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:21.124570 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:21.124583 (+ 13us) server_negotiation.cc:407] Connection header received
0812 17:43:21.124641 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:21.124644 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:21.124689 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:21.124777 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:43:21.125111 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:21.125916 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:21.127177 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:21.127819 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:21.127944 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:21.128004 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:21.128176 (+ 172us) server_negotiation.cc:299] Negotiation successful
0812 17:43:21.128245 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":92,"threads_started":1}
I20260812 17:43:21.128520 30465 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0489050887543798a33d0d801523d15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:21.128935 29974 tablet_service.cc:1467] Processing CreateTablet for tablet e0489050887543798a33d0d801523d15 (DEFAULT_TABLE table=test-table [id=ef8765f9bcea4c219a8a566949ab8e33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:43:21.129153 29974 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0489050887543798a33d0d801523d15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:21.130779 30784 tablet_bootstrap.cc:492] T e0489050887543798a33d0d801523d15 P 3e5f6e4a466340ba89376d1ad9bfe4a6: Bootstrap starting.
I20260812 17:43:21.131381 30785 tablet_bootstrap.cc:492] T e0489050887543798a33d0d801523d15 P 6be4cec5a2dd4f8797098bbff7094259: Bootstrap starting.
I20260812 17:43:21.131758 30776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:21.123650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:35191 (local address 127.0.0.1:45954)
0812 17:43:21.124040 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:21.124054 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:21.124152 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:21.124826 (+ 674us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:21.124829 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:21.124846 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:43:21.124949 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:21.124957 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:21.126089 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:21.126093 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:21.127872 (+ 1779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:21.127882 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:21.131446 (+ 3564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:21.131450 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:21.131542 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:21.131565 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 17:43:21.131614 (+ 49us) client_negotiation.cc:240] Negotiation successful
0812 17:43:21.131663 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"mutex_wait_us":538,"thread_start_us":89,"threads_started":1}
I20260812 17:43:21.131820 30784 tablet_bootstrap.cc:654] T e0489050887543798a33d0d801523d15 P 3e5f6e4a466340ba89376d1ad9bfe4a6: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:21.132301 30782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:21.124032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45954 (local address 127.17.255.2:35191)
0812 17:43:21.124592 (+ 560us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:21.124598 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:21.124612 (+ 14us) server_negotiation.cc:407] Connection header received
0812 17:43:21.124658 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:21.124660 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:21.124703 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:21.125066 (+ 363us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:43:21.125178 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:21.125916 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:21.130705 (+ 4789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:21.131308 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:21.132054 (+ 746us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:21.132113 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:21.132145 (+ 32us) server_negotiation.cc:299] Negotiation successful
0812 17:43:21.132202 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":482,"thread_start_us":93,"threads_started":1}
I20260812 17:43:21.132333 30785 tablet_bootstrap.cc:654] T e0489050887543798a33d0d801523d15 P 6be4cec5a2dd4f8797098bbff7094259: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:21.132858 30210 tablet_service.cc:1467] Processing CreateTablet for tablet e0489050887543798a33d0d801523d15 (DEFAULT_TABLE table=test-table [id=ef8765f9bcea4c219a8a566949ab8e33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:43:21.133147 30210 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0489050887543798a33d0d801523d15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:21.133980 30784 tablet_bootstrap.cc:492] T e0489050887543798a33d0d801523d15 P 3e5f6e4a466340ba89376d1ad9bfe4a6: No bootstrap required, opened a new log
I20260812 17:43:21.134055 30784 ts_tablet_manager.cc:1397] T e0489050887543798a33d0d801523d15 P 3e5f6e4a466340ba89376d1ad9bfe4a6: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 17:43:21.134498 30784 raft_consensus.cc:348] T e0489050887543798a33d0d801523d15 P 3e5f6e4a466340ba89376d1ad9bfe4a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5f6e4a466340ba89376d1ad9bfe4a6" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 35507 } } peers { permanent_uuid: "4e163f02b82c44979f1dd43899bcdc4f" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 35191 } } peers { permanent_uuid: "6be4cec5a2dd4f8797098bbff7094259" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 43215 } }
I20260812 17:43:21.134639 30784 raft_consensus.cc:374] T e0489050887543798a33d0d801523d15 P 3e5f6e4a466340ba89376d1ad9bfe4a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:21.134747 30784 raft_consensus.cc:729] T e0489050887543798a33d0d801523d15 P 3e5f6e4a466340ba89376d1ad9bfe4a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e5f6e4a466340ba89376d1ad9bfe4a6, State: Initialized, Role: FOLLOWER
I20260812 17:43:21.134956 30784 consensus_queue.cc:260] T e0489050887543798a33d0d801523d15 P 3e5f6e4a466340ba89376d1ad9bfe4a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5f6e4a466340ba89376d1ad9bfe4a6" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 35507 } } peers { permanent_uuid: "4e163f02b82c44979f1dd43899bcdc4f" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 35191 } } peers { permanent_uuid: "6be4cec5a2dd4f8797098bbff7094259" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 43215 } }
I20260812 17:43:21.135246 30785 tablet_bootstrap.cc:492] T e0489050887543798a33d0d801523d15 P 6be4cec5a2dd4f8797098bbff7094259: No bootstrap required, opened a new log
I20260812 17:43:21.135341 30785 ts_tablet_manager.cc:1397] T e0489050887543798a33d0d801523d15 P 6be4cec5a2dd4f8797098bbff7094259: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260812 17:43:21.135349 30784 ts_tablet_manager.cc:1428] T e0489050887543798a33d0d801523d15 P 3e5f6e4a466340ba89376d1ad9bfe4a6: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260812 17:43:21.135766 30798 tablet_bootstrap.cc:492] T e0489050887543798a33d0d801523d15 P 4e163f02b82c44979f1dd43899bcdc4f: Bootstrap starting.
I20260812 17:43:21.135836 30785 raft_consensus.cc:348] T e0489050887543798a33d0d801523d15 P 6be4cec5a2dd4f8797098bbff7094259 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5f6e4a466340ba89376d1ad9bfe4a6" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 35507 } } peers { permanent_uuid: "4e163f02b82c44979f1dd43899bcdc4f" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 35191 } } peers { permanent_uuid: "6be4cec5a2dd4f8797098bbff7094259" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 43215 } }
I20260812 17:43:21.135953 30785 raft_consensus.cc:374] T e0489050887543798a33d0d801523d15 P 6be4cec5a2dd4f8797098bbff7094259 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:21.135987 30785 raft_consensus.cc:729] T e0489050887543798a33d0d801523d15 P 6be4cec5a2dd4f8797098bbff7094259 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6be4cec5a2dd4f8797098bbff7094259, State: Initialized, Role: FOLLOWER
I20260812 17:43:21.136106 30785 consensus_queue.cc:260] T e0489050887543798a33d0d801523d15 P 6be4cec5a2dd4f8797098bbff7094259 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5f6e4a466340ba89376d1ad9bfe4a6" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 35507 } } peers { permanent_uuid: "4e163f02b82c44979f1dd43899bcdc4f" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 35191 } } peers { permanent_uuid: "6be4cec5a2dd4f8797098bbff7094259" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 43215 } }
I20260812 17:43:21.136225 30746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:21.135980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.17.255.3:57947)
0812 17:43:21.136100 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:21.136158 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260812 17:43:21.136441 30785 ts_tablet_manager.cc:1428] T e0489050887543798a33d0d801523d15 P 6be4cec5a2dd4f8797098bbff7094259: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 17:43:21.136704 30798 tablet_bootstrap.cc:654] T e0489050887543798a33d0d801523d15 P 4e163f02b82c44979f1dd43899bcdc4f: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:21.138026 30798 tablet_bootstrap.cc:492] T e0489050887543798a33d0d801523d15 P 4e163f02b82c44979f1dd43899bcdc4f: No bootstrap required, opened a new log
I20260812 17:43:21.138155 30798 ts_tablet_manager.cc:1397] T e0489050887543798a33d0d801523d15 P 4e163f02b82c44979f1dd43899bcdc4f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 17:43:21.138635 30798 raft_consensus.cc:348] T e0489050887543798a33d0d801523d15 P 4e163f02b82c44979f1dd43899bcdc4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5f6e4a466340ba89376d1ad9bfe4a6" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 35507 } } peers { permanent_uuid: "4e163f02b82c44979f1dd43899bcdc4f" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 35191 } } peers { permanent_uuid: "6be4cec5a2dd4f8797098bbff7094259" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 43215 } }
I20260812 17:43:21.138765 30798 raft_consensus.cc:374] T e0489050887543798a33d0d801523d15 P 4e163f02b82c44979f1dd43899bcdc4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:21.138826 30798 raft_consensus.cc:729] T e0489050887543798a33d0d801523d15 P 4e163f02b82c44979f1dd43899bcdc4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e163f02b82c44979f1dd43899bcdc4f, State: Initialized, Role: FOLLOWER
I20260812 17:43:21.138826 30588 heartbeater.cc:503] Master 127.17.255.61:42601 was elected leader, sending a full tablet report...
I20260812 17:43:21.138958 30798 consensus_queue.cc:260] T e0489050887543798a33d0d801523d15 P 4e163f02b82c44979f1dd43899bcdc4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5f6e4a466340ba89376d1ad9bfe4a6" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 35507 } } peers { permanent_uuid: "4e163f02b82c44979f1dd43899bcdc4f" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 35191 } } peers { permanent_uuid: "6be4cec5a2dd4f8797098bbff7094259" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 43215 } }
I20260812 17:43:21.139178 30744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:21.137182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.17.255.1:34645)
0812 17:43:21.139027 (+ 1845us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:21.139091 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1766}
I20260812 17:43:21.139328 30798 ts_tablet_manager.cc:1428] T e0489050887543798a33d0d801523d15 P 4e163f02b82c44979f1dd43899bcdc4f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 17:43:21.140506 30745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:21.140216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.17.255.2:55635)
0812 17:43:21.140358 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:21.140423 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260812 17:43:21.140887 30744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:21.140658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.17.255.1:46659)
0812 17:43:21.140755 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:21.140818 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260812 17:43:21.141014 30091 heartbeater.cc:503] Master 127.17.255.61:42601 was elected leader, sending a full tablet report...
I20260812 17:43:21.141601 30342 heartbeater.cc:503] Master 127.17.255.61:42601 was elected leader, sending a full tablet report...
I20260812 17:43:21.143302 30745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:21.143042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.17.255.2:35917)
0812 17:43:21.143184 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:21.143245 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260812 17:43:21.143316 30746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:21.143069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.17.255.3:38059)
0812 17:43:21.143185 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:21.143241 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260812 17:43:21.170639 30806 raft_consensus.cc:482] T e0489050887543798a33d0d801523d15 P 4e163f02b82c44979f1dd43899bcdc4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:43:21.170797 30806 raft_consensus.cc:504] T e0489050887543798a33d0d801523d15 P 4e163f02b82c44979f1dd43899bcdc4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5f6e4a466340ba89376d1ad9bfe4a6" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 35507 } } peers { permanent_uuid: "4e163f02b82c44979f1dd43899bcdc4f" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 35191 } } peers { permanent_uuid: "6be4cec5a2dd4f8797098bbff7094259" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 43215 } }
I20260812 17:43:21.172142 30806 leader_election.cc:288] T e0489050887543798a33d0d801523d15 P 4e163f02b82c44979f1dd43899bcdc4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e5f6e4a466340ba89376d1ad9bfe4a6 (127.17.255.3:35507), 6be4cec5a2dd4f8797098bbff7094259 (127.17.255.1:43215)
I20260812 17:43:21.176323 30745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:21.172377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:43215 (local address 127.17.255.2:50003)
0812 17:43:21.172492 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:21.172510 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:21.172620 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:21.172926 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:21.172928 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:21.172996 (+ 68us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:43:21.173169 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:21.173181 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:21.174111 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:21.174114 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:21.175156 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:21.175167 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:21.175856 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:21.175860 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:21.175977 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:21.176005 (+ 28us) client_negotiation.cc:769] Sending connection context
0812 17:43:21.176084 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 17:43:21.176159 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260812 17:43:21.176329 30783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:21.172487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:50003 (local address 127.17.255.1:43215)
0812 17:43:21.172621 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:21.172626 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:21.172642 (+ 16us) server_negotiation.cc:407] Connection header received
0812 17:43:21.172717 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:21.172720 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:21.172795 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:21.172881 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:43:21.173350 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:21.173996 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:21.175284 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:21.175733 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:21.175831 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:21.175875 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:21.176113 (+ 238us) server_negotiation.cc:299] Negotiation successful
0812 17:43:21.176197 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 17:43:21.176486 30773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:21.172483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:47147 (local address 127.17.255.3:35507)
0812 17:43:21.172611 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:21.172614 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:21.173233 (+ 619us) server_negotiation.cc:407] Connection header received
0812 17:43:21.173315 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:21.173317 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:21.173360 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:21.173438 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:43:21.173732 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:21.174369 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:21.175435 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:21.175872 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:21.175997 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:21.176048 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:21.176274 (+ 226us) server_negotiation.cc:299] Negotiation successful
0812 17:43:21.176369 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 17:43:21.176535 30807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:21.172384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.3:35507 (local address 127.17.255.2:47147)
0812 17:43:21.173103 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:21.173120 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:21.173225 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:21.173470 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:21.173473 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:21.173492 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:43:21.173608 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:21.173614 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:21.174508 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:21.174511 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:21.175296 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:21.175307 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:21.176000 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:21.176003 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:21.176134 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:21.176157 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 17:43:21.176235 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 17:43:21.176302 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":657,"mutex_wait_us":313,"thread_start_us":149,"threads_started":1}
I20260812 17:43:21.177137 30501 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0489050887543798a33d0d801523d15" candidate_uuid: "4e163f02b82c44979f1dd43899bcdc4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e5f6e4a466340ba89376d1ad9bfe4a6" is_pre_election: true
I20260812 17:43:21.177184 30005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0489050887543798a33d0d801523d15" candidate_uuid: "4e163f02b82c44979f1dd43899bcdc4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6be4cec5a2dd4f8797098bbff7094259" is_pre_election: true
I20260812 17:43:21.177341 30005 raft_consensus.cc:2454] T e0489050887543798a33d0d801523d15 P 6be4cec5a2dd4f8797098bbff7094259 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e163f02b82c44979f1dd43899bcdc4f in term 0.
I20260812 17:43:21.177415 30501 raft_consensus.cc:2454] T e0489050887543798a33d0d801523d15 P 3e5f6e4a466340ba89376d1ad9bfe4a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e163f02b82c44979f1dd43899bcdc4f in term 0.
I20260812 17:43:21.177798 30137 leader_election.cc:302] T e0489050887543798a33d0d801523d15 P 4e163f02b82c44979f1dd43899bcdc4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 3e5f6e4a466340ba89376d1ad9bfe4a6, 4e163f02b82c44979f1dd43899bcdc4f, 6be4cec5a2dd4f8797098bbff7094259; no voters:
I20260812 17:43:21.178093 30806 raft_consensus.cc:2781] T e0489050887543798a33d0d801523d15 P 4e163f02b82c44979f1dd43899bcdc4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 17:43:21.178169 30806 raft_consensus.cc:482] T e0489050887543798a33d0d801523d15 P 4e163f02b82c44979f1dd43899bcdc4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 17:43:21.178216 30806 raft_consensus.cc:3037] T e0489050887543798a33d0d801523d15 P 4e163f02b82c44979f1dd43899bcdc4f [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:21.179402 30806 raft_consensus.cc:504] T e0489050887543798a33d0d801523d15 P 4e163f02b82c44979f1dd43899bcdc4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5f6e4a466340ba89376d1ad9bfe4a6" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 35507 } } peers { permanent_uuid: "4e163f02b82c44979f1dd43899bcdc4f" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 35191 } } peers { permanent_uuid: "6be4cec5a2dd4f8797098bbff7094259" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 43215 } }
I20260812 17:43:21.179770 30806 leader_election.cc:288] T e0489050887543798a33d0d801523d15 P 4e163f02b82c44979f1dd43899bcdc4f [CANDIDATE]: Term 1 election: Requested vote from peers 3e5f6e4a466340ba89376d1ad9bfe4a6 (127.17.255.3:35507), 6be4cec5a2dd4f8797098bbff7094259 (127.17.255.1:43215)
I20260812 17:43:21.180184 30501 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0489050887543798a33d0d801523d15" candidate_uuid: "4e163f02b82c44979f1dd43899bcdc4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e5f6e4a466340ba89376d1ad9bfe4a6"
I20260812 17:43:21.180184 30005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0489050887543798a33d0d801523d15" candidate_uuid: "4e163f02b82c44979f1dd43899bcdc4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6be4cec5a2dd4f8797098bbff7094259"
I20260812 17:43:21.180315 30005 raft_consensus.cc:3037] T e0489050887543798a33d0d801523d15 P 6be4cec5a2dd4f8797098bbff7094259 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:21.180315 30501 raft_consensus.cc:3037] T e0489050887543798a33d0d801523d15 P 3e5f6e4a466340ba89376d1ad9bfe4a6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:21.181478 30005 raft_consensus.cc:2454] T e0489050887543798a33d0d801523d15 P 6be4cec5a2dd4f8797098bbff7094259 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e163f02b82c44979f1dd43899bcdc4f in term 1.
I20260812 17:43:21.181483 30501 raft_consensus.cc:2454] T e0489050887543798a33d0d801523d15 P 3e5f6e4a466340ba89376d1ad9bfe4a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e163f02b82c44979f1dd43899bcdc4f in term 1.
I20260812 17:43:21.181770 30137 leader_election.cc:302] T e0489050887543798a33d0d801523d15 P 4e163f02b82c44979f1dd43899bcdc4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 3e5f6e4a466340ba89376d1ad9bfe4a6, 4e163f02b82c44979f1dd43899bcdc4f, 6be4cec5a2dd4f8797098bbff7094259; no voters:
I20260812 17:43:21.181921 30806 raft_consensus.cc:2781] T e0489050887543798a33d0d801523d15 P 4e163f02b82c44979f1dd43899bcdc4f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:43:21.182147 30806 raft_consensus.cc:686] T e0489050887543798a33d0d801523d15 P 4e163f02b82c44979f1dd43899bcdc4f [term 1 LEADER]: Becoming Leader. State: Replica: 4e163f02b82c44979f1dd43899bcdc4f, State: Running, Role: LEADER
I20260812 17:43:21.182461 30806 consensus_queue.cc:237] T e0489050887543798a33d0d801523d15 P 4e163f02b82c44979f1dd43899bcdc4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5f6e4a466340ba89376d1ad9bfe4a6" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 35507 } } peers { permanent_uuid: "4e163f02b82c44979f1dd43899bcdc4f" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 35191 } } peers { permanent_uuid: "6be4cec5a2dd4f8797098bbff7094259" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 43215 } }
I20260812 17:43:21.183084 30807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:21.182838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.17.255.2:37737)
0812 17:43:21.182970 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:21.183023 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260812 17:43:21.185184 29465 catalog_manager.cc:5495] T e0489050887543798a33d0d801523d15 P 4e163f02b82c44979f1dd43899bcdc4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e163f02b82c44979f1dd43899bcdc4f (127.17.255.2). New cstate: current_term: 1 leader_uuid: "4e163f02b82c44979f1dd43899bcdc4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e5f6e4a466340ba89376d1ad9bfe4a6" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 35507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e163f02b82c44979f1dd43899bcdc4f" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 35191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6be4cec5a2dd4f8797098bbff7094259" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 43215 } health_report { overall_health: UNKNOWN } } }
I20260812 17:43:21.198833 30782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:21.195440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45964 (local address 127.17.255.2:35191)
0812 17:43:21.195576 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:21.195580 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:21.195593 (+ 13us) server_negotiation.cc:407] Connection header received
0812 17:43:21.195671 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:21.195673 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:21.195727 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:21.195817 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:43:21.196064 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:21.196559 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:21.197383 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:21.197588 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:21.197658 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:21.197923 (+ 265us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:43:21.198432 (+ 509us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:43:21.198536 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:21.198609 (+ 73us) server_negotiation.cc:299] Negotiation successful
0812 17:43:21.198662 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 17:43:21.201608 30005 raft_consensus.cc:1261] T e0489050887543798a33d0d801523d15 P 6be4cec5a2dd4f8797098bbff7094259 [term 1 FOLLOWER]: Refusing update from remote peer 4e163f02b82c44979f1dd43899bcdc4f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:43:21.201910 30501 raft_consensus.cc:1261] T e0489050887543798a33d0d801523d15 P 3e5f6e4a466340ba89376d1ad9bfe4a6 [term 1 FOLLOWER]: Refusing update from remote peer 4e163f02b82c44979f1dd43899bcdc4f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:43:21.202195 30806 consensus_queue.cc:1035] T e0489050887543798a33d0d801523d15 P 4e163f02b82c44979f1dd43899bcdc4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6be4cec5a2dd4f8797098bbff7094259" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 43215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:43:21.202491 30808 consensus_queue.cc:1035] T e0489050887543798a33d0d801523d15 P 4e163f02b82c44979f1dd43899bcdc4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e5f6e4a466340ba89376d1ad9bfe4a6" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 35507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:43:21.204342 30744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:21.204006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.17.255.1:47175)
0812 17:43:21.204193 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:21.204261 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260812 17:43:21.204736 30746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:21.204449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.17.255.3:38331)
0812 17:43:21.204608 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:21.204666 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260812 17:43:21.209275 30807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:21.208734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.17.255.2:41113)
0812 17:43:21.209136 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:21.209199 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":318}
I20260812 17:43:21.209967 30746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:21.209582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.17.255.3:60493)
0812 17:43:21.209833 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:21.209887 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179}
I20260812 17:43:21.210353 30744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:21.209992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40187 (local address 127.17.255.1:43085)
0812 17:43:21.210227 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:21.210297 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:40187: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134}
I20260812 17:43:21.220173 29467 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52194:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:43:21.220361 29467 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52194:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:43:21.224434 29467 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 49c170a02d22493c91370a2f8ee1d8e5: Sending DeleteTablet for 3 replicas of tablet e0489050887543798a33d0d801523d15
I20260812 17:43:21.225337 30465 tablet_service.cc:1514] Processing DeleteTablet for tablet e0489050887543798a33d0d801523d15 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:43:21 UTC) from {username='oryx', principal='oryx/127.17.255.61@KRBTEST.COM'} at 127.0.0.1:35924
I20260812 17:43:21.225356 29974 tablet_service.cc:1514] Processing DeleteTablet for tablet e0489050887543798a33d0d801523d15 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:43:21 UTC) from {username='oryx', principal='oryx/127.17.255.61@KRBTEST.COM'} at 127.0.0.1:37366
I20260812 17:43:21.225749 30210 tablet_service.cc:1514] Processing DeleteTablet for tablet e0489050887543798a33d0d801523d15 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:43:21 UTC) from {username='oryx', principal='oryx/127.17.255.61@KRBTEST.COM'} at 127.0.0.1:45954
I20260812 17:43:21.226100 30828 tablet_replica.cc:330] T e0489050887543798a33d0d801523d15 P 3e5f6e4a466340ba89376d1ad9bfe4a6: stopping tablet replica
I20260812 17:43:21.226233 30834 tablet_replica.cc:330] T e0489050887543798a33d0d801523d15 P 4e163f02b82c44979f1dd43899bcdc4f: stopping tablet replica
I20260812 17:43:21.226577 30834 raft_consensus.cc:2229] T e0489050887543798a33d0d801523d15 P 4e163f02b82c44979f1dd43899bcdc4f [term 1 LEADER]: Raft consensus shutting down.
I20260812 17:43:21.226615 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 29694
I20260812 17:43:21.271576 30828 raft_consensus.cc:2229] T e0489050887543798a33d0d801523d15 P 3e5f6e4a466340ba89376d1ad9bfe4a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:43:21.271838 30828 raft_consensus.cc:2258] T e0489050887543798a33d0d801523d15 P 3e5f6e4a466340ba89376d1ad9bfe4a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:43:21.271873 30834 raft_consensus.cc:2258] T e0489050887543798a33d0d801523d15 P 4e163f02b82c44979f1dd43899bcdc4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:43:21.272925 30828 ts_tablet_manager.cc:1905] T e0489050887543798a33d0d801523d15 P 3e5f6e4a466340ba89376d1ad9bfe4a6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:43:21.276312 30828 ts_tablet_manager.cc:1918] T e0489050887543798a33d0d801523d15 P 3e5f6e4a466340ba89376d1ad9bfe4a6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 17:43:21.276499 30828 log.cc:1196] T e0489050887543798a33d0d801523d15 P 3e5f6e4a466340ba89376d1ad9bfe4a6: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786556557564181-18428-0/minicluster-data/ts-2/wal/wals/e0489050887543798a33d0d801523d15
I20260812 17:43:21.276932 30828 ts_tablet_manager.cc:1939] T e0489050887543798a33d0d801523d15 P 3e5f6e4a466340ba89376d1ad9bfe4a6: Deleting consensus metadata
I20260812 17:43:21.278014 29449 catalog_manager.cc:4841] TS 3e5f6e4a466340ba89376d1ad9bfe4a6 (127.17.255.3:35507): tablet e0489050887543798a33d0d801523d15 (table test-table [id=ef8765f9bcea4c219a8a566949ab8e33]) successfully deleted
I20260812 17:43:21.279023 30834 ts_tablet_manager.cc:1905] T e0489050887543798a33d0d801523d15 P 4e163f02b82c44979f1dd43899bcdc4f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:43:21.282042 30834 ts_tablet_manager.cc:1918] T e0489050887543798a33d0d801523d15 P 4e163f02b82c44979f1dd43899bcdc4f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 17:43:21.282088 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 30111
W20260812 17:43:21.284684 30776 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:21.280981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:43215 (local address 127.0.0.1:37368)
0812 17:43:21.284482 (+ 3501us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:21.284554 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.1:43215: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":3386}
W20260812 17:43:21.304520 29443 catalog_manager.cc:4584] TS 6be4cec5a2dd4f8797098bbff7094259 (127.17.255.1:43215): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e0489050887543798a33d0d801523d15: Network error: Client connection negotiation failed: client connection to 127.17.255.1:43215: connect: Connection reset by peer (error 104)
I20260812 17:43:21.314548 30776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:21.314098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:35191 (local address 127.0.0.1:45974)
0812 17:43:21.314304 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:21.314361 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.2:35191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
I20260812 17:43:21.315575 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 30350
I20260812 17:43:21.332783 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 29243
I20260812 17:43:21.360613 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 29416
2026-08-12T17:43:21Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (7745 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:43:21 dist-test-slave-tk9z krb5kdc[30840](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:43:21 dist-test-slave-tk9z krb5kdc[30840](info): set up 2 sockets
Aug 12 17:43:21 dist-test-slave-tk9z krb5kdc[30840](info): commencing operation
krb5kdc: starting...
W20260812 17:43:22.684213 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.283s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:43:22 dist-test-slave-tk9z krb5kdc[30840](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556602, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:43:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:43:22Z Disabled control of system clock
WARNING: no policy specified for oryx/127.17.255.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.255.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.255.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.62.keytab.
Entry for principal oryx/127.17.255.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.62.keytab.
I20260812 17:43:22.821508 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:41677
--webserver_interface=127.17.255.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.62.keytab
--principal=oryx/127.17.255.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:43473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:41677
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:43:22.956694 30858 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:22.957034 30858 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:22.957139 30858 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:22.961359 30858 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:43:22.961452 30858 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 17:43:22.961483 30858 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:22.961541 30858 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:22.961596 30858 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:43:22.961635 30858 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:43:22.967314 30858 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:43473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:41677
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.62.keytab
--principal=oryx/127.17.255.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:41677
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30858
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:22.968556 30858 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:22.969715 30858 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:22.979549 30874 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:22.979636 30858 server_base.cc:1034] running on GCE node
W20260812 17:43:22.979569 30870 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:22.979557 30871 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:22.980461 30858 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:22.981618 30858 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:22.982813 30858 hybrid_clock.cc:648] HybridClock initialized: now 1786556602982774 us; error 52 us; skew 500 ppm
Aug 12 17:43:22 dist-test-slave-tk9z krb5kdc[30840](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556602, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.255.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:22.985788 30858 init.cc:377] Logged in from keytab as oryx/127.17.255.62@KRBTEST.COM (short username oryx)
I20260812 17:43:22.986830 30858 webserver.cc:460] Webserver started at http://127.17.255.62:40367/ using document root <none> and password file <none>
I20260812 17:43:22.987434 30858 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:22.987499 30858 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:22.987773 30858 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:22.989934 30858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "e1909aaadb58413f8fba81c9ca9d8f36"
format_stamp: "Formatted at 2026-08-12 17:43:22 on dist-test-slave-tk9z"
server_key: "b54acf8e787523059fd7d296f460e997"
server_key_iv: "846c612ffb7edfecd49e5d86afd3b7e3"
server_key_version: "encryptionkey@0"
I20260812 17:43:22.990614 30858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "e1909aaadb58413f8fba81c9ca9d8f36"
format_stamp: "Formatted at 2026-08-12 17:43:22 on dist-test-slave-tk9z"
server_key: "b54acf8e787523059fd7d296f460e997"
server_key_iv: "846c612ffb7edfecd49e5d86afd3b7e3"
server_key_version: "encryptionkey@0"
I20260812 17:43:22.994583 30858 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 17:43:22.997129 30884 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:22.998740 30858 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:43:22.998899 30858 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "e1909aaadb58413f8fba81c9ca9d8f36"
format_stamp: "Formatted at 2026-08-12 17:43:22 on dist-test-slave-tk9z"
server_key: "b54acf8e787523059fd7d296f460e997"
server_key_iv: "846c612ffb7edfecd49e5d86afd3b7e3"
server_key_version: "encryptionkey@0"
I20260812 17:43:22.999032 30858 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:23.031692 30858 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:23.035499 30858 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:23.035755 30858 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:23.044691 30858 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:41677
I20260812 17:43:23.044705 31001 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:41677 every 8 connection(s)
I20260812 17:43:23.045742 30858 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:43:23.048787 31003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:23.050812 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 30858
I20260812 17:43:23.050953 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:43:23.051280 18428 external_mini_cluster.cc:1428] Setting key 9f60e5a4525f092fb5fdf8bcde4ac3bd
I20260812 17:43:23.055965 31003 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1909aaadb58413f8fba81c9ca9d8f36: Bootstrap starting.
I20260812 17:43:23.058833 31003 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e1909aaadb58413f8fba81c9ca9d8f36: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:23.059810 31003 log.cc:824] T 00000000000000000000000000000000 P e1909aaadb58413f8fba81c9ca9d8f36: Log is configured to *not* fsync() on all Append() calls
Aug 12 17:43:23 dist-test-slave-tk9z krb5kdc[30840](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556602, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM
I20260812 17:43:23.062191 31003 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1909aaadb58413f8fba81c9ca9d8f36: No bootstrap required, opened a new log
I20260812 17:43:23.066505 31003 raft_consensus.cc:348] T 00000000000000000000000000000000 P e1909aaadb58413f8fba81c9ca9d8f36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1909aaadb58413f8fba81c9ca9d8f36" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 41677 } }
I20260812 17:43:23.066794 31003 raft_consensus.cc:374] T 00000000000000000000000000000000 P e1909aaadb58413f8fba81c9ca9d8f36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:23.066891 31003 raft_consensus.cc:729] T 00000000000000000000000000000000 P e1909aaadb58413f8fba81c9ca9d8f36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1909aaadb58413f8fba81c9ca9d8f36, State: Initialized, Role: FOLLOWER
I20260812 17:43:23.067325 31007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:23.052851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50812 (local address 127.17.255.62:41677)
0812 17:43:23.053312 (+ 461us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:23.053329 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:23.053374 (+ 45us) server_negotiation.cc:407] Connection header received
0812 17:43:23.054020 (+ 646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:23.054038 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:23.054454 (+ 416us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:23.054758 (+ 304us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:23.055690 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:23.056762 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:23.057975 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:23.058498 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:23.058617 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:23.061787 (+ 3170us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:23.061792 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:23.061806 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:23.061834 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:23.063699 (+ 1865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:23.064294 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:23.064301 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:23.064307 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:23.064446 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:23.064814 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:23.064817 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:23.064819 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:23.065313 (+ 494us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:23.065498 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:23.065872 (+ 374us) server_negotiation.cc:299] Negotiation successful
0812 17:43:23.066254 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":145,"threads_started":1}
I20260812 17:43:23.067396 31003 consensus_queue.cc:260] T 00000000000000000000000000000000 P e1909aaadb58413f8fba81c9ca9d8f36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1909aaadb58413f8fba81c9ca9d8f36" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 41677 } }
I20260812 17:43:23.067610 31003 raft_consensus.cc:388] T 00000000000000000000000000000000 P e1909aaadb58413f8fba81c9ca9d8f36 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:43:23.067689 31003 raft_consensus.cc:482] T 00000000000000000000000000000000 P e1909aaadb58413f8fba81c9ca9d8f36 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:43:23.067790 31003 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e1909aaadb58413f8fba81c9ca9d8f36 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:23.068944 31003 raft_consensus.cc:504] T 00000000000000000000000000000000 P e1909aaadb58413f8fba81c9ca9d8f36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1909aaadb58413f8fba81c9ca9d8f36" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 41677 } }
I20260812 17:43:23.069311 31003 leader_election.cc:302] T 00000000000000000000000000000000 P e1909aaadb58413f8fba81c9ca9d8f36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e1909aaadb58413f8fba81c9ca9d8f36; no voters:
I20260812 17:43:23.069667 31003 leader_election.cc:288] T 00000000000000000000000000000000 P e1909aaadb58413f8fba81c9ca9d8f36 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:43:23.069790 31010 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e1909aaadb58413f8fba81c9ca9d8f36 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:43:23.070065 31010 raft_consensus.cc:686] T 00000000000000000000000000000000 P e1909aaadb58413f8fba81c9ca9d8f36 [term 1 LEADER]: Becoming Leader. State: Replica: e1909aaadb58413f8fba81c9ca9d8f36, State: Running, Role: LEADER
I20260812 17:43:23.070487 31010 consensus_queue.cc:237] T 00000000000000000000000000000000 P e1909aaadb58413f8fba81c9ca9d8f36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1909aaadb58413f8fba81c9ca9d8f36" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 41677 } }
I20260812 17:43:23.071038 31003 sys_catalog.cc:564] T 00000000000000000000000000000000 P e1909aaadb58413f8fba81c9ca9d8f36 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:43:23.072221 31011 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1909aaadb58413f8fba81c9ca9d8f36 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e1909aaadb58413f8fba81c9ca9d8f36" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1909aaadb58413f8fba81c9ca9d8f36" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 41677 } } }
I20260812 17:43:23.072359 31011 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1909aaadb58413f8fba81c9ca9d8f36 [sys.catalog]: This master's current role is: LEADER
I20260812 17:43:23.072780 31028 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:43:23.072748 31012 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1909aaadb58413f8fba81c9ca9d8f36 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e1909aaadb58413f8fba81c9ca9d8f36. Latest consensus state: current_term: 1 leader_uuid: "e1909aaadb58413f8fba81c9ca9d8f36" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1909aaadb58413f8fba81c9ca9d8f36" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 41677 } } }
I20260812 17:43:23.072904 31012 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1909aaadb58413f8fba81c9ca9d8f36 [sys.catalog]: This master's current role is: LEADER
I20260812 17:43:23.076792 31028 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:43:23.082441 31028 catalog_manager.cc:1347] Generated new cluster ID: 71a39124296a4183b1fe97d2ade9399d
I20260812 17:43:23.082528 31028 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:43:23.095170 31028 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:43:23.096266 31028 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:43:23.104554 31028 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e1909aaadb58413f8fba81c9ca9d8f36: Generated new TSK 0
I20260812 17:43:23.105396 31028 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.17.255.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.255.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.255.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.1.keytab.
Entry for principal oryx/127.17.255.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.1.keytab.
I20260812 17:43:23.137669 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.1:0
--local_ip_for_outbound_sockets=127.17.255.1
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:41677
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.1.keytab
--principal=oryx/127.17.255.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:43473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:43:23.255228 31044 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:23.255532 31044 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:23.255612 31044 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:23.259622 31044 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:23.259701 31044 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:23.259769 31044 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 17:43:23.259855 31044 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.1
I20260812 17:43:23.264981 31044 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:43473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.1.keytab
--principal=oryx/127.17.255.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.255.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.255.62:41677
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31044
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.1
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:23.266099 31044 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:23.267226 31044 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:23.277078 31055 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:23.277100 31056 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:23.277241 31044 server_base.cc:1034] running on GCE node
W20260812 17:43:23.277081 31058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:23.277863 31044 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:23.278644 31044 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:23.279836 31044 hybrid_clock.cc:648] HybridClock initialized: now 1786556603279797 us; error 50 us; skew 500 ppm
Aug 12 17:43:23 dist-test-slave-tk9z krb5kdc[30840](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556603, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.255.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:23.282765 31044 init.cc:377] Logged in from keytab as oryx/127.17.255.1@KRBTEST.COM (short username oryx)
I20260812 17:43:23.283700 31044 webserver.cc:460] Webserver started at http://127.17.255.1:46349/ using document root <none> and password file <none>
I20260812 17:43:23.284293 31044 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:23.284355 31044 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:23.284653 31044 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:23.286839 31044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-0/data/instance:
uuid: "31ff7ae726e34549b561cfb734322abb"
format_stamp: "Formatted at 2026-08-12 17:43:23 on dist-test-slave-tk9z"
server_key: "53c3ac77f327d6baa476f3d714ef8235"
server_key_iv: "14c133e9026f15c8ab6f132313ba49ee"
server_key_version: "encryptionkey@0"
I20260812 17:43:23.287426 31044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance:
uuid: "31ff7ae726e34549b561cfb734322abb"
format_stamp: "Formatted at 2026-08-12 17:43:23 on dist-test-slave-tk9z"
server_key: "53c3ac77f327d6baa476f3d714ef8235"
server_key_iv: "14c133e9026f15c8ab6f132313ba49ee"
server_key_version: "encryptionkey@0"
I20260812 17:43:23.291366 31044 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 17:43:23.293889 31072 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:23.295320 31044 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 17:43:23.295475 31044 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-0/wal
uuid: "31ff7ae726e34549b561cfb734322abb"
format_stamp: "Formatted at 2026-08-12 17:43:23 on dist-test-slave-tk9z"
server_key: "53c3ac77f327d6baa476f3d714ef8235"
server_key_iv: "14c133e9026f15c8ab6f132313ba49ee"
server_key_version: "encryptionkey@0"
I20260812 17:43:23.295601 31044 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:23.310091 31044 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:23.313321 31044 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:23.313539 31044 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:23.316159 31044 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:43:23.316217 31044 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:23.316260 31044 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:43:23.316313 31044 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 17:43:23 dist-test-slave-tk9z krb5kdc[30840](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556603, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.255.1@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM
I20260812 17:43:23.326850 31044 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.1:34119
I20260812 17:43:23.326938 31270 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.1:34119 every 8 connection(s)
I20260812 17:43:23.328017 31044 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
I20260812 17:43:23.330338 31007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:23.315905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:55351 (local address 127.17.255.62:41677)
0812 17:43:23.316051 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:23.316056 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:23.317153 (+ 1097us) server_negotiation.cc:407] Connection header received
0812 17:43:23.318139 (+ 986us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:23.318142 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:23.318206 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:23.318323 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:23.319950 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:23.320875 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:23.322702 (+ 1827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:23.323128 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:23.323258 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:23.326683 (+ 3425us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:23.326687 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:23.326690 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:23.326723 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:23.328260 (+ 1537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:23.328876 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:23.328879 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:23.328881 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:23.328983 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:23.329326 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:23.329329 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:23.329330 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:23.329527 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:23.329604 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:23.330090 (+ 486us) server_negotiation.cc:299] Negotiation successful
0812 17:43:23.330203 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 17:43:23.331154 31094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:23.316430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:41677 (local address 127.17.255.1:55351)
0812 17:43:23.316959 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:23.317020 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:23.317905 (+ 885us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:23.318542 (+ 637us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:23.318549 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:23.319049 (+ 500us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:23.319778 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:23.319801 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:23.321038 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:23.321042 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:23.322589 (+ 1547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:23.322600 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:23.323311 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:23.323316 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:23.323549 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:23.324805 (+ 1256us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:23.324822 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:23.326505 (+ 1683us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:23.328374 (+ 1869us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:23.328380 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:23.328394 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:23.328773 (+ 379us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:23.329086 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:23.329088 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:23.329090 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:23.329227 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:23.329620 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:23.329626 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:23.329855 (+ 229us) client_negotiation.cc:769] Sending connection context
0812 17:43:23.330026 (+ 171us) client_negotiation.cc:240] Negotiation successful
0812 17:43:23.330297 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":148,"threads_started":1}
I20260812 17:43:23.332603 31271 heartbeater.cc:347] Connected to a master server at 127.17.255.62:41677
I20260812 17:43:23.332828 31271 heartbeater.cc:464] Registering TS with master...
I20260812 17:43:23.333405 31271 heartbeater.cc:511] Master 127.17.255.62:41677 requested a full tablet report, sending...
I20260812 17:43:23.335126 30913 ts_manager.cc:194] Registered new tserver with Master: 31ff7ae726e34549b561cfb734322abb (127.17.255.1:34119)
I20260812 17:43:23.335582 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 31044
I20260812 17:43:23.335721 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance
I20260812 17:43:23.336017 18428 external_mini_cluster.cc:1428] Setting key 79e9865dd90dfc908e5cd9fd3ec5a81f
I20260812 17:43:23.336700 30913 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.255.1@KRBTEST.COM'} at 127.17.255.1:55351
I20260812 17:43:23.342818 31007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:23.335153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:58935 (local address 127.17.255.62:41677)
0812 17:43:23.335307 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:23.335313 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:23.335453 (+ 140us) server_negotiation.cc:407] Connection header received
0812 17:43:23.335561 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:23.335564 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:23.335634 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:23.335730 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:23.336263 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:23.336913 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:23.337935 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:23.338153 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:23.338264 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:23.339507 (+ 1243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:23.339511 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:23.339513 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:23.339538 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:23.341055 (+ 1517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:23.341525 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:23.341528 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:23.341530 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:23.341617 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:23.341926 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:23.341929 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:23.341931 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:23.342122 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:23.342231 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:23.342536 (+ 305us) server_negotiation.cc:299] Negotiation successful
0812 17:43:23.342651 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 17:43:23.342833 31281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:23.335004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:41677 (local address 127.17.255.1:58935)
0812 17:43:23.335351 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:23.335366 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:23.335475 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:23.335772 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:23.335775 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:23.336002 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:23.336125 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:23.336133 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:23.337045 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:23.337048 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:23.337810 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:23.337820 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:23.338268 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:23.338271 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:23.338363 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:23.338992 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:23.339005 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:23.339354 (+ 349us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:23.341185 (+ 1831us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:23.341190 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:23.341193 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:23.341417 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:23.341719 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:23.341722 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:23.341724 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:23.341830 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:23.342222 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:23.342225 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:23.342331 (+ 106us) client_negotiation.cc:769] Sending connection context
0812 17:43:23.342467 (+ 136us) client_negotiation.cc:240] Negotiation successful
0812 17:43:23.342623 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"mutex_wait_us":10,"thread_start_us":108,"threads_started":1}
WARNING: no policy specified for oryx/127.17.255.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.255.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.255.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.2.keytab.
Entry for principal oryx/127.17.255.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.2.keytab.
I20260812 17:43:23.370224 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.2:0
--local_ip_for_outbound_sockets=127.17.255.2
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:41677
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.2.keytab
--principal=oryx/127.17.255.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:43473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:43:23.488937 31284 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:23.489208 31284 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:23.489253 31284 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:23.493317 31284 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:23.493388 31284 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:23.493434 31284 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 17:43:23.493467 31284 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.2
I20260812 17:43:23.499018 31284 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:43473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.2.keytab
--principal=oryx/127.17.255.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.255.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.255.62:41677
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31284
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.2
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:23.500181 31284 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:23.501210 31284 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:23.511525 31295 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:23.511545 31303 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:23.511525 31293 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:23.511821 31284 server_base.cc:1034] running on GCE node
I20260812 17:43:23.512442 31284 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:23.513136 31284 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:23.514329 31284 hybrid_clock.cc:648] HybridClock initialized: now 1786556603514304 us; error 33 us; skew 500 ppm
Aug 12 17:43:23 dist-test-slave-tk9z krb5kdc[30840](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556603, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.255.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:23.517467 31284 init.cc:377] Logged in from keytab as oryx/127.17.255.2@KRBTEST.COM (short username oryx)
I20260812 17:43:23.518641 31284 webserver.cc:460] Webserver started at http://127.17.255.2:35341/ using document root <none> and password file <none>
I20260812 17:43:23.519423 31284 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:23.519531 31284 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:23.519812 31284 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:23.522224 31284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-1/data/instance:
uuid: "89fc3d55f1b0460f9c19d623174d7a9b"
format_stamp: "Formatted at 2026-08-12 17:43:23 on dist-test-slave-tk9z"
server_key: "d9c86c9acdfbb13336615f6c06669ff0"
server_key_iv: "ce2dc36c1894a4546f87ad04d853d6b2"
server_key_version: "encryptionkey@0"
I20260812 17:43:23.523000 31284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance:
uuid: "89fc3d55f1b0460f9c19d623174d7a9b"
format_stamp: "Formatted at 2026-08-12 17:43:23 on dist-test-slave-tk9z"
server_key: "d9c86c9acdfbb13336615f6c06669ff0"
server_key_iv: "ce2dc36c1894a4546f87ad04d853d6b2"
server_key_version: "encryptionkey@0"
I20260812 17:43:23.527318 31284 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 17:43:23.530023 31315 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:23.531447 31284 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:43:23.531598 31284 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-1/wal
uuid: "89fc3d55f1b0460f9c19d623174d7a9b"
format_stamp: "Formatted at 2026-08-12 17:43:23 on dist-test-slave-tk9z"
server_key: "d9c86c9acdfbb13336615f6c06669ff0"
server_key_iv: "ce2dc36c1894a4546f87ad04d853d6b2"
server_key_version: "encryptionkey@0"
I20260812 17:43:23.531723 31284 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:23.558560 31284 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:23.562036 31284 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:23.562256 31284 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:23.563892 31284 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:43:23.563978 31284 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:23.564054 31284 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:43:23.564105 31284 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 17:43:23 dist-test-slave-tk9z krb5kdc[30840](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556603, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.255.2@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM
I20260812 17:43:23.576155 31284 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.2:44971
I20260812 17:43:23.576562 31516 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.2:44971 every 8 connection(s)
I20260812 17:43:23.577243 31284 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
I20260812 17:43:23.578648 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 31284
I20260812 17:43:23.578787 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance
I20260812 17:43:23.579141 18428 external_mini_cluster.cc:1428] Setting key f3e246b0e7d19b191c4b75462c4cb5da
I20260812 17:43:23.579988 31007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:23.564744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:53377 (local address 127.17.255.62:41677)
0812 17:43:23.564932 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:23.564938 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:23.565855 (+ 917us) server_negotiation.cc:407] Connection header received
0812 17:43:23.567060 (+ 1205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:23.567064 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:23.567136 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:23.567188 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:23.568872 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:23.569891 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:23.571377 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:23.571732 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:23.571842 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:23.575484 (+ 3642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:23.575492 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:23.575499 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:23.575535 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:23.577226 (+ 1691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:23.577927 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:23.577933 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:23.577938 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:23.578054 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:23.578580 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:23.578585 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:23.578588 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:23.578881 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:23.579009 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:23.579655 (+ 646us) server_negotiation.cc:299] Negotiation successful
0812 17:43:23.579805 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 17:43:23.580991 31329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:23.565157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:41677 (local address 127.17.255.2:53377)
0812 17:43:23.565675 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:23.565728 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:23.566764 (+ 1036us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:23.567541 (+ 777us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:23.567548 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:23.568037 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:23.568675 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:23.568700 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:23.570055 (+ 1355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:23.570058 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:23.571244 (+ 1186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:23.571260 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:23.572076 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:23.572084 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:23.572394 (+ 310us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:23.573120 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:23.573143 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:23.575217 (+ 2074us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:23.577363 (+ 2146us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:23.577369 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:23.577386 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:23.577777 (+ 391us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:23.578173 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:23.578176 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:23.578178 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:23.578441 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:23.579026 (+ 585us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:23.579033 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:23.579363 (+ 330us) client_negotiation.cc:769] Sending connection context
0812 17:43:23.579584 (+ 221us) client_negotiation.cc:240] Negotiation successful
0812 17:43:23.579957 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":139,"threads_started":1}
I20260812 17:43:23.582444 31517 heartbeater.cc:347] Connected to a master server at 127.17.255.62:41677
I20260812 17:43:23.582630 31517 heartbeater.cc:464] Registering TS with master...
I20260812 17:43:23.583156 31517 heartbeater.cc:511] Master 127.17.255.62:41677 requested a full tablet report, sending...
I20260812 17:43:23.584300 30913 ts_manager.cc:194] Registered new tserver with Master: 89fc3d55f1b0460f9c19d623174d7a9b (127.17.255.2:44971)
I20260812 17:43:23.585160 30913 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.255.2@KRBTEST.COM'} at 127.17.255.2:53377
WARNING: no policy specified for oryx/127.17.255.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.255.3@KRBTEST.COM" created.
I20260812 17:43:23.595656 31534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:23.584913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:41677 (local address 127.17.255.2:52307)
0812 17:43:23.587852 (+ 2939us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:23.587865 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:23.588036 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:23.588327 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:23.588330 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:23.588560 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:23.588684 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:23.588690 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:23.589626 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:23.589630 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:23.590284 (+ 654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:23.590293 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:23.590793 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:23.590796 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:23.590905 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:23.591478 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:23.591491 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:23.591838 (+ 347us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:23.593901 (+ 2063us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:23.593905 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:23.593908 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:23.594110 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:23.594493 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:23.594500 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:23.594505 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:23.594625 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:23.595096 (+ 471us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:23.595103 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:23.595238 (+ 135us) client_negotiation.cc:769] Sending connection context
0812 17:43:23.595368 (+ 130us) client_negotiation.cc:240] Negotiation successful
0812 17:43:23.595495 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2850,"thread_start_us":115,"threads_started":1}
I20260812 17:43:23.595820 31007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:23.584957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:52307 (local address 127.17.255.62:41677)
0812 17:43:23.585083 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:23.585087 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:23.587978 (+ 2891us) server_negotiation.cc:407] Connection header received
0812 17:43:23.588157 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:23.588160 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:23.588212 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:23.588304 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:23.588820 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:23.589472 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:23.590442 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:23.590667 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:23.590783 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:23.591988 (+ 1205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:23.591991 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:23.591994 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:23.592027 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:23.593786 (+ 1759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:23.594221 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:23.594224 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:23.594227 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:23.594309 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:23.594739 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:23.594742 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:23.594743 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:23.594985 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:23.595105 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:23.595466 (+ 361us) server_negotiation.cc:299] Negotiation successful
0812 17:43:23.595611 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.255.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.3.keytab.
Entry for principal oryx/127.17.255.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.3.keytab.
I20260812 17:43:23.614990 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.3:0
--local_ip_for_outbound_sockets=127.17.255.3
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:41677
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.3.keytab
--principal=oryx/127.17.255.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:43473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:43:23.740106 31537 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:23.740406 31537 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:23.740454 31537 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:23.744815 31537 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:23.744895 31537 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:23.744937 31537 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 17:43:23.744976 31537 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.3
I20260812 17:43:23.750435 31537 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:43473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.3.keytab
--principal=oryx/127.17.255.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.255.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.255.62:41677
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31537
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.3
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:23.751598 31537 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:23.752755 31537 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:23.763007 31554 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:23.763031 31552 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:23.763015 31549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:23.763095 31537 server_base.cc:1034] running on GCE node
I20260812 17:43:23.763697 31537 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:23.764345 31537 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:23.765542 31537 hybrid_clock.cc:648] HybridClock initialized: now 1786556603765465 us; error 86 us; skew 500 ppm
Aug 12 17:43:23 dist-test-slave-tk9z krb5kdc[30840](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556603, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.255.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:23.768648 31537 init.cc:377] Logged in from keytab as oryx/127.17.255.3@KRBTEST.COM (short username oryx)
I20260812 17:43:23.769737 31537 webserver.cc:460] Webserver started at http://127.17.255.3:36895/ using document root <none> and password file <none>
I20260812 17:43:23.770447 31537 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:23.770522 31537 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:23.770824 31537 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:23.773093 31537 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-2/data/instance:
uuid: "c41d3008007e49d6b3870288bd94d238"
format_stamp: "Formatted at 2026-08-12 17:43:23 on dist-test-slave-tk9z"
server_key: "56a9554060cb096344b0c6ade9e036bb"
server_key_iv: "8000abcc42f1cd058d9cea4ad88fc834"
server_key_version: "encryptionkey@0"
I20260812 17:43:23.773656 31537 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance:
uuid: "c41d3008007e49d6b3870288bd94d238"
format_stamp: "Formatted at 2026-08-12 17:43:23 on dist-test-slave-tk9z"
server_key: "56a9554060cb096344b0c6ade9e036bb"
server_key_iv: "8000abcc42f1cd058d9cea4ad88fc834"
server_key_version: "encryptionkey@0"
I20260812 17:43:23.777729 31537 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.001s
I20260812 17:43:23.780505 31562 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:23.781895 31537 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 17:43:23.782055 31537 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-2/wal
uuid: "c41d3008007e49d6b3870288bd94d238"
format_stamp: "Formatted at 2026-08-12 17:43:23 on dist-test-slave-tk9z"
server_key: "56a9554060cb096344b0c6ade9e036bb"
server_key_iv: "8000abcc42f1cd058d9cea4ad88fc834"
server_key_version: "encryptionkey@0"
I20260812 17:43:23.782186 31537 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:23.792145 31537 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:23.795281 31537 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:23.795492 31537 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:23.797027 31537 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:43:23.797101 31537 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:23.797168 31537 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:43:23.797201 31537 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 17:43:23 dist-test-slave-tk9z krb5kdc[30840](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556603, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.255.3@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM
I20260812 17:43:23.809391 31537 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.3:46087
I20260812 17:43:23.809476 31761 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.3:46087 every 8 connection(s)
I20260812 17:43:23.810532 31537 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
I20260812 17:43:23.812206 31007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:23.797713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:35903 (local address 127.17.255.62:41677)
0812 17:43:23.797878 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:23.797885 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:23.798812 (+ 927us) server_negotiation.cc:407] Connection header received
0812 17:43:23.799900 (+ 1088us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:23.799904 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:23.799972 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:23.800081 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:23.801538 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:23.802418 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:23.803981 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:23.804205 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:23.804321 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:23.807918 (+ 3597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:23.807923 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:23.807926 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:23.807963 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:23.809822 (+ 1859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:23.810436 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:23.810440 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:23.810443 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:23.810546 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:23.810955 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:23.810959 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:23.810961 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:23.811215 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:23.811342 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:23.811932 (+ 590us) server_negotiation.cc:299] Negotiation successful
0812 17:43:23.812067 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 17:43:23.813120 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 31537
I20260812 17:43:23.813153 31581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:23.798135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:41677 (local address 127.17.255.3:35903)
0812 17:43:23.798648 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:23.798700 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:23.799591 (+ 891us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:23.800293 (+ 702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:23.800301 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:23.800840 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:23.801381 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:23.801395 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:23.802546 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:23.802554 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:23.803834 (+ 1280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:23.803845 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:23.804376 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:23.804380 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:23.804574 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:23.805231 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:23.805257 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:23.807678 (+ 2421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:23.809955 (+ 2277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:23.809961 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:23.809977 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:23.810281 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:23.810661 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:23.810665 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:23.810668 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:23.810836 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:23.811409 (+ 573us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:23.811414 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:23.811663 (+ 249us) client_negotiation.cc:769] Sending connection context
0812 17:43:23.811829 (+ 166us) client_negotiation.cc:240] Negotiation successful
0812 17:43:23.812100 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":137,"threads_started":1}
I20260812 17:43:23.813287 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance
I20260812 17:43:23.813650 18428 external_mini_cluster.cc:1428] Setting key 7c837f6a4ae123496e9aec87c3ca1c91
I20260812 17:43:23.815392 31764 heartbeater.cc:347] Connected to a master server at 127.17.255.62:41677
I20260812 17:43:23.815588 31764 heartbeater.cc:464] Registering TS with master...
I20260812 17:43:23.816529 31764 heartbeater.cc:511] Master 127.17.255.62:41677 requested a full tablet report, sending...
I20260812 17:43:23.817607 30910 ts_manager.cc:194] Registered new tserver with Master: c41d3008007e49d6b3870288bd94d238 (127.17.255.3:46087)
I20260812 17:43:23.818594 30910 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.255.3@KRBTEST.COM'} at 127.17.255.3:35903
I20260812 17:43:23.825392 31776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:23.817692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:41677 (local address 127.17.255.3:41153)
0812 17:43:23.818024 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:23.818041 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:23.818147 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:23.818469 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:23.818472 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:23.818718 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:23.818854 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:23.818866 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:23.819972 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:23.819976 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:23.820608 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:23.820617 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:23.821125 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:23.821128 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:23.821207 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:23.821703 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:23.821715 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:23.822071 (+ 356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:23.824031 (+ 1960us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:23.824034 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:23.824036 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:23.824231 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:23.824511 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:23.824513 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:23.824514 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:23.824591 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:23.824983 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:23.824985 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:23.825060 (+ 75us) client_negotiation.cc:769] Sending connection context
0812 17:43:23.825139 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 17:43:23.825244 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":111,"threads_started":1}
I20260812 17:43:23.825405 31007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:23.817787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:41153 (local address 127.17.255.62:41677)
0812 17:43:23.817916 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:23.817920 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:23.818101 (+ 181us) server_negotiation.cc:407] Connection header received
0812 17:43:23.818247 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:23.818249 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:23.818286 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:23.818356 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:23.819000 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:23.819804 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:23.820747 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:23.821000 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:23.821090 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:23.822212 (+ 1122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:23.822215 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:23.822218 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:23.822242 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:23.823904 (+ 1662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:23.824322 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:23.824325 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:23.824327 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:23.824406 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:23.824699 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:23.824702 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:23.824703 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:23.824882 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:23.824982 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:23.825205 (+ 223us) server_negotiation.cc:299] Negotiation successful
0812 17:43:23.825298 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 17:43:23.827973 18428 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 17:43:23 dist-test-slave-tk9z krb5kdc[30840](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556603, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 17:43:23 dist-test-slave-tk9z krb5kdc[30840](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:23 dist-test-slave-tk9z krb5kdc[30840](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
W20260812 17:43:23.855278 31007 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:23.847667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50820 (local address 127.17.255.62:41677)
0812 17:43:23.847861 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:23.847866 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:23.847881 (+ 15us) server_negotiation.cc:407] Connection header received
0812 17:43:23.847931 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:23.847934 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:23.847976 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:23.848061 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:23.849060 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:23.849642 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:23.850733 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:23.850969 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:23.851074 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:23.855054 (+ 3980us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50820: BlockingRecv error: recv got EOF from 127.0.0.1:50820 (error 108)
Metrics: {"server-negotiator.queue_time_us":95}
Aug 12 17:43:23 dist-test-slave-tk9z krb5kdc[30840](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556603, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM
I20260812 17:43:23.867036 31007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:23.857292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50826 (local address 127.17.255.62:41677)
0812 17:43:23.857482 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:23.857486 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:23.857609 (+ 123us) server_negotiation.cc:407] Connection header received
0812 17:43:23.857675 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:23.857677 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:23.857733 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:23.857814 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:23.858744 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:23.859375 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:23.860550 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:23.860804 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:23.860930 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:23.863672 (+ 2742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:23.863676 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:23.863678 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:23.863711 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:23.865165 (+ 1454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:23.865681 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:23.865689 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:23.865691 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:23.865778 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:23.866079 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:23.866083 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:23.866085 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:23.866300 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:23.866474 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:23.866729 (+ 255us) server_negotiation.cc:299] Negotiation successful
0812 17:43:23.866857 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260812 17:43:23.870240 30910 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50826:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 17:43:23.874571 30910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 17:43:23.891309 31797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:23.884452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.3:46087 (local address 127.0.0.1:35362)
0812 17:43:23.884877 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:23.884942 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:23.885093 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:23.886717 (+ 1624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:23.886723 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:23.886755 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:43:23.886942 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:23.886950 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:23.888324 (+ 1374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:23.888327 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:23.889838 (+ 1511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:23.889849 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:23.890742 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:23.890745 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:23.890853 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:23.890894 (+ 41us) client_negotiation.cc:769] Sending connection context
0812 17:43:23.891009 (+ 115us) client_negotiation.cc:240] Negotiation successful
0812 17:43:23.891133 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"mutex_wait_us":156,"spinlock_wait_cycles":9088,"thread_start_us":123,"threads_started":1}
I20260812 17:43:23.891369 31795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:23.884505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:44971 (local address 127.0.0.1:43338)
0812 17:43:23.884877 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:23.884942 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:23.885093 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:23.887499 (+ 2406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:23.887502 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:23.887522 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:43:23.887619 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:23.887625 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:23.888809 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:23.888813 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:23.889888 (+ 1075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:23.889897 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:23.891017 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:23.891021 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:23.891112 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:23.891133 (+ 21us) client_negotiation.cc:769] Sending connection context
0812 17:43:23.891200 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 17:43:23.891254 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":218,"mutex_wait_us":65,"spinlock_wait_cycles":7552,"thread_start_us":76,"threads_started":1}
I20260812 17:43:23.891789 31800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:23.885469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43338 (local address 127.17.255.2:44971)
0812 17:43:23.887066 (+ 1597us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:23.887078 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:23.887098 (+ 20us) server_negotiation.cc:407] Connection header received
0812 17:43:23.887172 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:23.887176 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:23.887346 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:23.887493 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:43:23.887751 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:23.888652 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:23.890014 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:23.890859 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:23.891007 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:23.891145 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:23.891232 (+ 87us) server_negotiation.cc:299] Negotiation successful
0812 17:43:23.891323 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1478,"thread_start_us":129,"threads_started":1}
I20260812 17:43:23.891774 31798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:23.885251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:34119 (local address 127.0.0.1:33296)
0812 17:43:23.885522 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:23.885537 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:23.885637 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:23.886717 (+ 1080us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:23.886723 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:23.886765 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:43:23.886935 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:23.886941 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:23.888155 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:23.888160 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:23.889841 (+ 1681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:23.889849 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:23.891198 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:23.891202 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:23.891291 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:23.891315 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 17:43:23.891561 (+ 246us) client_negotiation.cc:240] Negotiation successful
0812 17:43:23.891639 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"mutex_wait_us":162,"spinlock_wait_cycles":18816,"thread_start_us":108,"threads_started":1}
I20260812 17:43:23.891917 31801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:23.885487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35362 (local address 127.17.255.3:46087)
0812 17:43:23.886103 (+ 616us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:23.886113 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:23.886134 (+ 21us) server_negotiation.cc:407] Connection header received
0812 17:43:23.886232 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:23.886237 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:23.886484 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:23.886662 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:43:23.887082 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:23.888207 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:23.889977 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:23.890615 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:23.890741 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:23.890917 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:23.891701 (+ 784us) server_negotiation.cc:299] Negotiation successful
0812 17:43:23.891777 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":528,"thread_start_us":148,"threads_started":1}
I20260812 17:43:23.892599 31802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:23.885702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33296 (local address 127.17.255.1:34119)
0812 17:43:23.886191 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:23.886199 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:23.886221 (+ 22us) server_negotiation.cc:407] Connection header received
0812 17:43:23.886296 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:23.886299 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:23.886570 (+ 271us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:23.886723 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:43:23.887058 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:23.888041 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:23.889992 (+ 1951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:23.890859 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:23.890983 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:23.891128 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:23.892354 (+ 1226us) server_negotiation.cc:299] Negotiation successful
0812 17:43:23.892463 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":379,"thread_start_us":100,"threads_started":1}
I20260812 17:43:23.894733 31649 tablet_service.cc:1467] Processing CreateTablet for tablet d5944153a70348139bca525ec9fb08db (DEFAULT_TABLE table=test-table [id=69a5fb7cf1144a2fb21b9e9fc7eb1084]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:43:23.894816 31403 tablet_service.cc:1467] Processing CreateTablet for tablet d5944153a70348139bca525ec9fb08db (DEFAULT_TABLE table=test-table [id=69a5fb7cf1144a2fb21b9e9fc7eb1084]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:43:23.895305 31162 tablet_service.cc:1467] Processing CreateTablet for tablet d5944153a70348139bca525ec9fb08db (DEFAULT_TABLE table=test-table [id=69a5fb7cf1144a2fb21b9e9fc7eb1084]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:43:23.895828 31649 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5944153a70348139bca525ec9fb08db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:23.895869 31403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5944153a70348139bca525ec9fb08db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:23.896240 31162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5944153a70348139bca525ec9fb08db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:23.902828 31803 tablet_bootstrap.cc:492] T d5944153a70348139bca525ec9fb08db P c41d3008007e49d6b3870288bd94d238: Bootstrap starting.
I20260812 17:43:23.904374 31805 tablet_bootstrap.cc:492] T d5944153a70348139bca525ec9fb08db P 31ff7ae726e34549b561cfb734322abb: Bootstrap starting.
I20260812 17:43:23.905583 31803 tablet_bootstrap.cc:654] T d5944153a70348139bca525ec9fb08db P c41d3008007e49d6b3870288bd94d238: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:23.906143 31805 tablet_bootstrap.cc:654] T d5944153a70348139bca525ec9fb08db P 31ff7ae726e34549b561cfb734322abb: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:23.906430 31803 log.cc:824] T d5944153a70348139bca525ec9fb08db P c41d3008007e49d6b3870288bd94d238: Log is configured to *not* fsync() on all Append() calls
I20260812 17:43:23.906737 31804 tablet_bootstrap.cc:492] T d5944153a70348139bca525ec9fb08db P 89fc3d55f1b0460f9c19d623174d7a9b: Bootstrap starting.
I20260812 17:43:23.907047 31805 log.cc:824] T d5944153a70348139bca525ec9fb08db P 31ff7ae726e34549b561cfb734322abb: Log is configured to *not* fsync() on all Append() calls
I20260812 17:43:23.908804 31803 tablet_bootstrap.cc:492] T d5944153a70348139bca525ec9fb08db P c41d3008007e49d6b3870288bd94d238: No bootstrap required, opened a new log
I20260812 17:43:23.908927 31804 tablet_bootstrap.cc:654] T d5944153a70348139bca525ec9fb08db P 89fc3d55f1b0460f9c19d623174d7a9b: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:23.909080 31805 tablet_bootstrap.cc:492] T d5944153a70348139bca525ec9fb08db P 31ff7ae726e34549b561cfb734322abb: No bootstrap required, opened a new log
I20260812 17:43:23.909212 31803 ts_tablet_manager.cc:1397] T d5944153a70348139bca525ec9fb08db P c41d3008007e49d6b3870288bd94d238: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260812 17:43:23.909281 31805 ts_tablet_manager.cc:1397] T d5944153a70348139bca525ec9fb08db P 31ff7ae726e34549b561cfb734322abb: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260812 17:43:23.910120 31804 log.cc:824] T d5944153a70348139bca525ec9fb08db P 89fc3d55f1b0460f9c19d623174d7a9b: Log is configured to *not* fsync() on all Append() calls
I20260812 17:43:23.912351 31804 tablet_bootstrap.cc:492] T d5944153a70348139bca525ec9fb08db P 89fc3d55f1b0460f9c19d623174d7a9b: No bootstrap required, opened a new log
I20260812 17:43:23.912576 31804 ts_tablet_manager.cc:1397] T d5944153a70348139bca525ec9fb08db P 89fc3d55f1b0460f9c19d623174d7a9b: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 17:43:23.912958 31803 raft_consensus.cc:348] T d5944153a70348139bca525ec9fb08db P c41d3008007e49d6b3870288bd94d238 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } }
I20260812 17:43:23.913233 31803 raft_consensus.cc:374] T d5944153a70348139bca525ec9fb08db P c41d3008007e49d6b3870288bd94d238 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:23.913290 31803 raft_consensus.cc:729] T d5944153a70348139bca525ec9fb08db P c41d3008007e49d6b3870288bd94d238 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c41d3008007e49d6b3870288bd94d238, State: Initialized, Role: FOLLOWER
I20260812 17:43:23.913818 31803 consensus_queue.cc:260] T d5944153a70348139bca525ec9fb08db P c41d3008007e49d6b3870288bd94d238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } }
I20260812 17:43:23.914052 31805 raft_consensus.cc:348] T d5944153a70348139bca525ec9fb08db P 31ff7ae726e34549b561cfb734322abb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } }
I20260812 17:43:23.914361 31805 raft_consensus.cc:374] T d5944153a70348139bca525ec9fb08db P 31ff7ae726e34549b561cfb734322abb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:23.914453 31805 raft_consensus.cc:729] T d5944153a70348139bca525ec9fb08db P 31ff7ae726e34549b561cfb734322abb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31ff7ae726e34549b561cfb734322abb, State: Initialized, Role: FOLLOWER
I20260812 17:43:23.914739 31764 heartbeater.cc:503] Master 127.17.255.62:41677 was elected leader, sending a full tablet report...
I20260812 17:43:23.914975 31803 ts_tablet_manager.cc:1428] T d5944153a70348139bca525ec9fb08db P c41d3008007e49d6b3870288bd94d238: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260812 17:43:23.915469 31805 consensus_queue.cc:260] T d5944153a70348139bca525ec9fb08db P 31ff7ae726e34549b561cfb734322abb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } }
I20260812 17:43:23.916194 31271 heartbeater.cc:503] Master 127.17.255.62:41677 was elected leader, sending a full tablet report...
I20260812 17:43:23.916476 31805 ts_tablet_manager.cc:1428] T d5944153a70348139bca525ec9fb08db P 31ff7ae726e34549b561cfb734322abb: Time spent starting tablet: real 0.007s user 0.004s sys 0.004s
I20260812 17:43:23.916635 31804 raft_consensus.cc:348] T d5944153a70348139bca525ec9fb08db P 89fc3d55f1b0460f9c19d623174d7a9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } }
I20260812 17:43:23.916867 31804 raft_consensus.cc:374] T d5944153a70348139bca525ec9fb08db P 89fc3d55f1b0460f9c19d623174d7a9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:23.916905 31804 raft_consensus.cc:729] T d5944153a70348139bca525ec9fb08db P 89fc3d55f1b0460f9c19d623174d7a9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89fc3d55f1b0460f9c19d623174d7a9b, State: Initialized, Role: FOLLOWER
I20260812 17:43:23.917280 31804 consensus_queue.cc:260] T d5944153a70348139bca525ec9fb08db P 89fc3d55f1b0460f9c19d623174d7a9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } }
I20260812 17:43:23.917933 31517 heartbeater.cc:503] Master 127.17.255.62:41677 was elected leader, sending a full tablet report...
I20260812 17:43:23.918282 31804 ts_tablet_manager.cc:1428] T d5944153a70348139bca525ec9fb08db P 89fc3d55f1b0460f9c19d623174d7a9b: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
W20260812 17:43:24.061651 31765 tablet.cc:2369] T d5944153a70348139bca525ec9fb08db P c41d3008007e49d6b3870288bd94d238: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 17:43:24.078774 31520 tablet.cc:2369] T d5944153a70348139bca525ec9fb08db P 89fc3d55f1b0460f9c19d623174d7a9b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 17:43:24.079454 31272 tablet.cc:2369] T d5944153a70348139bca525ec9fb08db P 31ff7ae726e34549b561cfb734322abb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 17:43:24.089720 31811 raft_consensus.cc:482] T d5944153a70348139bca525ec9fb08db P c41d3008007e49d6b3870288bd94d238 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:43:24.089979 31811 raft_consensus.cc:504] T d5944153a70348139bca525ec9fb08db P c41d3008007e49d6b3870288bd94d238 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } }
I20260812 17:43:24.091398 31811 leader_election.cc:288] T d5944153a70348139bca525ec9fb08db P c41d3008007e49d6b3870288bd94d238 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89fc3d55f1b0460f9c19d623174d7a9b (127.17.255.2:44971), 31ff7ae726e34549b561cfb734322abb (127.17.255.1:34119)
I20260812 17:43:24.095386 31581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:24.091630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:44971 (local address 127.17.255.3:35685)
0812 17:43:24.091752 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:24.091770 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:24.091879 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:24.092197 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:24.092203 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:24.092231 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:43:24.092360 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:24.092370 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:24.093223 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:24.093227 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:24.094186 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:24.094195 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:24.094977 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:24.094981 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:24.095122 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:24.095154 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 17:43:24.095213 (+ 59us) client_negotiation.cc:240] Negotiation successful
0812 17:43:24.095271 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32,"mutex_wait_us":5}
I20260812 17:43:24.095566 31800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:24.091743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:35685 (local address 127.17.255.2:44971)
0812 17:43:24.091894 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:24.091899 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:24.091946 (+ 47us) server_negotiation.cc:407] Connection header received
0812 17:43:24.092011 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:24.092017 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:24.092075 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:24.092157 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:43:24.092475 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:24.093087 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:24.094353 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:24.094855 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:24.094957 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:24.095002 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:24.095330 (+ 328us) server_negotiation.cc:299] Negotiation successful
0812 17:43:24.095421 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 17:43:24.096252 31437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5944153a70348139bca525ec9fb08db" candidate_uuid: "c41d3008007e49d6b3870288bd94d238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" is_pre_election: true
I20260812 17:43:24.096467 31802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:24.091972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:55893 (local address 127.17.255.1:34119)
0812 17:43:24.092123 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:24.092130 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:24.092260 (+ 130us) server_negotiation.cc:407] Connection header received
0812 17:43:24.092462 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:24.092465 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:24.092516 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:24.092599 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:43:24.093459 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:24.093935 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:24.095144 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:24.095893 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:24.096067 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:24.096115 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:24.096281 (+ 166us) server_negotiation.cc:299] Negotiation successful
0812 17:43:24.096345 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 17:43:24.096519 31815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:24.091707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:34119 (local address 127.17.255.3:55893)
0812 17:43:24.092158 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:24.092172 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:24.092332 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:24.092668 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:24.092671 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:24.092689 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:43:24.093299 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:24.093312 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:24.094070 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:24.094073 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:24.095002 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:24.095012 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:24.096043 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:24.096047 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:24.096142 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:24.096166 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 17:43:24.096248 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 17:43:24.096377 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":368,"spinlock_wait_cycles":20736,"thread_start_us":138,"threads_started":1}
I20260812 17:43:24.096647 31437 raft_consensus.cc:2454] T d5944153a70348139bca525ec9fb08db P 89fc3d55f1b0460f9c19d623174d7a9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c41d3008007e49d6b3870288bd94d238 in term 0.
I20260812 17:43:24.097136 31198 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5944153a70348139bca525ec9fb08db" candidate_uuid: "c41d3008007e49d6b3870288bd94d238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31ff7ae726e34549b561cfb734322abb" is_pre_election: true
I20260812 17:43:24.097198 31563 leader_election.cc:302] T d5944153a70348139bca525ec9fb08db P c41d3008007e49d6b3870288bd94d238 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89fc3d55f1b0460f9c19d623174d7a9b, c41d3008007e49d6b3870288bd94d238; no voters:
I20260812 17:43:24.097435 31198 raft_consensus.cc:2454] T d5944153a70348139bca525ec9fb08db P 31ff7ae726e34549b561cfb734322abb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c41d3008007e49d6b3870288bd94d238 in term 0.
I20260812 17:43:24.097509 31811 raft_consensus.cc:2781] T d5944153a70348139bca525ec9fb08db P c41d3008007e49d6b3870288bd94d238 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 17:43:24.097605 31811 raft_consensus.cc:482] T d5944153a70348139bca525ec9fb08db P c41d3008007e49d6b3870288bd94d238 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 17:43:24.097661 31811 raft_consensus.cc:3037] T d5944153a70348139bca525ec9fb08db P c41d3008007e49d6b3870288bd94d238 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:24.098904 31811 raft_consensus.cc:504] T d5944153a70348139bca525ec9fb08db P c41d3008007e49d6b3870288bd94d238 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } }
I20260812 17:43:24.099340 31811 leader_election.cc:288] T d5944153a70348139bca525ec9fb08db P c41d3008007e49d6b3870288bd94d238 [CANDIDATE]: Term 1 election: Requested vote from peers 89fc3d55f1b0460f9c19d623174d7a9b (127.17.255.2:44971), 31ff7ae726e34549b561cfb734322abb (127.17.255.1:34119)
I20260812 17:43:24.099684 31437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5944153a70348139bca525ec9fb08db" candidate_uuid: "c41d3008007e49d6b3870288bd94d238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89fc3d55f1b0460f9c19d623174d7a9b"
I20260812 17:43:24.099810 31437 raft_consensus.cc:3037] T d5944153a70348139bca525ec9fb08db P 89fc3d55f1b0460f9c19d623174d7a9b [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:24.099823 31198 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5944153a70348139bca525ec9fb08db" candidate_uuid: "c41d3008007e49d6b3870288bd94d238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31ff7ae726e34549b561cfb734322abb"
I20260812 17:43:24.099969 31198 raft_consensus.cc:3037] T d5944153a70348139bca525ec9fb08db P 31ff7ae726e34549b561cfb734322abb [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:24.101028 31437 raft_consensus.cc:2454] T d5944153a70348139bca525ec9fb08db P 89fc3d55f1b0460f9c19d623174d7a9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c41d3008007e49d6b3870288bd94d238 in term 1.
I20260812 17:43:24.101230 31198 raft_consensus.cc:2454] T d5944153a70348139bca525ec9fb08db P 31ff7ae726e34549b561cfb734322abb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c41d3008007e49d6b3870288bd94d238 in term 1.
I20260812 17:43:24.101398 31563 leader_election.cc:302] T d5944153a70348139bca525ec9fb08db P c41d3008007e49d6b3870288bd94d238 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89fc3d55f1b0460f9c19d623174d7a9b, c41d3008007e49d6b3870288bd94d238; no voters:
I20260812 17:43:24.101686 31811 raft_consensus.cc:2781] T d5944153a70348139bca525ec9fb08db P c41d3008007e49d6b3870288bd94d238 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:43:24.101861 31811 raft_consensus.cc:686] T d5944153a70348139bca525ec9fb08db P c41d3008007e49d6b3870288bd94d238 [term 1 LEADER]: Becoming Leader. State: Replica: c41d3008007e49d6b3870288bd94d238, State: Running, Role: LEADER
I20260812 17:43:24.102218 31811 consensus_queue.cc:237] T d5944153a70348139bca525ec9fb08db P c41d3008007e49d6b3870288bd94d238 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } }
I20260812 17:43:24.105597 30910 catalog_manager.cc:5495] T d5944153a70348139bca525ec9fb08db P c41d3008007e49d6b3870288bd94d238 reported cstate change: term changed from 0 to 1, leader changed from <none> to c41d3008007e49d6b3870288bd94d238 (127.17.255.3). New cstate: current_term: 1 leader_uuid: "c41d3008007e49d6b3870288bd94d238" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } health_report { overall_health: UNKNOWN } } }
I20260812 17:43:24.132689 31801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:24.128888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35376 (local address 127.17.255.3:46087)
0812 17:43:24.129039 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:24.129043 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:24.129060 (+ 17us) server_negotiation.cc:407] Connection header received
0812 17:43:24.129162 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:24.129164 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:24.129220 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:24.129335 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:43:24.129585 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:24.130102 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:24.131088 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:24.131323 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:24.131503 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:24.131810 (+ 307us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:43:24.132285 (+ 475us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:43:24.132428 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:24.132469 (+ 41us) server_negotiation.cc:299] Negotiation successful
0812 17:43:24.132533 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 17:43:24.138909 31437 raft_consensus.cc:1261] T d5944153a70348139bca525ec9fb08db P 89fc3d55f1b0460f9c19d623174d7a9b [term 1 FOLLOWER]: Refusing update from remote peer c41d3008007e49d6b3870288bd94d238: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:43:24.138909 31198 raft_consensus.cc:1261] T d5944153a70348139bca525ec9fb08db P 31ff7ae726e34549b561cfb734322abb [term 1 FOLLOWER]: Refusing update from remote peer c41d3008007e49d6b3870288bd94d238: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:43:24.139717 31811 consensus_queue.cc:1035] T d5944153a70348139bca525ec9fb08db P c41d3008007e49d6b3870288bd94d238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:43:24.139911 31816 consensus_queue.cc:1035] T d5944153a70348139bca525ec9fb08db P c41d3008007e49d6b3870288bd94d238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:43:24.148101 31821 mvcc.cc:205] Tried to move back new op lower bound from 7317735850544951296 to 7317735850405576704. Current Snapshot: MvccSnapshot[applied={T|T < 7317735850544951296}]
I20260812 17:43:24.149300 31823 mvcc.cc:205] Tried to move back new op lower bound from 7317735850544951296 to 7317735850405576704. Current Snapshot: MvccSnapshot[applied={T|T < 7317735850544951296}]
I20260812 17:43:24.158125 30910 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50826:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:43:24.158298 30910 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50826:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:43:24.160912 30910 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e1909aaadb58413f8fba81c9ca9d8f36: Sending DeleteTablet for 3 replicas of tablet d5944153a70348139bca525ec9fb08db
I20260812 17:43:24.161800 31649 tablet_service.cc:1514] Processing DeleteTablet for tablet d5944153a70348139bca525ec9fb08db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:43:24 UTC) from {username='oryx', principal='oryx/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:35362
I20260812 17:43:24.161824 31403 tablet_service.cc:1514] Processing DeleteTablet for tablet d5944153a70348139bca525ec9fb08db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:43:24 UTC) from {username='oryx', principal='oryx/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:43338
I20260812 17:43:24.161914 31162 tablet_service.cc:1514] Processing DeleteTablet for tablet d5944153a70348139bca525ec9fb08db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:43:24 UTC) from {username='oryx', principal='oryx/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:33296
I20260812 17:43:24.162333 31838 tablet_replica.cc:330] T d5944153a70348139bca525ec9fb08db P 89fc3d55f1b0460f9c19d623174d7a9b: stopping tablet replica
I20260812 17:43:24.162654 31839 tablet_replica.cc:330] T d5944153a70348139bca525ec9fb08db P 31ff7ae726e34549b561cfb734322abb: stopping tablet replica
I20260812 17:43:24.162709 31838 raft_consensus.cc:2229] T d5944153a70348139bca525ec9fb08db P 89fc3d55f1b0460f9c19d623174d7a9b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:43:24.163084 31838 raft_consensus.cc:2258] T d5944153a70348139bca525ec9fb08db P 89fc3d55f1b0460f9c19d623174d7a9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:43:24.163070 31839 raft_consensus.cc:2229] T d5944153a70348139bca525ec9fb08db P 31ff7ae726e34549b561cfb734322abb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:43:24.163000 30910 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50826:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 17:43:24.163447 30910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 17:43:24.163651 31839 raft_consensus.cc:2258] T d5944153a70348139bca525ec9fb08db P 31ff7ae726e34549b561cfb734322abb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:43:24.164317 31836 tablet_replica.cc:330] T d5944153a70348139bca525ec9fb08db P c41d3008007e49d6b3870288bd94d238: stopping tablet replica
I20260812 17:43:24.164601 31836 raft_consensus.cc:2229] T d5944153a70348139bca525ec9fb08db P c41d3008007e49d6b3870288bd94d238 [term 1 LEADER]: Raft consensus shutting down.
I20260812 17:43:24.164978 31836 raft_consensus.cc:2258] T d5944153a70348139bca525ec9fb08db P c41d3008007e49d6b3870288bd94d238 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:43:24.165000 31838 ts_tablet_manager.cc:1905] T d5944153a70348139bca525ec9fb08db P 89fc3d55f1b0460f9c19d623174d7a9b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:43:24.166807 31839 ts_tablet_manager.cc:1905] T d5944153a70348139bca525ec9fb08db P 31ff7ae726e34549b561cfb734322abb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:43:24.168012 31838 ts_tablet_manager.cc:1918] T d5944153a70348139bca525ec9fb08db P 89fc3d55f1b0460f9c19d623174d7a9b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 17:43:24.168125 31838 log.cc:1196] T d5944153a70348139bca525ec9fb08db P 89fc3d55f1b0460f9c19d623174d7a9b: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-1/wal/wals/d5944153a70348139bca525ec9fb08db
I20260812 17:43:24.168490 31838 ts_tablet_manager.cc:1939] T d5944153a70348139bca525ec9fb08db P 89fc3d55f1b0460f9c19d623174d7a9b: Deleting consensus metadata
I20260812 17:43:24.169739 31839 ts_tablet_manager.cc:1918] T d5944153a70348139bca525ec9fb08db P 31ff7ae726e34549b561cfb734322abb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 17:43:24.169876 31839 log.cc:1196] T d5944153a70348139bca525ec9fb08db P 31ff7ae726e34549b561cfb734322abb: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-0/wal/wals/d5944153a70348139bca525ec9fb08db
I20260812 17:43:24.169929 30885 catalog_manager.cc:4841] TS 89fc3d55f1b0460f9c19d623174d7a9b (127.17.255.2:44971): tablet d5944153a70348139bca525ec9fb08db (table test-table [id=69a5fb7cf1144a2fb21b9e9fc7eb1084]) successfully deleted
I20260812 17:43:24.170218 31839 ts_tablet_manager.cc:1939] T d5944153a70348139bca525ec9fb08db P 31ff7ae726e34549b561cfb734322abb: Deleting consensus metadata
I20260812 17:43:24.170584 31162 tablet_service.cc:1467] Processing CreateTablet for tablet 83538eb04ca84e82be4d2aaec1360d9a (DEFAULT_TABLE table=test-table [id=69bad9a807bd46718f48e8f60f63486e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:43:24.170776 31649 tablet_service.cc:1467] Processing CreateTablet for tablet 83538eb04ca84e82be4d2aaec1360d9a (DEFAULT_TABLE table=test-table [id=69bad9a807bd46718f48e8f60f63486e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:43:24.170862 31162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83538eb04ca84e82be4d2aaec1360d9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:24.171033 31649 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83538eb04ca84e82be4d2aaec1360d9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:24.173251 31805 tablet_bootstrap.cc:492] T 83538eb04ca84e82be4d2aaec1360d9a P 31ff7ae726e34549b561cfb734322abb: Bootstrap starting.
I20260812 17:43:24.173552 31803 tablet_bootstrap.cc:492] T 83538eb04ca84e82be4d2aaec1360d9a P c41d3008007e49d6b3870288bd94d238: Bootstrap starting.
I20260812 17:43:24.173936 31403 tablet_service.cc:1467] Processing CreateTablet for tablet 83538eb04ca84e82be4d2aaec1360d9a (DEFAULT_TABLE table=test-table [id=69bad9a807bd46718f48e8f60f63486e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:43:24.174211 31403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83538eb04ca84e82be4d2aaec1360d9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:24.174271 31805 tablet_bootstrap.cc:654] T 83538eb04ca84e82be4d2aaec1360d9a P 31ff7ae726e34549b561cfb734322abb: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:24.174523 31803 tablet_bootstrap.cc:654] T 83538eb04ca84e82be4d2aaec1360d9a P c41d3008007e49d6b3870288bd94d238: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:24.176141 31805 tablet_bootstrap.cc:492] T 83538eb04ca84e82be4d2aaec1360d9a P 31ff7ae726e34549b561cfb734322abb: No bootstrap required, opened a new log
I20260812 17:43:24.176170 31803 tablet_bootstrap.cc:492] T 83538eb04ca84e82be4d2aaec1360d9a P c41d3008007e49d6b3870288bd94d238: No bootstrap required, opened a new log
I20260812 17:43:24.176245 31805 ts_tablet_manager.cc:1397] T 83538eb04ca84e82be4d2aaec1360d9a P 31ff7ae726e34549b561cfb734322abb: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20260812 17:43:24.176250 31803 ts_tablet_manager.cc:1397] T 83538eb04ca84e82be4d2aaec1360d9a P c41d3008007e49d6b3870288bd94d238: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260812 17:43:24.176713 31805 raft_consensus.cc:348] T 83538eb04ca84e82be4d2aaec1360d9a P 31ff7ae726e34549b561cfb734322abb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } }
I20260812 17:43:24.176822 31805 raft_consensus.cc:374] T 83538eb04ca84e82be4d2aaec1360d9a P 31ff7ae726e34549b561cfb734322abb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:24.176748 31803 raft_consensus.cc:348] T 83538eb04ca84e82be4d2aaec1360d9a P c41d3008007e49d6b3870288bd94d238 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } }
I20260812 17:43:24.176853 31805 raft_consensus.cc:729] T 83538eb04ca84e82be4d2aaec1360d9a P 31ff7ae726e34549b561cfb734322abb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31ff7ae726e34549b561cfb734322abb, State: Initialized, Role: FOLLOWER
I20260812 17:43:24.176877 31803 raft_consensus.cc:374] T 83538eb04ca84e82be4d2aaec1360d9a P c41d3008007e49d6b3870288bd94d238 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:24.176928 31803 raft_consensus.cc:729] T 83538eb04ca84e82be4d2aaec1360d9a P c41d3008007e49d6b3870288bd94d238 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c41d3008007e49d6b3870288bd94d238, State: Initialized, Role: FOLLOWER
I20260812 17:43:24.176954 31805 consensus_queue.cc:260] T 83538eb04ca84e82be4d2aaec1360d9a P 31ff7ae726e34549b561cfb734322abb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } }
I20260812 17:43:24.177049 30889 catalog_manager.cc:4841] TS 31ff7ae726e34549b561cfb734322abb (127.17.255.1:34119): tablet d5944153a70348139bca525ec9fb08db (table test-table [id=69a5fb7cf1144a2fb21b9e9fc7eb1084]) successfully deleted
I20260812 17:43:24.177062 31803 consensus_queue.cc:260] T 83538eb04ca84e82be4d2aaec1360d9a P c41d3008007e49d6b3870288bd94d238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } }
I20260812 17:43:24.177191 31805 ts_tablet_manager.cc:1428] T 83538eb04ca84e82be4d2aaec1360d9a P 31ff7ae726e34549b561cfb734322abb: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 17:43:24.177322 31803 ts_tablet_manager.cc:1428] T 83538eb04ca84e82be4d2aaec1360d9a P c41d3008007e49d6b3870288bd94d238: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260812 17:43:24.177626 31804 tablet_bootstrap.cc:492] T 83538eb04ca84e82be4d2aaec1360d9a P 89fc3d55f1b0460f9c19d623174d7a9b: Bootstrap starting.
I20260812 17:43:24.180089 31836 ts_tablet_manager.cc:1905] T d5944153a70348139bca525ec9fb08db P c41d3008007e49d6b3870288bd94d238: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:43:24.181609 31804 tablet_bootstrap.cc:654] T 83538eb04ca84e82be4d2aaec1360d9a P 89fc3d55f1b0460f9c19d623174d7a9b: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:24.183033 31804 tablet_bootstrap.cc:492] T 83538eb04ca84e82be4d2aaec1360d9a P 89fc3d55f1b0460f9c19d623174d7a9b: No bootstrap required, opened a new log
I20260812 17:43:24.183126 31804 ts_tablet_manager.cc:1397] T 83538eb04ca84e82be4d2aaec1360d9a P 89fc3d55f1b0460f9c19d623174d7a9b: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260812 17:43:24.183395 31836 ts_tablet_manager.cc:1918] T d5944153a70348139bca525ec9fb08db P c41d3008007e49d6b3870288bd94d238: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 17:43:24.183521 31836 log.cc:1196] T d5944153a70348139bca525ec9fb08db P c41d3008007e49d6b3870288bd94d238: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-2/wal/wals/d5944153a70348139bca525ec9fb08db
I20260812 17:43:24.183879 31836 ts_tablet_manager.cc:1939] T d5944153a70348139bca525ec9fb08db P c41d3008007e49d6b3870288bd94d238: Deleting consensus metadata
I20260812 17:43:24.183894 31804 raft_consensus.cc:348] T 83538eb04ca84e82be4d2aaec1360d9a P 89fc3d55f1b0460f9c19d623174d7a9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } }
I20260812 17:43:24.184017 31804 raft_consensus.cc:374] T 83538eb04ca84e82be4d2aaec1360d9a P 89fc3d55f1b0460f9c19d623174d7a9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:24.184057 31804 raft_consensus.cc:729] T 83538eb04ca84e82be4d2aaec1360d9a P 89fc3d55f1b0460f9c19d623174d7a9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89fc3d55f1b0460f9c19d623174d7a9b, State: Initialized, Role: FOLLOWER
I20260812 17:43:24.184186 31804 consensus_queue.cc:260] T 83538eb04ca84e82be4d2aaec1360d9a P 89fc3d55f1b0460f9c19d623174d7a9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } }
I20260812 17:43:24.184454 31804 ts_tablet_manager.cc:1428] T 83538eb04ca84e82be4d2aaec1360d9a P 89fc3d55f1b0460f9c19d623174d7a9b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260812 17:43:24.185160 30889 catalog_manager.cc:4841] TS c41d3008007e49d6b3870288bd94d238 (127.17.255.3:46087): tablet d5944153a70348139bca525ec9fb08db (table test-table [id=69a5fb7cf1144a2fb21b9e9fc7eb1084]) successfully deleted
I20260812 17:43:24.466579 31811 raft_consensus.cc:482] T 83538eb04ca84e82be4d2aaec1360d9a P c41d3008007e49d6b3870288bd94d238 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:43:24.466751 31811 raft_consensus.cc:504] T 83538eb04ca84e82be4d2aaec1360d9a P c41d3008007e49d6b3870288bd94d238 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } }
I20260812 17:43:24.467150 31811 leader_election.cc:288] T 83538eb04ca84e82be4d2aaec1360d9a P c41d3008007e49d6b3870288bd94d238 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31ff7ae726e34549b561cfb734322abb (127.17.255.1:34119), 89fc3d55f1b0460f9c19d623174d7a9b (127.17.255.2:44971)
I20260812 17:43:24.467751 31437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83538eb04ca84e82be4d2aaec1360d9a" candidate_uuid: "c41d3008007e49d6b3870288bd94d238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" is_pre_election: true
I20260812 17:43:24.467767 31198 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83538eb04ca84e82be4d2aaec1360d9a" candidate_uuid: "c41d3008007e49d6b3870288bd94d238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31ff7ae726e34549b561cfb734322abb" is_pre_election: true
I20260812 17:43:24.467916 31437 raft_consensus.cc:2454] T 83538eb04ca84e82be4d2aaec1360d9a P 89fc3d55f1b0460f9c19d623174d7a9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c41d3008007e49d6b3870288bd94d238 in term 0.
I20260812 17:43:24.467943 31198 raft_consensus.cc:2454] T 83538eb04ca84e82be4d2aaec1360d9a P 31ff7ae726e34549b561cfb734322abb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c41d3008007e49d6b3870288bd94d238 in term 0.
I20260812 17:43:24.468333 31571 leader_election.cc:302] T 83538eb04ca84e82be4d2aaec1360d9a P c41d3008007e49d6b3870288bd94d238 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 31ff7ae726e34549b561cfb734322abb, 89fc3d55f1b0460f9c19d623174d7a9b, c41d3008007e49d6b3870288bd94d238; no voters:
I20260812 17:43:24.468540 31811 raft_consensus.cc:2781] T 83538eb04ca84e82be4d2aaec1360d9a P c41d3008007e49d6b3870288bd94d238 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 17:43:24.468621 31811 raft_consensus.cc:482] T 83538eb04ca84e82be4d2aaec1360d9a P c41d3008007e49d6b3870288bd94d238 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 17:43:24.468683 31811 raft_consensus.cc:3037] T 83538eb04ca84e82be4d2aaec1360d9a P c41d3008007e49d6b3870288bd94d238 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:24.469748 31811 raft_consensus.cc:504] T 83538eb04ca84e82be4d2aaec1360d9a P c41d3008007e49d6b3870288bd94d238 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } }
I20260812 17:43:24.470119 31811 leader_election.cc:288] T 83538eb04ca84e82be4d2aaec1360d9a P c41d3008007e49d6b3870288bd94d238 [CANDIDATE]: Term 1 election: Requested vote from peers 31ff7ae726e34549b561cfb734322abb (127.17.255.1:34119), 89fc3d55f1b0460f9c19d623174d7a9b (127.17.255.2:44971)
I20260812 17:43:24.470623 31198 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83538eb04ca84e82be4d2aaec1360d9a" candidate_uuid: "c41d3008007e49d6b3870288bd94d238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31ff7ae726e34549b561cfb734322abb"
I20260812 17:43:24.470643 31437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83538eb04ca84e82be4d2aaec1360d9a" candidate_uuid: "c41d3008007e49d6b3870288bd94d238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89fc3d55f1b0460f9c19d623174d7a9b"
I20260812 17:43:24.470773 31198 raft_consensus.cc:3037] T 83538eb04ca84e82be4d2aaec1360d9a P 31ff7ae726e34549b561cfb734322abb [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:24.470793 31437 raft_consensus.cc:3037] T 83538eb04ca84e82be4d2aaec1360d9a P 89fc3d55f1b0460f9c19d623174d7a9b [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:24.472002 31437 raft_consensus.cc:2454] T 83538eb04ca84e82be4d2aaec1360d9a P 89fc3d55f1b0460f9c19d623174d7a9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c41d3008007e49d6b3870288bd94d238 in term 1.
I20260812 17:43:24.471995 31198 raft_consensus.cc:2454] T 83538eb04ca84e82be4d2aaec1360d9a P 31ff7ae726e34549b561cfb734322abb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c41d3008007e49d6b3870288bd94d238 in term 1.
I20260812 17:43:24.472358 31571 leader_election.cc:302] T 83538eb04ca84e82be4d2aaec1360d9a P c41d3008007e49d6b3870288bd94d238 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ff7ae726e34549b561cfb734322abb, c41d3008007e49d6b3870288bd94d238; no voters:
I20260812 17:43:24.472558 31811 raft_consensus.cc:2781] T 83538eb04ca84e82be4d2aaec1360d9a P c41d3008007e49d6b3870288bd94d238 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:43:24.472651 31811 raft_consensus.cc:686] T 83538eb04ca84e82be4d2aaec1360d9a P c41d3008007e49d6b3870288bd94d238 [term 1 LEADER]: Becoming Leader. State: Replica: c41d3008007e49d6b3870288bd94d238, State: Running, Role: LEADER
I20260812 17:43:24.472802 31811 consensus_queue.cc:237] T 83538eb04ca84e82be4d2aaec1360d9a P c41d3008007e49d6b3870288bd94d238 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } }
I20260812 17:43:24.474637 30909 catalog_manager.cc:5495] T 83538eb04ca84e82be4d2aaec1360d9a P c41d3008007e49d6b3870288bd94d238 reported cstate change: term changed from 0 to 1, leader changed from <none> to c41d3008007e49d6b3870288bd94d238 (127.17.255.3). New cstate: current_term: 1 leader_uuid: "c41d3008007e49d6b3870288bd94d238" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } health_report { overall_health: HEALTHY } } }
Aug 12 17:43:24 dist-test-slave-tk9z krb5kdc[30840](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556602, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.255.62@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM
I20260812 17:43:24.578042 31863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:24.568314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:41677 (local address 127.0.0.1:50838)
0812 17:43:24.568655 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:24.568671 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:24.568825 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:24.569105 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:24.569108 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:24.569555 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:24.569652 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:24.569658 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:24.570511 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:24.570514 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:24.571180 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:24.571204 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:24.571757 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:24.571760 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:24.571837 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:24.572437 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:24.572449 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:24.574024 (+ 1575us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:24.575977 (+ 1953us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:24.575989 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:24.575997 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:24.576421 (+ 424us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:24.576752 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:24.576755 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:24.576757 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:24.576874 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:24.577370 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:24.577378 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:24.577528 (+ 150us) client_negotiation.cc:769] Sending connection context
0812 17:43:24.577656 (+ 128us) client_negotiation.cc:240] Negotiation successful
0812 17:43:24.577842 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":119,"threads_started":1}
I20260812 17:43:24.578253 31862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:24.568338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50838 (local address 127.17.255.62:41677)
0812 17:43:24.568628 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:24.568639 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:24.568764 (+ 125us) server_negotiation.cc:407] Connection header received
0812 17:43:24.568954 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:24.568957 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:24.568994 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:24.569089 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:24.569776 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:24.570321 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:24.571313 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:24.571642 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:24.571753 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:24.574168 (+ 2415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:24.574171 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:24.574173 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:24.574196 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:24.575848 (+ 1652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:24.576546 (+ 698us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:24.576549 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:24.576550 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:24.576644 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:24.577024 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:24.577027 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:24.577028 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:24.577230 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:24.577338 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:24.577741 (+ 403us) server_negotiation.cc:299] Negotiation successful
0812 17:43:24.578003 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":62,"server-negotiator.queue_time_us":206,"thread_start_us":123,"threads_started":1}
I20260812 17:43:24.583065 30909 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:50838:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 17:43:24.583921 30909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 17:43:24.589140 31403 tablet_service.cc:1467] Processing CreateTablet for tablet bb7e87f5a7864ea599abedd752e05768 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=94f09492b1814c4ca56138557c5f86be]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 17:43:24.589120 31162 tablet_service.cc:1467] Processing CreateTablet for tablet bb7e87f5a7864ea599abedd752e05768 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=94f09492b1814c4ca56138557c5f86be]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 17:43:24.589299 31649 tablet_service.cc:1467] Processing CreateTablet for tablet bb7e87f5a7864ea599abedd752e05768 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=94f09492b1814c4ca56138557c5f86be]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 17:43:24.589581 31403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb7e87f5a7864ea599abedd752e05768. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:24.589601 31162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb7e87f5a7864ea599abedd752e05768. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:24.589643 31649 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb7e87f5a7864ea599abedd752e05768. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:24.592048 31804 tablet_bootstrap.cc:492] T bb7e87f5a7864ea599abedd752e05768 P 89fc3d55f1b0460f9c19d623174d7a9b: Bootstrap starting.
I20260812 17:43:24.592445 31803 tablet_bootstrap.cc:492] T bb7e87f5a7864ea599abedd752e05768 P c41d3008007e49d6b3870288bd94d238: Bootstrap starting.
I20260812 17:43:24.592950 31804 tablet_bootstrap.cc:654] T bb7e87f5a7864ea599abedd752e05768 P 89fc3d55f1b0460f9c19d623174d7a9b: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:24.593325 31803 tablet_bootstrap.cc:654] T bb7e87f5a7864ea599abedd752e05768 P c41d3008007e49d6b3870288bd94d238: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:24.594115 31805 tablet_bootstrap.cc:492] T bb7e87f5a7864ea599abedd752e05768 P 31ff7ae726e34549b561cfb734322abb: Bootstrap starting.
I20260812 17:43:24.594183 31804 tablet_bootstrap.cc:492] T bb7e87f5a7864ea599abedd752e05768 P 89fc3d55f1b0460f9c19d623174d7a9b: No bootstrap required, opened a new log
I20260812 17:43:24.594252 31804 ts_tablet_manager.cc:1397] T bb7e87f5a7864ea599abedd752e05768 P 89fc3d55f1b0460f9c19d623174d7a9b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 17:43:24.594604 31803 tablet_bootstrap.cc:492] T bb7e87f5a7864ea599abedd752e05768 P c41d3008007e49d6b3870288bd94d238: No bootstrap required, opened a new log
I20260812 17:43:24.594666 31803 ts_tablet_manager.cc:1397] T bb7e87f5a7864ea599abedd752e05768 P c41d3008007e49d6b3870288bd94d238: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260812 17:43:24.594738 31804 raft_consensus.cc:348] T bb7e87f5a7864ea599abedd752e05768 P 89fc3d55f1b0460f9c19d623174d7a9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } }
I20260812 17:43:24.594849 31804 raft_consensus.cc:374] T bb7e87f5a7864ea599abedd752e05768 P 89fc3d55f1b0460f9c19d623174d7a9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:24.594882 31804 raft_consensus.cc:729] T bb7e87f5a7864ea599abedd752e05768 P 89fc3d55f1b0460f9c19d623174d7a9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89fc3d55f1b0460f9c19d623174d7a9b, State: Initialized, Role: FOLLOWER
I20260812 17:43:24.594986 31803 raft_consensus.cc:348] T bb7e87f5a7864ea599abedd752e05768 P c41d3008007e49d6b3870288bd94d238 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } }
I20260812 17:43:24.595021 31804 consensus_queue.cc:260] T bb7e87f5a7864ea599abedd752e05768 P 89fc3d55f1b0460f9c19d623174d7a9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } }
I20260812 17:43:24.595088 31805 tablet_bootstrap.cc:654] T bb7e87f5a7864ea599abedd752e05768 P 31ff7ae726e34549b561cfb734322abb: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:24.595091 31803 raft_consensus.cc:374] T bb7e87f5a7864ea599abedd752e05768 P c41d3008007e49d6b3870288bd94d238 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:24.595126 31803 raft_consensus.cc:729] T bb7e87f5a7864ea599abedd752e05768 P c41d3008007e49d6b3870288bd94d238 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c41d3008007e49d6b3870288bd94d238, State: Initialized, Role: FOLLOWER
I20260812 17:43:24.595263 31803 consensus_queue.cc:260] T bb7e87f5a7864ea599abedd752e05768 P c41d3008007e49d6b3870288bd94d238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } }
I20260812 17:43:24.595338 31804 ts_tablet_manager.cc:1428] T bb7e87f5a7864ea599abedd752e05768 P 89fc3d55f1b0460f9c19d623174d7a9b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260812 17:43:24.595319 31814 tablet_replica.cc:439] T bb7e87f5a7864ea599abedd752e05768 P 89fc3d55f1b0460f9c19d623174d7a9b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } } }
I20260812 17:43:24.595455 31814 tablet_replica.cc:442] T bb7e87f5a7864ea599abedd752e05768 P 89fc3d55f1b0460f9c19d623174d7a9b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 17:43:24.595552 31803 ts_tablet_manager.cc:1428] T bb7e87f5a7864ea599abedd752e05768 P c41d3008007e49d6b3870288bd94d238: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 17:43:24.596300 31811 tablet_replica.cc:439] T bb7e87f5a7864ea599abedd752e05768 P c41d3008007e49d6b3870288bd94d238: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } } }
I20260812 17:43:24.596506 31811 tablet_replica.cc:442] T bb7e87f5a7864ea599abedd752e05768 P c41d3008007e49d6b3870288bd94d238: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 17:43:24.603193 31805 tablet_bootstrap.cc:492] T bb7e87f5a7864ea599abedd752e05768 P 31ff7ae726e34549b561cfb734322abb: No bootstrap required, opened a new log
I20260812 17:43:24.603294 31805 ts_tablet_manager.cc:1397] T bb7e87f5a7864ea599abedd752e05768 P 31ff7ae726e34549b561cfb734322abb: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260812 17:43:24.603747 31805 raft_consensus.cc:348] T bb7e87f5a7864ea599abedd752e05768 P 31ff7ae726e34549b561cfb734322abb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } }
I20260812 17:43:24.603843 31805 raft_consensus.cc:374] T bb7e87f5a7864ea599abedd752e05768 P 31ff7ae726e34549b561cfb734322abb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:24.603865 31805 raft_consensus.cc:729] T bb7e87f5a7864ea599abedd752e05768 P 31ff7ae726e34549b561cfb734322abb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31ff7ae726e34549b561cfb734322abb, State: Initialized, Role: FOLLOWER
I20260812 17:43:24.604080 31805 consensus_queue.cc:260] T bb7e87f5a7864ea599abedd752e05768 P 31ff7ae726e34549b561cfb734322abb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } }
I20260812 17:43:24.604434 31805 ts_tablet_manager.cc:1428] T bb7e87f5a7864ea599abedd752e05768 P 31ff7ae726e34549b561cfb734322abb: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260812 17:43:24.604378 31812 tablet_replica.cc:439] T bb7e87f5a7864ea599abedd752e05768 P 31ff7ae726e34549b561cfb734322abb: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } } }
I20260812 17:43:24.604538 31812 tablet_replica.cc:442] T bb7e87f5a7864ea599abedd752e05768 P 31ff7ae726e34549b561cfb734322abb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 17:43:24.700531 31812 raft_consensus.cc:482] T bb7e87f5a7864ea599abedd752e05768 P 31ff7ae726e34549b561cfb734322abb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:43:24.700697 31812 raft_consensus.cc:504] T bb7e87f5a7864ea599abedd752e05768 P 31ff7ae726e34549b561cfb734322abb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } }
I20260812 17:43:24.701982 31812 leader_election.cc:288] T bb7e87f5a7864ea599abedd752e05768 P 31ff7ae726e34549b561cfb734322abb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89fc3d55f1b0460f9c19d623174d7a9b (127.17.255.2:44971), c41d3008007e49d6b3870288bd94d238 (127.17.255.3:46087)
I20260812 17:43:24.705997 31875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:24.702387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:53325 (local address 127.17.255.3:46087)
0812 17:43:24.702641 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:24.702646 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:24.702662 (+ 16us) server_negotiation.cc:407] Connection header received
0812 17:43:24.702828 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:24.702833 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:24.702909 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:24.703013 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:43:24.703372 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:24.703896 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:24.705006 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:24.705421 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:24.705555 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:24.705616 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:24.705794 (+ 178us) server_negotiation.cc:299] Negotiation successful
0812 17:43:24.705872 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":76,"threads_started":1}
I20260812 17:43:24.706010 31871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:24.702220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.3:46087 (local address 127.17.255.1:53325)
0812 17:43:24.702570 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:24.702587 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:24.702696 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:24.703133 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:24.703136 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:24.703152 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:43:24.703258 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:24.703262 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:24.704053 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:24.704057 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:24.704863 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:24.704872 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:24.705550 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:24.705553 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:24.705655 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:24.705685 (+ 30us) client_negotiation.cc:769] Sending connection context
0812 17:43:24.705775 (+ 90us) client_negotiation.cc:240] Negotiation successful
0812 17:43:24.705847 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":75,"threads_started":1}
I20260812 17:43:24.706425 31870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:24.702229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:44971 (local address 127.17.255.1:45151)
0812 17:43:24.702718 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:24.702731 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:24.702911 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:24.703222 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:24.703225 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:24.703245 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:43:24.703380 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:24.703394 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:24.704355 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:24.704359 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:24.705180 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:24.705189 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:24.705900 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:24.705904 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:24.706012 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:24.706042 (+ 30us) client_negotiation.cc:769] Sending connection context
0812 17:43:24.706146 (+ 104us) client_negotiation.cc:240] Negotiation successful
0812 17:43:24.706235 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":112,"threads_started":1}
I20260812 17:43:24.706533 31872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:24.702353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:45151 (local address 127.17.255.2:44971)
0812 17:43:24.702659 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:24.702664 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:24.702884 (+ 220us) server_negotiation.cc:407] Connection header received
0812 17:43:24.703040 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:24.703044 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:24.703098 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:24.703208 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:43:24.703512 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:24.704202 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:24.705320 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:24.705769 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:24.705907 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:24.705962 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:24.706296 (+ 334us) server_negotiation.cc:299] Negotiation successful
0812 17:43:24.706401 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":66,"threads_started":1}
I20260812 17:43:24.706513 31677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb7e87f5a7864ea599abedd752e05768" candidate_uuid: "31ff7ae726e34549b561cfb734322abb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41d3008007e49d6b3870288bd94d238" is_pre_election: true
I20260812 17:43:24.706763 31677 raft_consensus.cc:2454] T bb7e87f5a7864ea599abedd752e05768 P c41d3008007e49d6b3870288bd94d238 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ff7ae726e34549b561cfb734322abb in term 0.
I20260812 17:43:24.707023 31437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb7e87f5a7864ea599abedd752e05768" candidate_uuid: "31ff7ae726e34549b561cfb734322abb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" is_pre_election: true
I20260812 17:43:24.707173 31437 raft_consensus.cc:2454] T bb7e87f5a7864ea599abedd752e05768 P 89fc3d55f1b0460f9c19d623174d7a9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ff7ae726e34549b561cfb734322abb in term 0.
I20260812 17:43:24.707214 31076 leader_election.cc:302] T bb7e87f5a7864ea599abedd752e05768 P 31ff7ae726e34549b561cfb734322abb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ff7ae726e34549b561cfb734322abb, c41d3008007e49d6b3870288bd94d238; no voters:
I20260812 17:43:24.707515 31812 raft_consensus.cc:2781] T bb7e87f5a7864ea599abedd752e05768 P 31ff7ae726e34549b561cfb734322abb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 17:43:24.707598 31812 raft_consensus.cc:482] T bb7e87f5a7864ea599abedd752e05768 P 31ff7ae726e34549b561cfb734322abb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 17:43:24.707659 31812 raft_consensus.cc:3037] T bb7e87f5a7864ea599abedd752e05768 P 31ff7ae726e34549b561cfb734322abb [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:24.708719 31812 raft_consensus.cc:504] T bb7e87f5a7864ea599abedd752e05768 P 31ff7ae726e34549b561cfb734322abb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } }
I20260812 17:43:24.709110 31812 leader_election.cc:288] T bb7e87f5a7864ea599abedd752e05768 P 31ff7ae726e34549b561cfb734322abb [CANDIDATE]: Term 1 election: Requested vote from peers 89fc3d55f1b0460f9c19d623174d7a9b (127.17.255.2:44971), c41d3008007e49d6b3870288bd94d238 (127.17.255.3:46087)
I20260812 17:43:24.709403 31437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb7e87f5a7864ea599abedd752e05768" candidate_uuid: "31ff7ae726e34549b561cfb734322abb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89fc3d55f1b0460f9c19d623174d7a9b"
I20260812 17:43:24.709555 31437 raft_consensus.cc:3037] T bb7e87f5a7864ea599abedd752e05768 P 89fc3d55f1b0460f9c19d623174d7a9b [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:24.709556 31677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb7e87f5a7864ea599abedd752e05768" candidate_uuid: "31ff7ae726e34549b561cfb734322abb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41d3008007e49d6b3870288bd94d238"
I20260812 17:43:24.709666 31677 raft_consensus.cc:3037] T bb7e87f5a7864ea599abedd752e05768 P c41d3008007e49d6b3870288bd94d238 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:24.710727 31437 raft_consensus.cc:2454] T bb7e87f5a7864ea599abedd752e05768 P 89fc3d55f1b0460f9c19d623174d7a9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ff7ae726e34549b561cfb734322abb in term 1.
I20260812 17:43:24.710916 31677 raft_consensus.cc:2454] T bb7e87f5a7864ea599abedd752e05768 P c41d3008007e49d6b3870288bd94d238 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ff7ae726e34549b561cfb734322abb in term 1.
I20260812 17:43:24.711053 31073 leader_election.cc:302] T bb7e87f5a7864ea599abedd752e05768 P 31ff7ae726e34549b561cfb734322abb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ff7ae726e34549b561cfb734322abb, 89fc3d55f1b0460f9c19d623174d7a9b; no voters:
I20260812 17:43:24.711218 31812 raft_consensus.cc:2781] T bb7e87f5a7864ea599abedd752e05768 P 31ff7ae726e34549b561cfb734322abb [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:43:24.711470 31812 raft_consensus.cc:686] T bb7e87f5a7864ea599abedd752e05768 P 31ff7ae726e34549b561cfb734322abb [term 1 LEADER]: Becoming Leader. State: Replica: 31ff7ae726e34549b561cfb734322abb, State: Running, Role: LEADER
I20260812 17:43:24.711747 31812 consensus_queue.cc:237] T bb7e87f5a7864ea599abedd752e05768 P 31ff7ae726e34549b561cfb734322abb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } }
I20260812 17:43:24.713209 31877 tablet_replica.cc:439] T bb7e87f5a7864ea599abedd752e05768 P 31ff7ae726e34549b561cfb734322abb: TxnStatusTablet state changed. Reason: New leader 31ff7ae726e34549b561cfb734322abb. Latest consensus state: current_term: 1 leader_uuid: "31ff7ae726e34549b561cfb734322abb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } } }
I20260812 17:43:24.713320 31877 tablet_replica.cc:442] T bb7e87f5a7864ea599abedd752e05768 P 31ff7ae726e34549b561cfb734322abb: This TxnStatusTablet replica's current role is: LEADER
I20260812 17:43:24.713755 31880 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 17:43:24.713930 31880 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 17:43:24.714329 30909 catalog_manager.cc:5495] T bb7e87f5a7864ea599abedd752e05768 P 31ff7ae726e34549b561cfb734322abb reported cstate change: term changed from 0 to 1, leader changed from <none> to 31ff7ae726e34549b561cfb734322abb (127.17.255.1). New cstate: current_term: 1 leader_uuid: "31ff7ae726e34549b561cfb734322abb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } health_report { overall_health: UNKNOWN } } }
I20260812 17:43:24.756583 31863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:24.752429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:34119 (local address 127.0.0.1:33306)
0812 17:43:24.752590 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:24.752614 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:24.752706 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:24.753205 (+ 499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:24.753208 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:24.753217 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 17:43:24.753343 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:24.753348 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:24.754162 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:24.754167 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:24.754834 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:24.754843 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:24.755355 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:24.755358 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:24.755461 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:24.755515 (+ 54us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 17:43:24.756265 (+ 750us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 17:43:24.756283 (+ 18us) client_negotiation.cc:769] Sending connection context
0812 17:43:24.756355 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 17:43:24.756443 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260812 17:43:24.756606 31884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:24.752599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33306 (local address 127.17.255.1:34119)
0812 17:43:24.752919 (+ 320us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:24.752931 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:24.752943 (+ 12us) server_negotiation.cc:407] Connection header received
0812 17:43:24.753014 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:24.753016 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:24.753069 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:24.753197 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:43:24.753482 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:24.754048 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:24.754984 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:24.755240 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:24.755355 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:24.755728 (+ 373us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:43:24.756168 (+ 440us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:43:24.756295 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:24.756367 (+ 72us) server_negotiation.cc:299] Negotiation successful
0812 17:43:24.756428 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":244,"thread_start_us":110,"threads_started":1}
I20260812 17:43:24.760022 31437 raft_consensus.cc:1261] T bb7e87f5a7864ea599abedd752e05768 P 89fc3d55f1b0460f9c19d623174d7a9b [term 1 FOLLOWER]: Refusing update from remote peer 31ff7ae726e34549b561cfb734322abb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:43:24.760278 31677 raft_consensus.cc:1261] T bb7e87f5a7864ea599abedd752e05768 P c41d3008007e49d6b3870288bd94d238 [term 1 FOLLOWER]: Refusing update from remote peer 31ff7ae726e34549b561cfb734322abb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:43:24.760643 31877 consensus_queue.cc:1035] T bb7e87f5a7864ea599abedd752e05768 P 31ff7ae726e34549b561cfb734322abb [LEADER]: Connected to new peer: Peer: permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:43:24.760838 31812 consensus_queue.cc:1035] T bb7e87f5a7864ea599abedd752e05768 P 31ff7ae726e34549b561cfb734322abb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:43:24.762422 31814 tablet_replica.cc:439] T bb7e87f5a7864ea599abedd752e05768 P 89fc3d55f1b0460f9c19d623174d7a9b: TxnStatusTablet state changed. Reason: New leader 31ff7ae726e34549b561cfb734322abb. Latest consensus state: current_term: 1 leader_uuid: "31ff7ae726e34549b561cfb734322abb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } } }
I20260812 17:43:24.762573 31814 tablet_replica.cc:442] T bb7e87f5a7864ea599abedd752e05768 P 89fc3d55f1b0460f9c19d623174d7a9b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 17:43:24.763085 31811 tablet_replica.cc:439] T bb7e87f5a7864ea599abedd752e05768 P c41d3008007e49d6b3870288bd94d238: TxnStatusTablet state changed. Reason: New leader 31ff7ae726e34549b561cfb734322abb. Latest consensus state: current_term: 1 leader_uuid: "31ff7ae726e34549b561cfb734322abb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } } }
I20260812 17:43:24.763200 31811 tablet_replica.cc:442] T bb7e87f5a7864ea599abedd752e05768 P c41d3008007e49d6b3870288bd94d238: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 17:43:24.765161 31877 tablet_replica.cc:439] T bb7e87f5a7864ea599abedd752e05768 P 31ff7ae726e34549b561cfb734322abb: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "31ff7ae726e34549b561cfb734322abb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } } }
I20260812 17:43:24.765297 31877 tablet_replica.cc:442] T bb7e87f5a7864ea599abedd752e05768 P 31ff7ae726e34549b561cfb734322abb: This TxnStatusTablet replica's current role is: LEADER
I20260812 17:43:24.765552 31887 mvcc.cc:205] Tried to move back new op lower bound from 7317735853091237888 to 7317735852902064128. Current Snapshot: MvccSnapshot[applied={T|T < 7317735853091237888}]
I20260812 17:43:24.765633 31877 tablet_replica.cc:439] T bb7e87f5a7864ea599abedd752e05768 P 31ff7ae726e34549b561cfb734322abb: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "31ff7ae726e34549b561cfb734322abb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } } }
I20260812 17:43:24.765739 31877 tablet_replica.cc:442] T bb7e87f5a7864ea599abedd752e05768 P 31ff7ae726e34549b561cfb734322abb: This TxnStatusTablet replica's current role is: LEADER
I20260812 17:43:24.766394 31814 tablet_replica.cc:439] T bb7e87f5a7864ea599abedd752e05768 P 89fc3d55f1b0460f9c19d623174d7a9b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "31ff7ae726e34549b561cfb734322abb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } } }
I20260812 17:43:24.766508 31814 tablet_replica.cc:442] T bb7e87f5a7864ea599abedd752e05768 P 89fc3d55f1b0460f9c19d623174d7a9b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 17:43:24.768074 31811 tablet_replica.cc:439] T bb7e87f5a7864ea599abedd752e05768 P c41d3008007e49d6b3870288bd94d238: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "31ff7ae726e34549b561cfb734322abb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } } }
I20260812 17:43:24.768188 31811 tablet_replica.cc:442] T bb7e87f5a7864ea599abedd752e05768 P c41d3008007e49d6b3870288bd94d238: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 17:43:24.781690 31902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:24.778023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:34119 (local address 127.17.255.3:44903)
0812 17:43:24.778363 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:24.778430 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:24.778579 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:24.778875 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:24.778878 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:24.778886 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 17:43:24.778996 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:24.779002 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:24.779767 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:24.779770 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:24.780426 (+ 656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:24.780436 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:24.780916 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:24.780919 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:24.781009 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:24.781068 (+ 59us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 17:43:24.781392 (+ 324us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 17:43:24.781401 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 17:43:24.781469 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 17:43:24.781559 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":94,"threads_started":1}
I20260812 17:43:24.781690 31884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:24.778164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:44903 (local address 127.17.255.1:34119)
0812 17:43:24.778302 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:24.778307 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:24.778523 (+ 216us) server_negotiation.cc:407] Connection header received
0812 17:43:24.778706 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:24.778709 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:24.778763 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:24.778863 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:43:24.779118 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:24.779652 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:24.780558 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:24.780798 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:24.780912 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:24.781214 (+ 302us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:43:24.781300 (+ 86us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:43:24.781386 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:24.781478 (+ 92us) server_negotiation.cc:299] Negotiation successful
0812 17:43:24.781532 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 17:43:24.788982 31437 raft_consensus.cc:1261] T 83538eb04ca84e82be4d2aaec1360d9a P 89fc3d55f1b0460f9c19d623174d7a9b [term 1 FOLLOWER]: Refusing update from remote peer c41d3008007e49d6b3870288bd94d238: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:43:24.789059 31198 raft_consensus.cc:1261] T 83538eb04ca84e82be4d2aaec1360d9a P 31ff7ae726e34549b561cfb734322abb [term 1 FOLLOWER]: Refusing update from remote peer c41d3008007e49d6b3870288bd94d238: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:43:24.789577 31816 consensus_queue.cc:1035] T 83538eb04ca84e82be4d2aaec1360d9a P c41d3008007e49d6b3870288bd94d238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:43:24.789883 31811 consensus_queue.cc:1035] T 83538eb04ca84e82be4d2aaec1360d9a P c41d3008007e49d6b3870288bd94d238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:43:24.820785 31875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:24.815463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:43285 (local address 127.17.255.3:46087)
0812 17:43:24.815581 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:24.815586 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:24.816001 (+ 415us) server_negotiation.cc:407] Connection header received
0812 17:43:24.816240 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:24.816243 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:24.816339 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:24.816393 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:43:24.816861 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:24.817678 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:24.819421 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:24.819744 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:24.819836 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:24.820269 (+ 433us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:43:24.820361 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:43:24.820409 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:24.820573 (+ 164us) server_negotiation.cc:299] Negotiation successful
0812 17:43:24.820641 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 17:43:24.821498 31913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:24.815389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.3:46087 (local address 127.17.255.1:43285)
0812 17:43:24.815795 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:24.815916 (+ 121us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:24.816095 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:24.816574 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:24.816576 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:24.816584 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 17:43:24.816702 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:24.816708 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:24.818073 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:24.818076 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:24.819104 (+ 1028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:24.819115 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:24.819958 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:24.819961 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:24.820054 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:24.820109 (+ 55us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 17:43:24.820474 (+ 365us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 17:43:24.820480 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 17:43:24.821221 (+ 741us) client_negotiation.cc:240] Negotiation successful
0812 17:43:24.821323 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":116,"threads_started":1}
I20260812 17:43:24.854441 30910 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50826:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:43:24.854600 30910 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50826:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:43:24.857184 30910 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e1909aaadb58413f8fba81c9ca9d8f36: Sending DeleteTablet for 3 replicas of tablet 83538eb04ca84e82be4d2aaec1360d9a
I20260812 17:43:24.857805 31162 tablet_service.cc:1514] Processing DeleteTablet for tablet 83538eb04ca84e82be4d2aaec1360d9a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:43:24 UTC) from {username='oryx', principal='oryx/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:33296
I20260812 17:43:24.857877 31649 tablet_service.cc:1514] Processing DeleteTablet for tablet 83538eb04ca84e82be4d2aaec1360d9a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:43:24 UTC) from {username='oryx', principal='oryx/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:35362
I20260812 17:43:24.858476 31403 tablet_service.cc:1514] Processing DeleteTablet for tablet 83538eb04ca84e82be4d2aaec1360d9a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:43:24 UTC) from {username='oryx', principal='oryx/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:43338
I20260812 17:43:24.858923 31921 tablet_replica.cc:330] T 83538eb04ca84e82be4d2aaec1360d9a P c41d3008007e49d6b3870288bd94d238: stopping tablet replica
I20260812 17:43:24.858934 31923 tablet_replica.cc:330] T 83538eb04ca84e82be4d2aaec1360d9a P 89fc3d55f1b0460f9c19d623174d7a9b: stopping tablet replica
I20260812 17:43:24.859076 31921 raft_consensus.cc:2229] T 83538eb04ca84e82be4d2aaec1360d9a P c41d3008007e49d6b3870288bd94d238 [term 1 LEADER]: Raft consensus shutting down.
I20260812 17:43:24.859122 31923 raft_consensus.cc:2229] T 83538eb04ca84e82be4d2aaec1360d9a P 89fc3d55f1b0460f9c19d623174d7a9b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:43:24.859308 31921 raft_consensus.cc:2258] T 83538eb04ca84e82be4d2aaec1360d9a P c41d3008007e49d6b3870288bd94d238 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:43:24.859335 31923 raft_consensus.cc:2258] T 83538eb04ca84e82be4d2aaec1360d9a P 89fc3d55f1b0460f9c19d623174d7a9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:43:24.860234 31923 ts_tablet_manager.cc:1905] T 83538eb04ca84e82be4d2aaec1360d9a P 89fc3d55f1b0460f9c19d623174d7a9b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:43:24.860234 31921 ts_tablet_manager.cc:1905] T 83538eb04ca84e82be4d2aaec1360d9a P c41d3008007e49d6b3870288bd94d238: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:43:24.863304 31921 ts_tablet_manager.cc:1918] T 83538eb04ca84e82be4d2aaec1360d9a P c41d3008007e49d6b3870288bd94d238: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 17:43:24.863312 31923 ts_tablet_manager.cc:1918] T 83538eb04ca84e82be4d2aaec1360d9a P 89fc3d55f1b0460f9c19d623174d7a9b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 17:43:24.863408 31921 log.cc:1196] T 83538eb04ca84e82be4d2aaec1360d9a P c41d3008007e49d6b3870288bd94d238: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-2/wal/wals/83538eb04ca84e82be4d2aaec1360d9a
I20260812 17:43:24.863525 31923 log.cc:1196] T 83538eb04ca84e82be4d2aaec1360d9a P 89fc3d55f1b0460f9c19d623174d7a9b: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-1/wal/wals/83538eb04ca84e82be4d2aaec1360d9a
I20260812 17:43:24.863715 31921 ts_tablet_manager.cc:1939] T 83538eb04ca84e82be4d2aaec1360d9a P c41d3008007e49d6b3870288bd94d238: Deleting consensus metadata
I20260812 17:43:24.863965 31923 ts_tablet_manager.cc:1939] T 83538eb04ca84e82be4d2aaec1360d9a P 89fc3d55f1b0460f9c19d623174d7a9b: Deleting consensus metadata
I20260812 17:43:24.864564 30889 catalog_manager.cc:4841] TS c41d3008007e49d6b3870288bd94d238 (127.17.255.3:46087): tablet 83538eb04ca84e82be4d2aaec1360d9a (table test-table [id=69bad9a807bd46718f48e8f60f63486e]) successfully deleted
I20260812 17:43:24.864681 30885 catalog_manager.cc:4841] TS 89fc3d55f1b0460f9c19d623174d7a9b (127.17.255.2:44971): tablet 83538eb04ca84e82be4d2aaec1360d9a (table test-table [id=69bad9a807bd46718f48e8f60f63486e]) successfully deleted
I20260812 17:43:24.864921 31920 tablet_replica.cc:330] T 83538eb04ca84e82be4d2aaec1360d9a P 31ff7ae726e34549b561cfb734322abb: stopping tablet replica
I20260812 17:43:24.865082 31920 raft_consensus.cc:2229] T 83538eb04ca84e82be4d2aaec1360d9a P 31ff7ae726e34549b561cfb734322abb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:43:24.865247 31920 raft_consensus.cc:2258] T 83538eb04ca84e82be4d2aaec1360d9a P 31ff7ae726e34549b561cfb734322abb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:43:24.865947 31920 ts_tablet_manager.cc:1905] T 83538eb04ca84e82be4d2aaec1360d9a P 31ff7ae726e34549b561cfb734322abb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:43:24.868531 31920 ts_tablet_manager.cc:1918] T 83538eb04ca84e82be4d2aaec1360d9a P 31ff7ae726e34549b561cfb734322abb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 17:43:24.868634 31920 log.cc:1196] T 83538eb04ca84e82be4d2aaec1360d9a P 31ff7ae726e34549b561cfb734322abb: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-0/wal/wals/83538eb04ca84e82be4d2aaec1360d9a
I20260812 17:43:24.868919 31920 ts_tablet_manager.cc:1939] T 83538eb04ca84e82be4d2aaec1360d9a P 31ff7ae726e34549b561cfb734322abb: Deleting consensus metadata
I20260812 17:43:24.869858 30889 catalog_manager.cc:4841] TS 31ff7ae726e34549b561cfb734322abb (127.17.255.1:34119): tablet 83538eb04ca84e82be4d2aaec1360d9a (table test-table [id=69bad9a807bd46718f48e8f60f63486e]) successfully deleted
Aug 12 17:43:24 dist-test-slave-tk9z krb5kdc[30840](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556604, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 17:43:24 dist-test-slave-tk9z krb5kdc[30840](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:24 dist-test-slave-tk9z krb5kdc[30840](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
W20260812 17:43:24.891660 31862 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:24.883916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50852 (local address 127.17.255.62:41677)
0812 17:43:24.884090 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:24.884095 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:24.884279 (+ 184us) server_negotiation.cc:407] Connection header received
0812 17:43:24.884440 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:24.884442 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:24.884490 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:24.884566 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:24.885647 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:24.886208 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:24.887580 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:24.887810 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:24.887898 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:24.891529 (+ 3631us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50852: BlockingRecv error: recv got EOF from 127.0.0.1:50852 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 12 17:43:24 dist-test-slave-tk9z krb5kdc[30840](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556604, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM
I20260812 17:43:24.902459 31862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:24.893513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50866 (local address 127.17.255.62:41677)
0812 17:43:24.893663 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:24.893668 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:24.893781 (+ 113us) server_negotiation.cc:407] Connection header received
0812 17:43:24.893933 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:24.893936 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:24.893987 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:24.894069 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:24.894761 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:24.895279 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:24.896081 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:24.896309 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:24.896420 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:24.898950 (+ 2530us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:24.898954 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:24.898956 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:24.898981 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:24.900620 (+ 1639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:24.901075 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:24.901079 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:24.901081 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:24.901170 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:24.901488 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:24.901492 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:24.901494 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:24.901699 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:24.901843 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:24.902119 (+ 276us) server_negotiation.cc:299] Negotiation successful
0812 17:43:24.902263 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 17:43:24.905380 30910 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50866:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 17:43:24.905898 30910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 17:43:24.912264 31403 tablet_service.cc:1467] Processing CreateTablet for tablet bd9024f05f3a4f54a4127bff2eb38fcf (DEFAULT_TABLE table=test-table [id=7b6ced7e4cdd4902bbaa7db1975c0946]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:43:24.912264 31162 tablet_service.cc:1467] Processing CreateTablet for tablet bd9024f05f3a4f54a4127bff2eb38fcf (DEFAULT_TABLE table=test-table [id=7b6ced7e4cdd4902bbaa7db1975c0946]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:43:24.912587 31403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd9024f05f3a4f54a4127bff2eb38fcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:24.912587 31162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd9024f05f3a4f54a4127bff2eb38fcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:24.912607 31649 tablet_service.cc:1467] Processing CreateTablet for tablet bd9024f05f3a4f54a4127bff2eb38fcf (DEFAULT_TABLE table=test-table [id=7b6ced7e4cdd4902bbaa7db1975c0946]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:43:24.912936 31649 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd9024f05f3a4f54a4127bff2eb38fcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:24.915181 31804 tablet_bootstrap.cc:492] T bd9024f05f3a4f54a4127bff2eb38fcf P 89fc3d55f1b0460f9c19d623174d7a9b: Bootstrap starting.
I20260812 17:43:24.915361 31805 tablet_bootstrap.cc:492] T bd9024f05f3a4f54a4127bff2eb38fcf P 31ff7ae726e34549b561cfb734322abb: Bootstrap starting.
I20260812 17:43:24.915701 31803 tablet_bootstrap.cc:492] T bd9024f05f3a4f54a4127bff2eb38fcf P c41d3008007e49d6b3870288bd94d238: Bootstrap starting.
I20260812 17:43:24.916265 31804 tablet_bootstrap.cc:654] T bd9024f05f3a4f54a4127bff2eb38fcf P 89fc3d55f1b0460f9c19d623174d7a9b: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:24.916288 31805 tablet_bootstrap.cc:654] T bd9024f05f3a4f54a4127bff2eb38fcf P 31ff7ae726e34549b561cfb734322abb: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:24.916733 31803 tablet_bootstrap.cc:654] T bd9024f05f3a4f54a4127bff2eb38fcf P c41d3008007e49d6b3870288bd94d238: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:24.917513 31804 tablet_bootstrap.cc:492] T bd9024f05f3a4f54a4127bff2eb38fcf P 89fc3d55f1b0460f9c19d623174d7a9b: No bootstrap required, opened a new log
I20260812 17:43:24.917622 31804 ts_tablet_manager.cc:1397] T bd9024f05f3a4f54a4127bff2eb38fcf P 89fc3d55f1b0460f9c19d623174d7a9b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 17:43:24.917879 31803 tablet_bootstrap.cc:492] T bd9024f05f3a4f54a4127bff2eb38fcf P c41d3008007e49d6b3870288bd94d238: No bootstrap required, opened a new log
I20260812 17:43:24.917959 31803 ts_tablet_manager.cc:1397] T bd9024f05f3a4f54a4127bff2eb38fcf P c41d3008007e49d6b3870288bd94d238: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 17:43:24.918007 31805 tablet_bootstrap.cc:492] T bd9024f05f3a4f54a4127bff2eb38fcf P 31ff7ae726e34549b561cfb734322abb: No bootstrap required, opened a new log
I20260812 17:43:24.918071 31805 ts_tablet_manager.cc:1397] T bd9024f05f3a4f54a4127bff2eb38fcf P 31ff7ae726e34549b561cfb734322abb: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260812 17:43:24.918175 31804 raft_consensus.cc:348] T bd9024f05f3a4f54a4127bff2eb38fcf P 89fc3d55f1b0460f9c19d623174d7a9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } }
I20260812 17:43:24.918290 31804 raft_consensus.cc:374] T bd9024f05f3a4f54a4127bff2eb38fcf P 89fc3d55f1b0460f9c19d623174d7a9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:24.918327 31804 raft_consensus.cc:729] T bd9024f05f3a4f54a4127bff2eb38fcf P 89fc3d55f1b0460f9c19d623174d7a9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89fc3d55f1b0460f9c19d623174d7a9b, State: Initialized, Role: FOLLOWER
I20260812 17:43:24.918350 31803 raft_consensus.cc:348] T bd9024f05f3a4f54a4127bff2eb38fcf P c41d3008007e49d6b3870288bd94d238 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } }
I20260812 17:43:24.918452 31805 raft_consensus.cc:348] T bd9024f05f3a4f54a4127bff2eb38fcf P 31ff7ae726e34549b561cfb734322abb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } }
I20260812 17:43:24.918541 31805 raft_consensus.cc:374] T bd9024f05f3a4f54a4127bff2eb38fcf P 31ff7ae726e34549b561cfb734322abb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:24.918530 31803 raft_consensus.cc:374] T bd9024f05f3a4f54a4127bff2eb38fcf P c41d3008007e49d6b3870288bd94d238 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:24.918563 31805 raft_consensus.cc:729] T bd9024f05f3a4f54a4127bff2eb38fcf P 31ff7ae726e34549b561cfb734322abb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31ff7ae726e34549b561cfb734322abb, State: Initialized, Role: FOLLOWER
I20260812 17:43:24.918568 31803 raft_consensus.cc:729] T bd9024f05f3a4f54a4127bff2eb38fcf P c41d3008007e49d6b3870288bd94d238 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c41d3008007e49d6b3870288bd94d238, State: Initialized, Role: FOLLOWER
I20260812 17:43:24.918587 31804 consensus_queue.cc:260] T bd9024f05f3a4f54a4127bff2eb38fcf P 89fc3d55f1b0460f9c19d623174d7a9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } }
I20260812 17:43:24.918694 31805 consensus_queue.cc:260] T bd9024f05f3a4f54a4127bff2eb38fcf P 31ff7ae726e34549b561cfb734322abb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } }
I20260812 17:43:24.918704 31803 consensus_queue.cc:260] T bd9024f05f3a4f54a4127bff2eb38fcf P c41d3008007e49d6b3870288bd94d238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } }
I20260812 17:43:24.919003 31805 ts_tablet_manager.cc:1428] T bd9024f05f3a4f54a4127bff2eb38fcf P 31ff7ae726e34549b561cfb734322abb: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260812 17:43:24.919534 31804 ts_tablet_manager.cc:1428] T bd9024f05f3a4f54a4127bff2eb38fcf P 89fc3d55f1b0460f9c19d623174d7a9b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260812 17:43:24.920729 31803 ts_tablet_manager.cc:1428] T bd9024f05f3a4f54a4127bff2eb38fcf P c41d3008007e49d6b3870288bd94d238: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260812 17:43:24.949090 31917 raft_consensus.cc:482] T bd9024f05f3a4f54a4127bff2eb38fcf P c41d3008007e49d6b3870288bd94d238 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:43:24.949255 31917 raft_consensus.cc:504] T bd9024f05f3a4f54a4127bff2eb38fcf P c41d3008007e49d6b3870288bd94d238 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } }
I20260812 17:43:24.949772 31917 leader_election.cc:288] T bd9024f05f3a4f54a4127bff2eb38fcf P c41d3008007e49d6b3870288bd94d238 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31ff7ae726e34549b561cfb734322abb (127.17.255.1:34119), 89fc3d55f1b0460f9c19d623174d7a9b (127.17.255.2:44971)
I20260812 17:43:24.950286 31198 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd9024f05f3a4f54a4127bff2eb38fcf" candidate_uuid: "c41d3008007e49d6b3870288bd94d238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31ff7ae726e34549b561cfb734322abb" is_pre_election: true
I20260812 17:43:24.950325 31437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd9024f05f3a4f54a4127bff2eb38fcf" candidate_uuid: "c41d3008007e49d6b3870288bd94d238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" is_pre_election: true
I20260812 17:43:24.950513 31198 raft_consensus.cc:2454] T bd9024f05f3a4f54a4127bff2eb38fcf P 31ff7ae726e34549b561cfb734322abb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c41d3008007e49d6b3870288bd94d238 in term 0.
I20260812 17:43:24.950513 31437 raft_consensus.cc:2454] T bd9024f05f3a4f54a4127bff2eb38fcf P 89fc3d55f1b0460f9c19d623174d7a9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c41d3008007e49d6b3870288bd94d238 in term 0.
I20260812 17:43:24.950867 31563 leader_election.cc:302] T bd9024f05f3a4f54a4127bff2eb38fcf P c41d3008007e49d6b3870288bd94d238 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89fc3d55f1b0460f9c19d623174d7a9b, c41d3008007e49d6b3870288bd94d238; no voters:
I20260812 17:43:24.951073 31917 raft_consensus.cc:2781] T bd9024f05f3a4f54a4127bff2eb38fcf P c41d3008007e49d6b3870288bd94d238 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 17:43:24.951152 31917 raft_consensus.cc:482] T bd9024f05f3a4f54a4127bff2eb38fcf P c41d3008007e49d6b3870288bd94d238 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 17:43:24.951215 31917 raft_consensus.cc:3037] T bd9024f05f3a4f54a4127bff2eb38fcf P c41d3008007e49d6b3870288bd94d238 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:24.952407 31917 raft_consensus.cc:504] T bd9024f05f3a4f54a4127bff2eb38fcf P c41d3008007e49d6b3870288bd94d238 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } }
I20260812 17:43:24.952859 31917 leader_election.cc:288] T bd9024f05f3a4f54a4127bff2eb38fcf P c41d3008007e49d6b3870288bd94d238 [CANDIDATE]: Term 1 election: Requested vote from peers 31ff7ae726e34549b561cfb734322abb (127.17.255.1:34119), 89fc3d55f1b0460f9c19d623174d7a9b (127.17.255.2:44971)
I20260812 17:43:24.953312 31198 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd9024f05f3a4f54a4127bff2eb38fcf" candidate_uuid: "c41d3008007e49d6b3870288bd94d238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31ff7ae726e34549b561cfb734322abb"
I20260812 17:43:24.953439 31198 raft_consensus.cc:3037] T bd9024f05f3a4f54a4127bff2eb38fcf P 31ff7ae726e34549b561cfb734322abb [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:24.953344 31437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd9024f05f3a4f54a4127bff2eb38fcf" candidate_uuid: "c41d3008007e49d6b3870288bd94d238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89fc3d55f1b0460f9c19d623174d7a9b"
I20260812 17:43:24.953608 31437 raft_consensus.cc:3037] T bd9024f05f3a4f54a4127bff2eb38fcf P 89fc3d55f1b0460f9c19d623174d7a9b [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:24.954591 31198 raft_consensus.cc:2454] T bd9024f05f3a4f54a4127bff2eb38fcf P 31ff7ae726e34549b561cfb734322abb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c41d3008007e49d6b3870288bd94d238 in term 1.
I20260812 17:43:24.954990 31437 raft_consensus.cc:2454] T bd9024f05f3a4f54a4127bff2eb38fcf P 89fc3d55f1b0460f9c19d623174d7a9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c41d3008007e49d6b3870288bd94d238 in term 1.
I20260812 17:43:24.955061 31571 leader_election.cc:302] T bd9024f05f3a4f54a4127bff2eb38fcf P c41d3008007e49d6b3870288bd94d238 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ff7ae726e34549b561cfb734322abb, c41d3008007e49d6b3870288bd94d238; no voters:
I20260812 17:43:24.955402 31917 raft_consensus.cc:2781] T bd9024f05f3a4f54a4127bff2eb38fcf P c41d3008007e49d6b3870288bd94d238 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:43:24.955528 31917 raft_consensus.cc:686] T bd9024f05f3a4f54a4127bff2eb38fcf P c41d3008007e49d6b3870288bd94d238 [term 1 LEADER]: Becoming Leader. State: Replica: c41d3008007e49d6b3870288bd94d238, State: Running, Role: LEADER
I20260812 17:43:24.955693 31917 consensus_queue.cc:237] T bd9024f05f3a4f54a4127bff2eb38fcf P c41d3008007e49d6b3870288bd94d238 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } }
I20260812 17:43:24.957530 30913 catalog_manager.cc:5495] T bd9024f05f3a4f54a4127bff2eb38fcf P c41d3008007e49d6b3870288bd94d238 reported cstate change: term changed from 0 to 1, leader changed from <none> to c41d3008007e49d6b3870288bd94d238 (127.17.255.3). New cstate: current_term: 1 leader_uuid: "c41d3008007e49d6b3870288bd94d238" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } health_report { overall_health: HEALTHY } } }
I20260812 17:43:24.975656 31875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:24.972805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35390 (local address 127.17.255.3:46087)
0812 17:43:24.972927 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:24.972931 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:24.972945 (+ 14us) server_negotiation.cc:407] Connection header received
0812 17:43:24.973020 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:24.973022 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:24.973099 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:24.973182 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:43:24.973408 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:24.973912 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:24.974802 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:24.975018 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:24.975095 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:24.975308 (+ 213us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:43:24.975374 (+ 66us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:43:24.975425 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:24.975504 (+ 79us) server_negotiation.cc:299] Negotiation successful
0812 17:43:24.975546 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 17:43:24.977675 31437 raft_consensus.cc:1261] T bd9024f05f3a4f54a4127bff2eb38fcf P 89fc3d55f1b0460f9c19d623174d7a9b [term 1 FOLLOWER]: Refusing update from remote peer c41d3008007e49d6b3870288bd94d238: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:43:24.977703 31198 raft_consensus.cc:1261] T bd9024f05f3a4f54a4127bff2eb38fcf P 31ff7ae726e34549b561cfb734322abb [term 1 FOLLOWER]: Refusing update from remote peer c41d3008007e49d6b3870288bd94d238: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:43:24.978178 31811 consensus_queue.cc:1035] T bd9024f05f3a4f54a4127bff2eb38fcf P c41d3008007e49d6b3870288bd94d238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:43:24.978363 31917 consensus_queue.cc:1035] T bd9024f05f3a4f54a4127bff2eb38fcf P c41d3008007e49d6b3870288bd94d238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:43:24.986122 30910 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50866:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:43:24.986261 30910 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50866:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:43:24.988346 30910 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e1909aaadb58413f8fba81c9ca9d8f36: Sending DeleteTablet for 3 replicas of tablet bd9024f05f3a4f54a4127bff2eb38fcf
I20260812 17:43:24.988969 31162 tablet_service.cc:1514] Processing DeleteTablet for tablet bd9024f05f3a4f54a4127bff2eb38fcf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:43:24 UTC) from {username='oryx', principal='oryx/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:33296
I20260812 17:43:24.989054 31649 tablet_service.cc:1514] Processing DeleteTablet for tablet bd9024f05f3a4f54a4127bff2eb38fcf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:43:24 UTC) from {username='oryx', principal='oryx/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:35362
I20260812 17:43:24.989163 31920 tablet_replica.cc:330] T bd9024f05f3a4f54a4127bff2eb38fcf P 31ff7ae726e34549b561cfb734322abb: stopping tablet replica
I20260812 17:43:24.989233 31921 tablet_replica.cc:330] T bd9024f05f3a4f54a4127bff2eb38fcf P c41d3008007e49d6b3870288bd94d238: stopping tablet replica
I20260812 17:43:24.989291 31920 raft_consensus.cc:2229] T bd9024f05f3a4f54a4127bff2eb38fcf P 31ff7ae726e34549b561cfb734322abb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:43:24.989413 31921 raft_consensus.cc:2229] T bd9024f05f3a4f54a4127bff2eb38fcf P c41d3008007e49d6b3870288bd94d238 [term 1 LEADER]: Raft consensus shutting down.
I20260812 17:43:24.989445 31920 raft_consensus.cc:2258] T bd9024f05f3a4f54a4127bff2eb38fcf P 31ff7ae726e34549b561cfb734322abb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:43:24.989565 31403 tablet_service.cc:1514] Processing DeleteTablet for tablet bd9024f05f3a4f54a4127bff2eb38fcf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:43:24 UTC) from {username='oryx', principal='oryx/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:43338
I20260812 17:43:24.989648 31921 raft_consensus.cc:2258] T bd9024f05f3a4f54a4127bff2eb38fcf P c41d3008007e49d6b3870288bd94d238 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:43:24.989985 31923 tablet_replica.cc:330] T bd9024f05f3a4f54a4127bff2eb38fcf P 89fc3d55f1b0460f9c19d623174d7a9b: stopping tablet replica
I20260812 17:43:24.990120 31923 raft_consensus.cc:2229] T bd9024f05f3a4f54a4127bff2eb38fcf P 89fc3d55f1b0460f9c19d623174d7a9b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:43:24.990288 31923 raft_consensus.cc:2258] T bd9024f05f3a4f54a4127bff2eb38fcf P 89fc3d55f1b0460f9c19d623174d7a9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:43:24.990408 31921 ts_tablet_manager.cc:1905] T bd9024f05f3a4f54a4127bff2eb38fcf P c41d3008007e49d6b3870288bd94d238: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:43:24.990298 30910 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50866:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 17:43:24.990741 30910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 17:43:24.991081 31920 ts_tablet_manager.cc:1905] T bd9024f05f3a4f54a4127bff2eb38fcf P 31ff7ae726e34549b561cfb734322abb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:43:24.991081 31923 ts_tablet_manager.cc:1905] T bd9024f05f3a4f54a4127bff2eb38fcf P 89fc3d55f1b0460f9c19d623174d7a9b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:43:24.993111 31921 ts_tablet_manager.cc:1918] T bd9024f05f3a4f54a4127bff2eb38fcf P c41d3008007e49d6b3870288bd94d238: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 17:43:24.993187 31921 log.cc:1196] T bd9024f05f3a4f54a4127bff2eb38fcf P c41d3008007e49d6b3870288bd94d238: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-2/wal/wals/bd9024f05f3a4f54a4127bff2eb38fcf
I20260812 17:43:24.993463 31921 ts_tablet_manager.cc:1939] T bd9024f05f3a4f54a4127bff2eb38fcf P c41d3008007e49d6b3870288bd94d238: Deleting consensus metadata
I20260812 17:43:24.993571 31923 ts_tablet_manager.cc:1918] T bd9024f05f3a4f54a4127bff2eb38fcf P 89fc3d55f1b0460f9c19d623174d7a9b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 17:43:24.993571 31920 ts_tablet_manager.cc:1918] T bd9024f05f3a4f54a4127bff2eb38fcf P 31ff7ae726e34549b561cfb734322abb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 17:43:24.993649 31923 log.cc:1196] T bd9024f05f3a4f54a4127bff2eb38fcf P 89fc3d55f1b0460f9c19d623174d7a9b: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-1/wal/wals/bd9024f05f3a4f54a4127bff2eb38fcf
I20260812 17:43:24.993649 31920 log.cc:1196] T bd9024f05f3a4f54a4127bff2eb38fcf P 31ff7ae726e34549b561cfb734322abb: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-0/wal/wals/bd9024f05f3a4f54a4127bff2eb38fcf
I20260812 17:43:24.993920 31923 ts_tablet_manager.cc:1939] T bd9024f05f3a4f54a4127bff2eb38fcf P 89fc3d55f1b0460f9c19d623174d7a9b: Deleting consensus metadata
I20260812 17:43:24.993934 31920 ts_tablet_manager.cc:1939] T bd9024f05f3a4f54a4127bff2eb38fcf P 31ff7ae726e34549b561cfb734322abb: Deleting consensus metadata
I20260812 17:43:24.994491 30889 catalog_manager.cc:4841] TS c41d3008007e49d6b3870288bd94d238 (127.17.255.3:46087): tablet bd9024f05f3a4f54a4127bff2eb38fcf (table test-table [id=7b6ced7e4cdd4902bbaa7db1975c0946]) successfully deleted
I20260812 17:43:24.994776 30885 catalog_manager.cc:4841] TS 89fc3d55f1b0460f9c19d623174d7a9b (127.17.255.2:44971): tablet bd9024f05f3a4f54a4127bff2eb38fcf (table test-table [id=7b6ced7e4cdd4902bbaa7db1975c0946]) successfully deleted
I20260812 17:43:24.995558 30889 catalog_manager.cc:4841] TS 31ff7ae726e34549b561cfb734322abb (127.17.255.1:34119): tablet bd9024f05f3a4f54a4127bff2eb38fcf (table test-table [id=7b6ced7e4cdd4902bbaa7db1975c0946]) successfully deleted
I20260812 17:43:24.995862 31403 tablet_service.cc:1467] Processing CreateTablet for tablet fbdef6017e9942f08fd7b96fdfb94c89 (DEFAULT_TABLE table=test-table [id=38166acd7f7944849a33874c29f07c09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:43:24.995921 31162 tablet_service.cc:1467] Processing CreateTablet for tablet fbdef6017e9942f08fd7b96fdfb94c89 (DEFAULT_TABLE table=test-table [id=38166acd7f7944849a33874c29f07c09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:43:24.996152 31403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbdef6017e9942f08fd7b96fdfb94c89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:24.996170 31162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbdef6017e9942f08fd7b96fdfb94c89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:24.997917 31804 tablet_bootstrap.cc:492] T fbdef6017e9942f08fd7b96fdfb94c89 P 89fc3d55f1b0460f9c19d623174d7a9b: Bootstrap starting.
I20260812 17:43:24.998005 31805 tablet_bootstrap.cc:492] T fbdef6017e9942f08fd7b96fdfb94c89 P 31ff7ae726e34549b561cfb734322abb: Bootstrap starting.
I20260812 17:43:24.998651 31649 tablet_service.cc:1467] Processing CreateTablet for tablet fbdef6017e9942f08fd7b96fdfb94c89 (DEFAULT_TABLE table=test-table [id=38166acd7f7944849a33874c29f07c09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:43:24.998859 31805 tablet_bootstrap.cc:654] T fbdef6017e9942f08fd7b96fdfb94c89 P 31ff7ae726e34549b561cfb734322abb: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:24.998868 31804 tablet_bootstrap.cc:654] T fbdef6017e9942f08fd7b96fdfb94c89 P 89fc3d55f1b0460f9c19d623174d7a9b: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:24.998960 31649 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbdef6017e9942f08fd7b96fdfb94c89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:25.000087 31804 tablet_bootstrap.cc:492] T fbdef6017e9942f08fd7b96fdfb94c89 P 89fc3d55f1b0460f9c19d623174d7a9b: No bootstrap required, opened a new log
I20260812 17:43:25.000156 31804 ts_tablet_manager.cc:1397] T fbdef6017e9942f08fd7b96fdfb94c89 P 89fc3d55f1b0460f9c19d623174d7a9b: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260812 17:43:25.000293 31805 tablet_bootstrap.cc:492] T fbdef6017e9942f08fd7b96fdfb94c89 P 31ff7ae726e34549b561cfb734322abb: No bootstrap required, opened a new log
I20260812 17:43:25.000401 31805 ts_tablet_manager.cc:1397] T fbdef6017e9942f08fd7b96fdfb94c89 P 31ff7ae726e34549b561cfb734322abb: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260812 17:43:25.000578 31804 raft_consensus.cc:348] T fbdef6017e9942f08fd7b96fdfb94c89 P 89fc3d55f1b0460f9c19d623174d7a9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } }
I20260812 17:43:25.000710 31804 raft_consensus.cc:374] T fbdef6017e9942f08fd7b96fdfb94c89 P 89fc3d55f1b0460f9c19d623174d7a9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:25.000746 31804 raft_consensus.cc:729] T fbdef6017e9942f08fd7b96fdfb94c89 P 89fc3d55f1b0460f9c19d623174d7a9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89fc3d55f1b0460f9c19d623174d7a9b, State: Initialized, Role: FOLLOWER
I20260812 17:43:25.000795 31805 raft_consensus.cc:348] T fbdef6017e9942f08fd7b96fdfb94c89 P 31ff7ae726e34549b561cfb734322abb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } }
I20260812 17:43:25.000850 31804 consensus_queue.cc:260] T fbdef6017e9942f08fd7b96fdfb94c89 P 89fc3d55f1b0460f9c19d623174d7a9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } }
I20260812 17:43:25.000900 31805 raft_consensus.cc:374] T fbdef6017e9942f08fd7b96fdfb94c89 P 31ff7ae726e34549b561cfb734322abb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:25.000929 31805 raft_consensus.cc:729] T fbdef6017e9942f08fd7b96fdfb94c89 P 31ff7ae726e34549b561cfb734322abb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31ff7ae726e34549b561cfb734322abb, State: Initialized, Role: FOLLOWER
I20260812 17:43:25.001109 31804 ts_tablet_manager.cc:1428] T fbdef6017e9942f08fd7b96fdfb94c89 P 89fc3d55f1b0460f9c19d623174d7a9b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260812 17:43:25.001060 31805 consensus_queue.cc:260] T fbdef6017e9942f08fd7b96fdfb94c89 P 31ff7ae726e34549b561cfb734322abb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } }
I20260812 17:43:25.001350 31805 ts_tablet_manager.cc:1428] T fbdef6017e9942f08fd7b96fdfb94c89 P 31ff7ae726e34549b561cfb734322abb: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 17:43:25.001427 31803 tablet_bootstrap.cc:492] T fbdef6017e9942f08fd7b96fdfb94c89 P c41d3008007e49d6b3870288bd94d238: Bootstrap starting.
I20260812 17:43:25.002276 31803 tablet_bootstrap.cc:654] T fbdef6017e9942f08fd7b96fdfb94c89 P c41d3008007e49d6b3870288bd94d238: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:25.003530 31803 tablet_bootstrap.cc:492] T fbdef6017e9942f08fd7b96fdfb94c89 P c41d3008007e49d6b3870288bd94d238: No bootstrap required, opened a new log
I20260812 17:43:25.003618 31803 ts_tablet_manager.cc:1397] T fbdef6017e9942f08fd7b96fdfb94c89 P c41d3008007e49d6b3870288bd94d238: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 17:43:25.003988 31803 raft_consensus.cc:348] T fbdef6017e9942f08fd7b96fdfb94c89 P c41d3008007e49d6b3870288bd94d238 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } }
I20260812 17:43:25.004099 31803 raft_consensus.cc:374] T fbdef6017e9942f08fd7b96fdfb94c89 P c41d3008007e49d6b3870288bd94d238 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:25.004127 31803 raft_consensus.cc:729] T fbdef6017e9942f08fd7b96fdfb94c89 P c41d3008007e49d6b3870288bd94d238 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c41d3008007e49d6b3870288bd94d238, State: Initialized, Role: FOLLOWER
I20260812 17:43:25.004240 31803 consensus_queue.cc:260] T fbdef6017e9942f08fd7b96fdfb94c89 P c41d3008007e49d6b3870288bd94d238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } }
I20260812 17:43:25.004513 31803 ts_tablet_manager.cc:1428] T fbdef6017e9942f08fd7b96fdfb94c89 P c41d3008007e49d6b3870288bd94d238: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 17:43:25.164757 31812 raft_consensus.cc:482] T fbdef6017e9942f08fd7b96fdfb94c89 P 31ff7ae726e34549b561cfb734322abb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:43:25.164914 31812 raft_consensus.cc:504] T fbdef6017e9942f08fd7b96fdfb94c89 P 31ff7ae726e34549b561cfb734322abb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } }
I20260812 17:43:25.165334 31812 leader_election.cc:288] T fbdef6017e9942f08fd7b96fdfb94c89 P 31ff7ae726e34549b561cfb734322abb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89fc3d55f1b0460f9c19d623174d7a9b (127.17.255.2:44971), c41d3008007e49d6b3870288bd94d238 (127.17.255.3:46087)
I20260812 17:43:25.165941 31677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbdef6017e9942f08fd7b96fdfb94c89" candidate_uuid: "31ff7ae726e34549b561cfb734322abb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41d3008007e49d6b3870288bd94d238" is_pre_election: true
I20260812 17:43:25.165940 31437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbdef6017e9942f08fd7b96fdfb94c89" candidate_uuid: "31ff7ae726e34549b561cfb734322abb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" is_pre_election: true
I20260812 17:43:25.166118 31677 raft_consensus.cc:2454] T fbdef6017e9942f08fd7b96fdfb94c89 P c41d3008007e49d6b3870288bd94d238 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ff7ae726e34549b561cfb734322abb in term 0.
I20260812 17:43:25.166118 31437 raft_consensus.cc:2454] T fbdef6017e9942f08fd7b96fdfb94c89 P 89fc3d55f1b0460f9c19d623174d7a9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ff7ae726e34549b561cfb734322abb in term 0.
I20260812 17:43:25.166507 31073 leader_election.cc:302] T fbdef6017e9942f08fd7b96fdfb94c89 P 31ff7ae726e34549b561cfb734322abb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ff7ae726e34549b561cfb734322abb, 89fc3d55f1b0460f9c19d623174d7a9b; no voters:
I20260812 17:43:25.166728 31812 raft_consensus.cc:2781] T fbdef6017e9942f08fd7b96fdfb94c89 P 31ff7ae726e34549b561cfb734322abb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 17:43:25.166801 31812 raft_consensus.cc:482] T fbdef6017e9942f08fd7b96fdfb94c89 P 31ff7ae726e34549b561cfb734322abb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 17:43:25.166834 31812 raft_consensus.cc:3037] T fbdef6017e9942f08fd7b96fdfb94c89 P 31ff7ae726e34549b561cfb734322abb [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:25.167868 31812 raft_consensus.cc:504] T fbdef6017e9942f08fd7b96fdfb94c89 P 31ff7ae726e34549b561cfb734322abb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } }
I20260812 17:43:25.168226 31812 leader_election.cc:288] T fbdef6017e9942f08fd7b96fdfb94c89 P 31ff7ae726e34549b561cfb734322abb [CANDIDATE]: Term 1 election: Requested vote from peers 89fc3d55f1b0460f9c19d623174d7a9b (127.17.255.2:44971), c41d3008007e49d6b3870288bd94d238 (127.17.255.3:46087)
I20260812 17:43:25.168591 31437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbdef6017e9942f08fd7b96fdfb94c89" candidate_uuid: "31ff7ae726e34549b561cfb734322abb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89fc3d55f1b0460f9c19d623174d7a9b"
I20260812 17:43:25.168701 31437 raft_consensus.cc:3037] T fbdef6017e9942f08fd7b96fdfb94c89 P 89fc3d55f1b0460f9c19d623174d7a9b [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:25.168727 31677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbdef6017e9942f08fd7b96fdfb94c89" candidate_uuid: "31ff7ae726e34549b561cfb734322abb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41d3008007e49d6b3870288bd94d238"
I20260812 17:43:25.168905 31677 raft_consensus.cc:3037] T fbdef6017e9942f08fd7b96fdfb94c89 P c41d3008007e49d6b3870288bd94d238 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:25.169691 31437 raft_consensus.cc:2454] T fbdef6017e9942f08fd7b96fdfb94c89 P 89fc3d55f1b0460f9c19d623174d7a9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ff7ae726e34549b561cfb734322abb in term 1.
I20260812 17:43:25.169996 31677 raft_consensus.cc:2454] T fbdef6017e9942f08fd7b96fdfb94c89 P c41d3008007e49d6b3870288bd94d238 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ff7ae726e34549b561cfb734322abb in term 1.
I20260812 17:43:25.169996 31073 leader_election.cc:302] T fbdef6017e9942f08fd7b96fdfb94c89 P 31ff7ae726e34549b561cfb734322abb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ff7ae726e34549b561cfb734322abb, 89fc3d55f1b0460f9c19d623174d7a9b; no voters:
I20260812 17:43:25.170179 31812 raft_consensus.cc:2781] T fbdef6017e9942f08fd7b96fdfb94c89 P 31ff7ae726e34549b561cfb734322abb [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:43:25.170296 31812 raft_consensus.cc:686] T fbdef6017e9942f08fd7b96fdfb94c89 P 31ff7ae726e34549b561cfb734322abb [term 1 LEADER]: Becoming Leader. State: Replica: 31ff7ae726e34549b561cfb734322abb, State: Running, Role: LEADER
I20260812 17:43:25.170493 31812 consensus_queue.cc:237] T fbdef6017e9942f08fd7b96fdfb94c89 P 31ff7ae726e34549b561cfb734322abb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } }
I20260812 17:43:25.172523 30906 catalog_manager.cc:5495] T fbdef6017e9942f08fd7b96fdfb94c89 P 31ff7ae726e34549b561cfb734322abb reported cstate change: term changed from 0 to 1, leader changed from <none> to 31ff7ae726e34549b561cfb734322abb (127.17.255.1). New cstate: current_term: 1 leader_uuid: "31ff7ae726e34549b561cfb734322abb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ff7ae726e34549b561cfb734322abb" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 } health_report { overall_health: UNKNOWN } } }
I20260812 17:43:25.207954 31884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:25.204792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33322 (local address 127.17.255.1:34119)
0812 17:43:25.205084 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:25.205087 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:25.205097 (+ 10us) server_negotiation.cc:407] Connection header received
0812 17:43:25.205132 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:25.205134 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:25.205172 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:25.205260 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:43:25.205525 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:25.206045 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:25.206952 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:25.207180 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:25.207260 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:25.207510 (+ 250us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:43:25.207580 (+ 70us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:43:25.207637 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:25.207801 (+ 164us) server_negotiation.cc:299] Negotiation successful
0812 17:43:25.207848 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":224}
I20260812 17:43:25.216746 31913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:25.213572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:34119 (local address 127.17.255.1:44365)
0812 17:43:25.213738 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:25.213754 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:25.213842 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:25.214073 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:25.214076 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:25.214082 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 17:43:25.214211 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:25.214216 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:25.215009 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:25.215014 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:25.215608 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:25.215616 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:25.216078 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:25.216082 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:25.216185 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:25.216217 (+ 32us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 17:43:25.216484 (+ 267us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 17:43:25.216492 (+ 8us) client_negotiation.cc:769] Sending connection context
0812 17:43:25.216552 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 17:43:25.216626 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59,"mutex_wait_us":24}
I20260812 17:43:25.216746 31884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:25.213630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:44365 (local address 127.17.255.1:34119)
0812 17:43:25.213734 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:25.213738 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:25.213797 (+ 59us) server_negotiation.cc:407] Connection header received
0812 17:43:25.213934 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:25.213937 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:25.213985 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:25.214065 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:43:25.214318 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:25.214905 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:25.215725 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:25.215975 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:25.216081 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:25.216326 (+ 245us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:43:25.216394 (+ 68us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:43:25.216475 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:25.216558 (+ 83us) server_negotiation.cc:299] Negotiation successful
0812 17:43:25.216598 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":42,"server-negotiator.queue_time_us":40}
I20260812 17:43:25.222627 31677 raft_consensus.cc:1261] T fbdef6017e9942f08fd7b96fdfb94c89 P c41d3008007e49d6b3870288bd94d238 [term 1 FOLLOWER]: Refusing update from remote peer 31ff7ae726e34549b561cfb734322abb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:43:25.222730 31437 raft_consensus.cc:1261] T fbdef6017e9942f08fd7b96fdfb94c89 P 89fc3d55f1b0460f9c19d623174d7a9b [term 1 FOLLOWER]: Refusing update from remote peer 31ff7ae726e34549b561cfb734322abb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:43:25.223035 31965 consensus_queue.cc:1035] T fbdef6017e9942f08fd7b96fdfb94c89 P 31ff7ae726e34549b561cfb734322abb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c41d3008007e49d6b3870288bd94d238" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:43:25.223275 31877 consensus_queue.cc:1035] T fbdef6017e9942f08fd7b96fdfb94c89 P 31ff7ae726e34549b561cfb734322abb [LEADER]: Connected to new peer: Peer: permanent_uuid: "89fc3d55f1b0460f9c19d623174d7a9b" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 44971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:43:25.258139 30910 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50866:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:43:25.258325 30910 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50866:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:43:25.260728 30910 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e1909aaadb58413f8fba81c9ca9d8f36: Sending DeleteTablet for 3 replicas of tablet fbdef6017e9942f08fd7b96fdfb94c89
I20260812 17:43:25.261479 31403 tablet_service.cc:1514] Processing DeleteTablet for tablet fbdef6017e9942f08fd7b96fdfb94c89 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:43:25 UTC) from {username='oryx', principal='oryx/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:43338
I20260812 17:43:25.261503 31161 tablet_service.cc:1514] Processing DeleteTablet for tablet fbdef6017e9942f08fd7b96fdfb94c89 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:43:25 UTC) from {username='oryx', principal='oryx/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:33296
I20260812 17:43:25.261693 31920 tablet_replica.cc:330] T fbdef6017e9942f08fd7b96fdfb94c89 P 31ff7ae726e34549b561cfb734322abb: stopping tablet replica
I20260812 17:43:25.261689 31649 tablet_service.cc:1514] Processing DeleteTablet for tablet fbdef6017e9942f08fd7b96fdfb94c89 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:43:25 UTC) from {username='oryx', principal='oryx/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:35362
I20260812 17:43:25.261818 31920 raft_consensus.cc:2229] T fbdef6017e9942f08fd7b96fdfb94c89 P 31ff7ae726e34549b561cfb734322abb [term 1 LEADER]: Raft consensus shutting down.
I20260812 17:43:25.261899 31923 tablet_replica.cc:330] T fbdef6017e9942f08fd7b96fdfb94c89 P 89fc3d55f1b0460f9c19d623174d7a9b: stopping tablet replica
I20260812 17:43:25.261914 31921 tablet_replica.cc:330] T fbdef6017e9942f08fd7b96fdfb94c89 P c41d3008007e49d6b3870288bd94d238: stopping tablet replica
I20260812 17:43:25.262014 31923 raft_consensus.cc:2229] T fbdef6017e9942f08fd7b96fdfb94c89 P 89fc3d55f1b0460f9c19d623174d7a9b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:43:25.262050 31921 raft_consensus.cc:2229] T fbdef6017e9942f08fd7b96fdfb94c89 P c41d3008007e49d6b3870288bd94d238 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:43:25.262130 31923 raft_consensus.cc:2258] T fbdef6017e9942f08fd7b96fdfb94c89 P 89fc3d55f1b0460f9c19d623174d7a9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:43:25.262173 31921 raft_consensus.cc:2258] T fbdef6017e9942f08fd7b96fdfb94c89 P c41d3008007e49d6b3870288bd94d238 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:43:25.262174 31920 raft_consensus.cc:2258] T fbdef6017e9942f08fd7b96fdfb94c89 P 31ff7ae726e34549b561cfb734322abb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:43:25.262939 31920 ts_tablet_manager.cc:1905] T fbdef6017e9942f08fd7b96fdfb94c89 P 31ff7ae726e34549b561cfb734322abb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:43:25.263438 31923 ts_tablet_manager.cc:1905] T fbdef6017e9942f08fd7b96fdfb94c89 P 89fc3d55f1b0460f9c19d623174d7a9b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:43:25.264887 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 31044
I20260812 17:43:25.268783 31921 ts_tablet_manager.cc:1905] T fbdef6017e9942f08fd7b96fdfb94c89 P c41d3008007e49d6b3870288bd94d238: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:43:25.269434 31923 ts_tablet_manager.cc:1918] T fbdef6017e9942f08fd7b96fdfb94c89 P 89fc3d55f1b0460f9c19d623174d7a9b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 17:43:25.269510 31923 log.cc:1196] T fbdef6017e9942f08fd7b96fdfb94c89 P 89fc3d55f1b0460f9c19d623174d7a9b: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-1/wal/wals/fbdef6017e9942f08fd7b96fdfb94c89
I20260812 17:43:25.269743 31923 ts_tablet_manager.cc:1939] T fbdef6017e9942f08fd7b96fdfb94c89 P 89fc3d55f1b0460f9c19d623174d7a9b: Deleting consensus metadata
I20260812 17:43:25.272409 31921 ts_tablet_manager.cc:1918] T fbdef6017e9942f08fd7b96fdfb94c89 P c41d3008007e49d6b3870288bd94d238: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 17:43:25.272526 31921 log.cc:1196] T fbdef6017e9942f08fd7b96fdfb94c89 P c41d3008007e49d6b3870288bd94d238: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786556557564181-18428-0/minicluster-data/ts-2/wal/wals/fbdef6017e9942f08fd7b96fdfb94c89
I20260812 17:43:25.272853 31921 ts_tablet_manager.cc:1939] T fbdef6017e9942f08fd7b96fdfb94c89 P c41d3008007e49d6b3870288bd94d238: Deleting consensus metadata
I20260812 17:43:25.273835 30889 catalog_manager.cc:4841] TS c41d3008007e49d6b3870288bd94d238 (127.17.255.3:46087): tablet fbdef6017e9942f08fd7b96fdfb94c89 (table test-table [id=38166acd7f7944849a33874c29f07c09]) successfully deleted
I20260812 17:43:25.274217 30885 catalog_manager.cc:4841] TS 89fc3d55f1b0460f9c19d623174d7a9b (127.17.255.2:44971): tablet fbdef6017e9942f08fd7b96fdfb94c89 (table test-table [id=38166acd7f7944849a33874c29f07c09]) successfully deleted
I20260812 17:43:25.281965 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 31284
W20260812 17:43:25.281993 30889 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.255.1:34119 (error 108)
I20260812 17:43:25.300047 31978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:25.297976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:34119 (local address 127.0.0.1:33330)
0812 17:43:25.299736 (+ 1760us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:25.299881 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.1:34119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1634,"thread_start_us":1358,"threads_started":1}
W20260812 17:43:25.300244 30889 catalog_manager.cc:4584] TS 31ff7ae726e34549b561cfb734322abb (127.17.255.1:34119): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet fbdef6017e9942f08fd7b96fdfb94c89: Network error: Client connection negotiation failed: client connection to 127.17.255.1:34119: connect: Connection refused (error 111)
I20260812 17:43:25.309060 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 31537
I20260812 17:43:25.326300 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 30858
2026-08-12T17:43:25Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3969 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:43:25 dist-test-slave-tk9z krb5kdc[31983](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:43:25 dist-test-slave-tk9z krb5kdc[31983](info): set up 2 sockets
Aug 12 17:43:25 dist-test-slave-tk9z krb5kdc[31983](info): commencing operation
krb5kdc: starting...
W20260812 17:43:26.659641 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.288s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:43:26 dist-test-slave-tk9z krb5kdc[31983](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556606, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:43:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:43:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.255.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
I20260812 17:43:26.795501 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:40673
--webserver_interface=127.17.255.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:35565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:40673
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:43:26.919420 31998 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:26.919687 31998 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:26.919764 31998 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:26.923913 31998 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:43:26.923982 31998 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:26.924002 31998 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:26.924019 31998 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:43:26.924036 31998 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:43:26.929816 31998 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:35565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:40673
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:40673
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31998
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:26.931164 31998 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:26.932385 31998 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:26.941572 32006 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:26.941576 32010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:26.941557 32005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:26.941824 31998 server_base.cc:1034] running on GCE node
I20260812 17:43:26.942680 31998 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:26.943882 31998 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:26.945078 31998 hybrid_clock.cc:648] HybridClock initialized: now 1786556606945048 us; error 45 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-12T17:43:26Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1616 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:43:27 dist-test-slave-tk9z krb5kdc[32026](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:43:27 dist-test-slave-tk9z krb5kdc[32026](info): set up 2 sockets
Aug 12 17:43:27 dist-test-slave-tk9z krb5kdc[32026](info): commencing operation
krb5kdc: starting...
W20260812 17:43:28.250622 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.263s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:43:28 dist-test-slave-tk9z krb5kdc[32026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556608, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:43:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:43:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.255.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
I20260812 17:43:28.386723 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:44587
--webserver_interface=127.17.255.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:33221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:44587
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:43:28.506240 32062 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:28.506624 32062 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:28.506721 32062 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:28.510833 32062 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:43:28.510941 32062 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:28.510980 32062 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:28.511019 32062 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:43:28.511056 32062 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:43:28.516570 32062 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:33221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:44587
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:44587
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32062
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:28.517798 32062 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:28.518959 32062 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:28.527860 32074 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:28.528029 32062 server_base.cc:1034] running on GCE node
W20260812 17:43:28.527912 32072 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:28.527868 32068 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:28.528837 32062 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:28.529986 32062 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:28.531185 32062 hybrid_clock.cc:648] HybridClock initialized: now 1786556608531150 us; error 46 us; skew 500 ppm
Aug 12 17:43:28 dist-test-slave-tk9z krb5kdc[32026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556608, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:28.534191 32062 init.cc:377] Logged in from keytab as kudu/127.17.255.62@KRBTEST.COM (short username kudu)
I20260812 17:43:28.535455 32062 webserver.cc:460] Webserver started at http://127.17.255.62:43751/ using document root <none> and password file <none>
I20260812 17:43:28.536178 32062 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:28.536283 32062 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:28.536573 32062 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:28.538892 32062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "47a46b2b04f1491fb7111af526dbcf80"
format_stamp: "Formatted at 2026-08-12 17:43:28 on dist-test-slave-tk9z"
server_key: "876d26265002e1abc2b51530e47e3730"
server_key_iv: "c980bd83fd493d0f41ce55db016268df"
server_key_version: "encryptionkey@0"
I20260812 17:43:28.539518 32062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "47a46b2b04f1491fb7111af526dbcf80"
format_stamp: "Formatted at 2026-08-12 17:43:28 on dist-test-slave-tk9z"
server_key: "876d26265002e1abc2b51530e47e3730"
server_key_iv: "c980bd83fd493d0f41ce55db016268df"
server_key_version: "encryptionkey@0"
I20260812 17:43:28.543715 32062 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260812 17:43:28.546707 32085 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:28.548195 32062 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 17:43:28.548372 32062 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "47a46b2b04f1491fb7111af526dbcf80"
format_stamp: "Formatted at 2026-08-12 17:43:28 on dist-test-slave-tk9z"
server_key: "876d26265002e1abc2b51530e47e3730"
server_key_iv: "c980bd83fd493d0f41ce55db016268df"
server_key_version: "encryptionkey@0"
I20260812 17:43:28.548521 32062 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:28.565682 32062 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:28.568840 32062 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:28.569070 32062 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:28.576534 32062 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:44587
I20260812 17:43:28.576551 32188 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:44587 every 8 connection(s)
I20260812 17:43:28.577572 32062 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:43:28.580574 32189 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:28.585501 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 32062
I20260812 17:43:28.585625 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:43:28.585942 18428 external_mini_cluster.cc:1428] Setting key ad470c0c7a28cb81e89f3f1ace541d1a
I20260812 17:43:28.586694 32189 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80: Bootstrap starting.
I20260812 17:43:28.589154 32189 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:28.590129 32189 log.cc:824] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80: Log is configured to *not* fsync() on all Append() calls
I20260812 17:43:28.592564 32189 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80: No bootstrap required, opened a new log
Aug 12 17:43:28 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556608, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:43:28.597657 32189 raft_consensus.cc:348] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47a46b2b04f1491fb7111af526dbcf80" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 44587 } }
I20260812 17:43:28.597963 32189 raft_consensus.cc:374] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:28.598049 32189 raft_consensus.cc:729] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47a46b2b04f1491fb7111af526dbcf80, State: Initialized, Role: FOLLOWER
I20260812 17:43:28.598615 32189 consensus_queue.cc:260] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47a46b2b04f1491fb7111af526dbcf80" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 44587 } }
I20260812 17:43:28.598784 32189 raft_consensus.cc:388] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:43:28.598876 32189 raft_consensus.cc:482] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:43:28.599011 32189 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:28.599992 32189 raft_consensus.cc:504] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47a46b2b04f1491fb7111af526dbcf80" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 44587 } }
I20260812 17:43:28.600396 32189 leader_election.cc:302] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 47a46b2b04f1491fb7111af526dbcf80; no voters:
I20260812 17:43:28.600808 32189 leader_election.cc:288] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:43:28.600889 32195 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:43:28.601106 32195 raft_consensus.cc:686] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80 [term 1 LEADER]: Becoming Leader. State: Replica: 47a46b2b04f1491fb7111af526dbcf80, State: Running, Role: LEADER
I20260812 17:43:28.601500 32195 consensus_queue.cc:237] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47a46b2b04f1491fb7111af526dbcf80" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 44587 } }
I20260812 17:43:28.602262 32189 sys_catalog.cc:564] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:43:28.603613 32199 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 47a46b2b04f1491fb7111af526dbcf80. Latest consensus state: current_term: 1 leader_uuid: "47a46b2b04f1491fb7111af526dbcf80" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47a46b2b04f1491fb7111af526dbcf80" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 44587 } } }
I20260812 17:43:28.603771 32199 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80 [sys.catalog]: This master's current role is: LEADER
I20260812 17:43:28.604095 32196 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "47a46b2b04f1491fb7111af526dbcf80" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47a46b2b04f1491fb7111af526dbcf80" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 44587 } } }
I20260812 17:43:28.604254 32196 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80 [sys.catalog]: This master's current role is: LEADER
I20260812 17:43:28.604365 32193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:28.587593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52118 (local address 127.17.255.62:44587)
0812 17:43:28.588057 (+ 464us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:28.588084 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:28.588128 (+ 44us) server_negotiation.cc:407] Connection header received
0812 17:43:28.588824 (+ 696us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:28.588844 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:28.589226 (+ 382us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:28.589569 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:28.590620 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:28.591801 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:28.593020 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:28.593530 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:28.593663 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:28.597179 (+ 3516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:28.597185 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:28.597203 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:28.597238 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:28.599641 (+ 2403us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:28.600181 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:28.600188 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:28.600195 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:28.600351 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:28.600708 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:28.600712 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:28.600714 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:28.601349 (+ 635us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:28.601572 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:28.602276 (+ 704us) server_negotiation.cc:299] Negotiation successful
0812 17:43:28.602646 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309,"thread_start_us":166,"threads_started":1}
I20260812 17:43:28.604594 32205 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:43:28.608155 32205 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:43:28.615247 32205 catalog_manager.cc:1347] Generated new cluster ID: dc3c864d78aa4aaa8e2109f2a175c02a
I20260812 17:43:28.615360 32205 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:43:28.635228 32205 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:43:28.636343 32205 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:43:28.642830 32205 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80: Generated new TSK 0
I20260812 17:43:28.643762 32205 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.255.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab.
Entry for principal kudu/127.17.255.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab.
I20260812 17:43:28.680114 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.1:0
--local_ip_for_outbound_sockets=127.17.255.1
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:44587
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:33221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:43:28.812608 32229 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:28.812894 32229 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:28.812940 32229 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:28.817088 32229 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:28.817152 32229 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:28.817210 32229 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.1
I20260812 17:43:28.823014 32229 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:33221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:44587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32229
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.1
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:28.824167 32229 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:28.825294 32229 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:28.835657 32239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:28.835654 32237 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:28.835726 32241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:28.835695 32229 server_base.cc:1034] running on GCE node
I20260812 17:43:28.836303 32229 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:28.837024 32229 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:28.838217 32229 hybrid_clock.cc:648] HybridClock initialized: now 1786556608838204 us; error 37 us; skew 500 ppm
Aug 12 17:43:28 dist-test-slave-tk9z krb5kdc[32026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556608, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:28.841265 32229 init.cc:377] Logged in from keytab as kudu/127.17.255.1@KRBTEST.COM (short username kudu)
I20260812 17:43:28.842140 32229 webserver.cc:460] Webserver started at http://127.17.255.1:39139/ using document root <none> and password file <none>
I20260812 17:43:28.842777 32229 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:28.842842 32229 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:28.843019 32229 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:28.845211 32229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-0/data/instance:
uuid: "5b4fc220177d4fcdb9a346f7b3ed9024"
format_stamp: "Formatted at 2026-08-12 17:43:28 on dist-test-slave-tk9z"
server_key: "0992b124b2868825ecc0c09e142713f7"
server_key_iv: "5201872023e47085dc60ee05a86ab657"
server_key_version: "encryptionkey@0"
I20260812 17:43:28.845811 32229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance:
uuid: "5b4fc220177d4fcdb9a346f7b3ed9024"
format_stamp: "Formatted at 2026-08-12 17:43:28 on dist-test-slave-tk9z"
server_key: "0992b124b2868825ecc0c09e142713f7"
server_key_iv: "5201872023e47085dc60ee05a86ab657"
server_key_version: "encryptionkey@0"
I20260812 17:43:28.850224 32229 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260812 17:43:28.853917 32253 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:28.855516 32229 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260812 17:43:28.855643 32229 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-0/wal
uuid: "5b4fc220177d4fcdb9a346f7b3ed9024"
format_stamp: "Formatted at 2026-08-12 17:43:28 on dist-test-slave-tk9z"
server_key: "0992b124b2868825ecc0c09e142713f7"
server_key_iv: "5201872023e47085dc60ee05a86ab657"
server_key_version: "encryptionkey@0"
I20260812 17:43:28.855758 32229 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:28.888553 32229 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:28.892479 32229 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:28.892706 32229 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:28.893572 32229 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:43:28.894842 32229 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:43:28.894927 32229 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:28.894990 32229 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:43:28.895047 32229 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260812 17:43:28.904608 32229 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.1:35111
I20260812 17:43:28.904631 32451 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.1:35111 every 8 connection(s)
I20260812 17:43:28.905649 32229 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
I20260812 17:43:28.911039 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 32229
I20260812 17:43:28.911207 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance
I20260812 17:43:28.911618 18428 external_mini_cluster.cc:1428] Setting key 23b89b0e98aca20fc6eaeab43e0d39dd
Aug 12 17:43:28 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556608, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.255.2@KRBTEST.COM; defaulting to no policy
I20260812 17:43:28.924501 32193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:28.908237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:35131 (local address 127.17.255.62:44587)
0812 17:43:28.908439 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:28.908444 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:28.909881 (+ 1437us) server_negotiation.cc:407] Connection header received
0812 17:43:28.911349 (+ 1468us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:28.911353 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:28.911414 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:28.911485 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:28.913466 (+ 1981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:28.914351 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:28.916547 (+ 2196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:28.916863 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:28.916991 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:28.920216 (+ 3225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:28.920219 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:28.920221 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:28.920249 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:28.921760 (+ 1511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:28.922502 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:28.922506 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:28.922507 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:28.922602 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:28.923073 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:28.923076 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:28.923077 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:28.923288 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:28.923423 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:28.924111 (+ 688us) server_negotiation.cc:299] Negotiation successful
0812 17:43:28.924236 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 17:43:28.925459 32454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:28.908793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.1:35131)
0812 17:43:28.909678 (+ 885us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:28.909745 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:28.911073 (+ 1328us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:28.911949 (+ 876us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:28.911959 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:28.912519 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:28.913260 (+ 741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:28.913283 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:28.914571 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:28.914578 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:28.916373 (+ 1795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:28.916406 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:28.917060 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:28.917065 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:28.917269 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:28.917958 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:28.917977 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:28.920007 (+ 2030us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:28.921896 (+ 1889us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:28.921904 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:28.921926 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:28.922327 (+ 401us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:28.922713 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:28.922718 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:28.922722 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:28.922943 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:28.923426 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:28.923435 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:28.923817 (+ 382us) client_negotiation.cc:769] Sending connection context
0812 17:43:28.923997 (+ 180us) client_negotiation.cc:240] Negotiation successful
0812 17:43:28.924398 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":598,"thread_start_us":136,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.2@KRBTEST.COM" created.
I20260812 17:43:28.927001 32452 heartbeater.cc:347] Connected to a master server at 127.17.255.62:44587
I20260812 17:43:28.927291 32452 heartbeater.cc:464] Registering TS with master...
I20260812 17:43:28.927903 32452 heartbeater.cc:511] Master 127.17.255.62:44587 requested a full tablet report, sending...
I20260812 17:43:28.929812 32123 ts_manager.cc:194] Registered new tserver with Master: 5b4fc220177d4fcdb9a346f7b3ed9024 (127.17.255.1:35111)
I20260812 17:43:28.931663 32123 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.1@KRBTEST.COM'} at 127.17.255.1:35131
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab.
Entry for principal kudu/127.17.255.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab.
I20260812 17:43:28.946727 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.2:0
--local_ip_for_outbound_sockets=127.17.255.2
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:44587
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:33221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:43:29.065021 32462 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:29.065335 32462 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:29.065379 32462 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:29.069509 32462 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:29.069582 32462 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:29.069644 32462 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.2
I20260812 17:43:29.075223 32462 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:33221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:44587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32462
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.2
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:29.076375 32462 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:29.077459 32462 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:29.088073 32473 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:29.088132 32462 server_base.cc:1034] running on GCE node
W20260812 17:43:29.088090 32468 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:29.088073 32467 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:29.088833 32462 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:29.089563 32462 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:29.090806 32462 hybrid_clock.cc:648] HybridClock initialized: now 1786556609090749 us; error 53 us; skew 500 ppm
Aug 12 17:43:29 dist-test-slave-tk9z krb5kdc[32026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556609, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:29.094137 32462 init.cc:377] Logged in from keytab as kudu/127.17.255.2@KRBTEST.COM (short username kudu)
I20260812 17:43:29.095302 32462 webserver.cc:460] Webserver started at http://127.17.255.2:34305/ using document root <none> and password file <none>
I20260812 17:43:29.095973 32462 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:29.096087 32462 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:29.096349 32462 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:29.099040 32462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-1/data/instance:
uuid: "153e7877f4c24f30a96d848bdb092da8"
format_stamp: "Formatted at 2026-08-12 17:43:29 on dist-test-slave-tk9z"
server_key: "f8a211619890fd9a3f8919ea389c5987"
server_key_iv: "c73e05d0b49ed1bc0842f6168772e59c"
server_key_version: "encryptionkey@0"
I20260812 17:43:29.099720 32462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance:
uuid: "153e7877f4c24f30a96d848bdb092da8"
format_stamp: "Formatted at 2026-08-12 17:43:29 on dist-test-slave-tk9z"
server_key: "f8a211619890fd9a3f8919ea389c5987"
server_key_iv: "c73e05d0b49ed1bc0842f6168772e59c"
server_key_version: "encryptionkey@0"
I20260812 17:43:29.104267 32462 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 17:43:29.107177 32488 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:29.108520 32462 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 17:43:29.108664 32462 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-1/wal
uuid: "153e7877f4c24f30a96d848bdb092da8"
format_stamp: "Formatted at 2026-08-12 17:43:29 on dist-test-slave-tk9z"
server_key: "f8a211619890fd9a3f8919ea389c5987"
server_key_iv: "c73e05d0b49ed1bc0842f6168772e59c"
server_key_version: "encryptionkey@0"
I20260812 17:43:29.108830 32462 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:29.126503 32462 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:29.129972 32462 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:29.130151 32462 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:29.130803 32462 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:43:29.131680 32462 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:43:29.131729 32462 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:29.131773 32462 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:43:29.131789 32462 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:29.141342 32462 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.2:34459
I20260812 17:43:29.141418 32680 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.2:34459 every 8 connection(s)
I20260812 17:43:29.142550 32462 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
I20260812 17:43:29.144716 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 32462
I20260812 17:43:29.144861 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance
I20260812 17:43:29.145202 18428 external_mini_cluster.cc:1428] Setting key d2883b4bb2bad7b015a333c012b673ad
Aug 12 17:43:29 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556609, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.255.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.3@KRBTEST.COM" created.
I20260812 17:43:29.159423 32193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:29.144744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:39571 (local address 127.17.255.62:44587)
0812 17:43:29.144905 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:29.144911 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:29.146425 (+ 1514us) server_negotiation.cc:407] Connection header received
0812 17:43:29.147546 (+ 1121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:29.147549 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:29.147601 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:29.147686 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:29.149090 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:29.149613 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:29.151491 (+ 1878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:29.151703 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:29.151785 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:29.155007 (+ 3222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:29.155010 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:29.155012 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:29.155037 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:29.156689 (+ 1652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:29.157280 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:29.157283 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:29.157284 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:29.157365 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:29.157721 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:29.157724 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:29.157725 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:29.157929 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:29.158012 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:29.158879 (+ 867us) server_negotiation.cc:299] Negotiation successful
0812 17:43:29.159068 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 17:43:29.160274 32686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:29.145260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.2:39571)
0812 17:43:29.146224 (+ 964us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:29.146288 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:29.147307 (+ 1019us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:29.147876 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:29.147883 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:29.148259 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:29.148912 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:29.148937 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:29.149746 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:29.149752 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:29.151349 (+ 1597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:29.151364 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:29.151878 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:29.151919 (+ 41us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:29.152225 (+ 306us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:29.152989 (+ 764us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:29.153019 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:29.154775 (+ 1756us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:29.156805 (+ 2030us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:29.156811 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:29.156829 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:29.157157 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:29.157448 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:29.157450 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:29.157452 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:29.157593 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:29.158055 (+ 462us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:29.158060 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:29.158515 (+ 455us) client_negotiation.cc:769] Sending connection context
0812 17:43:29.158724 (+ 209us) client_negotiation.cc:240] Negotiation successful
0812 17:43:29.159135 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":706,"thread_start_us":164,"threads_started":1}
I20260812 17:43:29.161669 32682 heartbeater.cc:347] Connected to a master server at 127.17.255.62:44587
I20260812 17:43:29.161966 32682 heartbeater.cc:464] Registering TS with master...
I20260812 17:43:29.162577 32682 heartbeater.cc:511] Master 127.17.255.62:44587 requested a full tablet report, sending...
I20260812 17:43:29.163769 32123 ts_manager.cc:194] Registered new tserver with Master: 153e7877f4c24f30a96d848bdb092da8 (127.17.255.2:34459)
I20260812 17:43:29.164685 32123 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.2@KRBTEST.COM'} at 127.17.255.2:39571
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab.
Entry for principal kudu/127.17.255.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab.
I20260812 17:43:29.177474 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.3:0
--local_ip_for_outbound_sockets=127.17.255.3
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:44587
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:33221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:43:29.295480 32691 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:29.295768 32691 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:29.295864 32691 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:29.299906 32691 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:29.299963 32691 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:29.300061 32691 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.3
I20260812 17:43:29.305699 32691 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:33221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:44587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32691
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.3
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:29.306845 32691 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:29.307957 32691 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:29.318332 32706 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:29.318430 32691 server_base.cc:1034] running on GCE node
W20260812 17:43:29.318352 32702 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:29.318331 32704 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:29.319139 32691 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:29.319830 32691 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:29.321038 32691 hybrid_clock.cc:648] HybridClock initialized: now 1786556609321022 us; error 30 us; skew 500 ppm
Aug 12 17:43:29 dist-test-slave-tk9z krb5kdc[32026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556609, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:29.324283 32691 init.cc:377] Logged in from keytab as kudu/127.17.255.3@KRBTEST.COM (short username kudu)
I20260812 17:43:29.325335 32691 webserver.cc:460] Webserver started at http://127.17.255.3:36091/ using document root <none> and password file <none>
I20260812 17:43:29.325947 32691 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:29.326046 32691 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:29.326308 32691 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:29.328552 32691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-2/data/instance:
uuid: "f3db1790afc4419fa04074e3658f25f9"
format_stamp: "Formatted at 2026-08-12 17:43:29 on dist-test-slave-tk9z"
server_key: "71b876117e719efd2a7737674d909054"
server_key_iv: "cd030a44e08ef6f90695ad5a7a23164a"
server_key_version: "encryptionkey@0"
I20260812 17:43:29.329178 32691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance:
uuid: "f3db1790afc4419fa04074e3658f25f9"
format_stamp: "Formatted at 2026-08-12 17:43:29 on dist-test-slave-tk9z"
server_key: "71b876117e719efd2a7737674d909054"
server_key_iv: "cd030a44e08ef6f90695ad5a7a23164a"
server_key_version: "encryptionkey@0"
I20260812 17:43:29.333304 32691 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260812 17:43:29.336095 32716 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:29.337507 32691 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 17:43:29.337668 32691 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-2/wal
uuid: "f3db1790afc4419fa04074e3658f25f9"
format_stamp: "Formatted at 2026-08-12 17:43:29 on dist-test-slave-tk9z"
server_key: "71b876117e719efd2a7737674d909054"
server_key_iv: "cd030a44e08ef6f90695ad5a7a23164a"
server_key_version: "encryptionkey@0"
I20260812 17:43:29.337802 32691 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:29.366598 32691 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:29.370048 32691 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:29.370294 32691 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:29.371038 32691 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:43:29.372004 32691 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:43:29.372089 32691 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:29.372169 32691 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:43:29.372213 32691 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:29.384305 32691 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.3:41585
I20260812 17:43:29.384330 445 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.3:41585 every 8 connection(s)
I20260812 17:43:29.385293 32691 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
I20260812 17:43:29.386610 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 32691
I20260812 17:43:29.386773 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance
I20260812 17:43:29.387166 18428 external_mini_cluster.cc:1428] Setting key 5b925c3b545bb4d7005d1d4d67baba7e
Aug 12 17:43:29 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556609, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:43:29.400708 32193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:29.387552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:33867 (local address 127.17.255.62:44587)
0812 17:43:29.387733 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:29.387739 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:29.389017 (+ 1278us) server_negotiation.cc:407] Connection header received
0812 17:43:29.390895 (+ 1878us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:29.390898 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:29.390947 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:29.391027 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:29.392394 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:29.392930 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:29.394253 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:29.394545 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:29.394630 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:29.397213 (+ 2583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:29.397217 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:29.397219 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:29.397246 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:29.398609 (+ 1363us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:29.399122 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:29.399125 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:29.399126 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:29.399201 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:29.399548 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:29.399550 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:29.399551 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:29.399736 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:29.399814 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:29.400406 (+ 592us) server_negotiation.cc:299] Negotiation successful
0812 17:43:29.400546 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 17:43:29.401919 450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:29.388067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.3:33867)
0812 17:43:29.388775 (+ 708us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:29.388886 (+ 111us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:29.390616 (+ 1730us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:29.391246 (+ 630us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:29.391254 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:29.391696 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:29.392233 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:29.392248 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:29.393062 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:29.393065 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:29.394138 (+ 1073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:29.394149 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:29.394719 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:29.394722 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:29.394901 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:29.395493 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:29.395512 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:29.397034 (+ 1522us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:29.398728 (+ 1694us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:29.398734 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:29.398749 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:29.399032 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:29.399285 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:29.399287 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:29.399289 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:29.399460 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:29.399858 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:29.399864 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:29.400146 (+ 282us) client_negotiation.cc:769] Sending connection context
0812 17:43:29.400344 (+ 198us) client_negotiation.cc:240] Negotiation successful
0812 17:43:29.400794 (+ 450us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":155,"threads_started":1}
I20260812 17:43:29.403261 446 heartbeater.cc:347] Connected to a master server at 127.17.255.62:44587
I20260812 17:43:29.403569 446 heartbeater.cc:464] Registering TS with master...
I20260812 17:43:29.404157 446 heartbeater.cc:511] Master 127.17.255.62:44587 requested a full tablet report, sending...
I20260812 17:43:29.405256 32123 ts_manager.cc:194] Registered new tserver with Master: f3db1790afc4419fa04074e3658f25f9 (127.17.255.3:41585)
I20260812 17:43:29.405802 32123 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.3@KRBTEST.COM'} at 127.17.255.3:33867
I20260812 17:43:29.413978 18428 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.17.255.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.255.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.255.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.1.keytab.
Entry for principal oryx/127.17.255.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.1.keytab.
WARNING: no policy specified for oryx/127.17.255.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.255.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.255.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.2.keytab.
Entry for principal oryx/127.17.255.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.2.keytab.
WARNING: no policy specified for oryx/127.17.255.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.255.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.255.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.3.keytab.
Entry for principal oryx/127.17.255.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.3.keytab.
I20260812 17:43:29.495307 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 32229
I20260812 17:43:29.507325 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 32462
I20260812 17:43:29.528249 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 32691
I20260812 17:43:29.541476 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 32062
I20260812 17:43:29.557562 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:44587
--webserver_interface=127.17.255.62
--webserver_port=43751
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:33221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:44587
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:43:29.678131 464 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:29.678544 464 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:29.678632 464 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:29.682803 464 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:43:29.682916 464 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:29.682955 464 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:29.682999 464 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:43:29.683035 464 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:43:29.688606 464 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:33221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:44587
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:44587
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=43751
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.464
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:29.689806 464 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:29.690944 464 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:29.700070 480 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:29.700125 475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:29.700070 476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:29.700317 464 server_base.cc:1034] running on GCE node
I20260812 17:43:29.701133 464 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:29.702322 464 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:29.703562 464 hybrid_clock.cc:648] HybridClock initialized: now 1786556609703543 us; error 32 us; skew 500 ppm
Aug 12 17:43:29 dist-test-slave-tk9z krb5kdc[32026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556609, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:29.706758 464 init.cc:377] Logged in from keytab as kudu/127.17.255.62@KRBTEST.COM (short username kudu)
I20260812 17:43:29.707778 464 webserver.cc:460] Webserver started at http://127.17.255.62:43751/ using document root <none> and password file <none>
I20260812 17:43:29.708431 464 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:29.708514 464 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:29.712968 464 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 17:43:29.715495 492 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:29.716948 464 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:43:29.717214 464 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "47a46b2b04f1491fb7111af526dbcf80"
format_stamp: "Formatted at 2026-08-12 17:43:28 on dist-test-slave-tk9z"
server_key: "876d26265002e1abc2b51530e47e3730"
server_key_iv: "c980bd83fd493d0f41ce55db016268df"
server_key_version: "encryptionkey@0"
I20260812 17:43:29.717849 464 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:29.733722 464 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:29.737352 464 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:29.737586 464 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:29.745121 464 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:44587
I20260812 17:43:29.745208 592 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:44587 every 8 connection(s)
I20260812 17:43:29.746285 464 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:43:29.751140 593 sys_catalog.cc:263] Verifying existing consensus state
I20260812 17:43:29.752974 593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80: Bootstrap starting.
I20260812 17:43:29.755034 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 464
I20260812 17:43:29.755559 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.1:35111
--local_ip_for_outbound_sockets=127.17.255.1
--tserver_master_addrs=127.17.255.62:44587
--webserver_port=39139
--webserver_interface=127.17.255.1
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:33221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.17.255.1
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.1.keytab with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 17:43:29.771347 593 log.cc:824] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80: Log is configured to *not* fsync() on all Append() calls
I20260812 17:43:29.778919 593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 17:43:29.779402 593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80: Bootstrap complete.
I20260812 17:43:29.784154 593 raft_consensus.cc:348] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47a46b2b04f1491fb7111af526dbcf80" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 44587 } }
I20260812 17:43:29.784574 593 raft_consensus.cc:729] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47a46b2b04f1491fb7111af526dbcf80, State: Initialized, Role: FOLLOWER
I20260812 17:43:29.785143 593 consensus_queue.cc:260] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47a46b2b04f1491fb7111af526dbcf80" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 44587 } }
I20260812 17:43:29.785267 593 raft_consensus.cc:388] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:43:29.785357 593 raft_consensus.cc:482] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:43:29.785485 593 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80 [term 1 FOLLOWER]: Advancing to term 2
I20260812 17:43:29.787633 593 raft_consensus.cc:504] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47a46b2b04f1491fb7111af526dbcf80" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 44587 } }
I20260812 17:43:29.787986 593 leader_election.cc:302] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 47a46b2b04f1491fb7111af526dbcf80; no voters:
I20260812 17:43:29.788333 593 leader_election.cc:288] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 17:43:29.788429 598 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 17:43:29.788650 598 raft_consensus.cc:686] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80 [term 2 LEADER]: Becoming Leader. State: Replica: 47a46b2b04f1491fb7111af526dbcf80, State: Running, Role: LEADER
I20260812 17:43:29.788975 598 consensus_queue.cc:237] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47a46b2b04f1491fb7111af526dbcf80" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 44587 } }
I20260812 17:43:29.789661 593 sys_catalog.cc:564] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:43:29.789983 598 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 47a46b2b04f1491fb7111af526dbcf80. Latest consensus state: current_term: 2 leader_uuid: "47a46b2b04f1491fb7111af526dbcf80" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47a46b2b04f1491fb7111af526dbcf80" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 44587 } } }
I20260812 17:43:29.790113 598 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80 [sys.catalog]: This master's current role is: LEADER
I20260812 17:43:29.790531 599 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "47a46b2b04f1491fb7111af526dbcf80" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47a46b2b04f1491fb7111af526dbcf80" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 44587 } } }
I20260812 17:43:29.790714 599 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80 [sys.catalog]: This master's current role is: LEADER
I20260812 17:43:29.790630 607 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:43:29.794400 607 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:43:29.795383 607 catalog_manager.cc:1259] Loaded cluster ID: dc3c864d78aa4aaa8e2109f2a175c02a
I20260812 17:43:29.795493 607 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:43:29.797921 607 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:43:29.798756 607 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 47a46b2b04f1491fb7111af526dbcf80: Loaded TSK: 0
I20260812 17:43:29.800117 607 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 17:43:29.880820 595 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:29.881127 595 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:29.881201 595 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:29.885321 595 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:29.885392 595 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:29.885459 595 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.1
I20260812 17:43:29.891618 595 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:33221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.1.keytab
--principal=oryx/127.17.255.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.1:35111
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.255.1
--webserver_port=39139
--tserver_master_addrs=127.17.255.62:44587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.595
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.1
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:29.892835 595 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:29.893972 595 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:29.905380 639 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:29.905501 642 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:29.905381 640 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:29.905730 595 server_base.cc:1034] running on GCE node
I20260812 17:43:29.906203 595 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:29.907038 595 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:29.908228 595 hybrid_clock.cc:648] HybridClock initialized: now 1786556609908187 us; error 54 us; skew 500 ppm
Aug 12 17:43:29 dist-test-slave-tk9z krb5kdc[32026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556609, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.255.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:29.911412 595 init.cc:377] Logged in from keytab as oryx/127.17.255.1@KRBTEST.COM (short username oryx)
I20260812 17:43:29.912498 595 webserver.cc:460] Webserver started at http://127.17.255.1:39139/ using document root <none> and password file <none>
I20260812 17:43:29.913130 595 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:29.913211 595 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:29.917584 595 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260812 17:43:29.920030 657 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:29.921555 595 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 17:43:29.921680 595 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-0/wal
uuid: "5b4fc220177d4fcdb9a346f7b3ed9024"
format_stamp: "Formatted at 2026-08-12 17:43:28 on dist-test-slave-tk9z"
server_key: "0992b124b2868825ecc0c09e142713f7"
server_key_iv: "5201872023e47085dc60ee05a86ab657"
server_key_version: "encryptionkey@0"
I20260812 17:43:29.922330 595 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:29.945852 595 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:29.949427 595 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:29.949692 595 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:29.950486 595 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:43:29.951408 595 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:43:29.951468 595 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:29.951540 595 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:43:29.951571 595 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:29.961925 595 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.1:35111
I20260812 17:43:29.961946 851 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.1:35111 every 8 connection(s)
I20260812 17:43:29.963127 595 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
I20260812 17:43:29.963723 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 595
I20260812 17:43:29.964200 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.2:34459
--local_ip_for_outbound_sockets=127.17.255.2
--tserver_master_addrs=127.17.255.62:44587
--webserver_port=34305
--webserver_interface=127.17.255.2
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:33221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.17.255.2
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.2.keytab with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 17:43:29 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.1@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:29 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.1@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:29.979890 857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:29.965895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.1:52765)
0812 17:43:29.966445 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:29.966498 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:29.968180 (+ 1682us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:29.969427 (+ 1247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:29.969439 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:29.970036 (+ 597us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:29.970857 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:29.970882 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:29.972313 (+ 1431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:29.972319 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:29.973958 (+ 1639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:29.973976 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:29.974937 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:29.974945 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:29.975197 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:29.975996 (+ 799us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:29.976026 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:29.979000 (+ 2974us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":127,"threads_started":1}
W20260812 17:43:29.980188 856 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:29.965646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:52765 (local address 127.17.255.62:44587)
0812 17:43:29.966122 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:29.966145 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:29.966633 (+ 488us) server_negotiation.cc:407] Connection header received
0812 17:43:29.968620 (+ 1987us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:29.968633 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:29.968960 (+ 327us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:29.969248 (+ 288us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:29.971088 (+ 1840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:29.972145 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:29.974135 (+ 1990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:29.974732 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:29.974909 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:29.979300 (+ 4391us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.1:52765: BlockingRecv error: recv got EOF from 127.17.255.1:52765 (error 108)
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":95,"threads_started":1}
W20260812 17:43:29.980530 852 heartbeater.cc:644] Failed to heartbeat to 127.17.255.62:44587 (0 consecutive failures): Not authorized: Failed to ping master at 127.17.255.62:44587: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Aug 12 17:43:29 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.1@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:29 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.1@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:29.986564 857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:29.981035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.1:60579)
0812 17:43:29.981182 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:29.981199 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:29.981285 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:29.981512 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:29.981514 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:29.981649 (+ 135us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:29.981743 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:29.981748 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:29.982841 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:29.982844 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:29.983406 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:29.983414 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:29.983995 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:29.983997 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:29.984074 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:29.984640 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:29.984652 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:29.986460 (+ 1808us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":62}
W20260812 17:43:29.987074 856 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:29.981139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:60579 (local address 127.17.255.62:44587)
0812 17:43:29.981276 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:29.981280 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:29.981297 (+ 17us) server_negotiation.cc:407] Connection header received
0812 17:43:29.981347 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:29.981350 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:29.981403 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:29.981488 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:29.981847 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:29.982712 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:29.983517 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:29.983870 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:29.983978 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:29.986616 (+ 2638us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.1:60579: BlockingRecv error: recv got EOF from 127.17.255.1:60579 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 12 17:43:29 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.1@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:29 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.1@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:29.992956 857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:29.987289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.1:36973)
0812 17:43:29.987475 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:29.987490 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:29.987568 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:29.987878 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:29.987881 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:29.988053 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:29.988144 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:29.988151 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:29.988876 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:29.988879 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:29.989799 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:29.989810 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:29.990307 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:29.990311 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:29.990440 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:29.990922 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:29.990937 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:29.992812 (+ 1875us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":108}
W20260812 17:43:29.993052 856 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:29.987568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:36973 (local address 127.17.255.62:44587)
0812 17:43:29.987689 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:29.987692 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:29.987704 (+ 12us) server_negotiation.cc:407] Connection header received
0812 17:43:29.987736 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:29.987738 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:29.987774 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:29.987840 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:29.988258 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:29.988769 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:29.989922 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:29.990186 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:29.990279 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:29.992936 (+ 2657us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.1:36973: BlockingRecv error: recv got EOF from 127.17.255.1:36973 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260812 17:43:29.993362 852 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 17:43:30.087625 855 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:30.087984 855 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:30.088032 855 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:30.092465 855 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:30.092540 855 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:30.092602 855 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.2
I20260812 17:43:30.098345 855 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:33221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.2.keytab
--principal=oryx/127.17.255.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.2:34459
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.255.2
--webserver_port=34305
--tserver_master_addrs=127.17.255.62:44587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.855
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.2
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:30.099618 855 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:30.100704 855 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:30.110761 879 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:30.110980 855 server_base.cc:1034] running on GCE node
W20260812 17:43:30.110798 874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:30.110766 875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:30.111545 855 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:30.112216 855 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:30.113416 855 hybrid_clock.cc:648] HybridClock initialized: now 1786556610113395 us; error 32 us; skew 500 ppm
Aug 12 17:43:30 dist-test-slave-tk9z krb5kdc[32026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556610, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.255.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:30.117700 855 init.cc:377] Logged in from keytab as oryx/127.17.255.2@KRBTEST.COM (short username oryx)
I20260812 17:43:30.118798 855 webserver.cc:460] Webserver started at http://127.17.255.2:34305/ using document root <none> and password file <none>
I20260812 17:43:30.119423 855 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:30.119540 855 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:30.123848 855 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 17:43:30.126151 889 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:30.127733 855 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:43:30.127853 855 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-1/wal
uuid: "153e7877f4c24f30a96d848bdb092da8"
format_stamp: "Formatted at 2026-08-12 17:43:29 on dist-test-slave-tk9z"
server_key: "f8a211619890fd9a3f8919ea389c5987"
server_key_iv: "c73e05d0b49ed1bc0842f6168772e59c"
server_key_version: "encryptionkey@0"
I20260812 17:43:30.128495 855 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:30.141567 855 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:30.145176 855 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:30.145377 855 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:30.145974 855 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:43:30.146948 855 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:43:30.147010 855 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:30.147055 855 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:43:30.147071 855 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:30.156713 855 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.2:34459
I20260812 17:43:30.156798 1093 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.2:34459 every 8 connection(s)
I20260812 17:43:30.157835 855 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
I20260812 17:43:30.162945 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 855
I20260812 17:43:30.163542 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.3:41585
--local_ip_for_outbound_sockets=127.17.255.3
--tserver_master_addrs=127.17.255.62:44587
--webserver_port=36091
--webserver_interface=127.17.255.3
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:33221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.17.255.3
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.3.keytab with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 17:43:30 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.2@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:30 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.2@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
W20260812 17:43:30.172910 856 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:30.159992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:43117 (local address 127.17.255.62:44587)
0812 17:43:30.160168 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:30.160172 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:30.161028 (+ 856us) server_negotiation.cc:407] Connection header received
0812 17:43:30.163079 (+ 2051us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:30.163084 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:30.163160 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:30.163270 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:30.164839 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:30.165614 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:30.167783 (+ 2169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:30.168021 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:30.168123 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:30.172716 (+ 4593us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.2:43117: BlockingRecv error: recv got EOF from 127.17.255.2:43117 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 17:43:30.173452 1100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:30.160266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.2:43117)
0812 17:43:30.160840 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:30.160896 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:30.162804 (+ 1908us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:30.163536 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:30.163545 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:30.164018 (+ 473us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:30.164628 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:30.164646 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:30.165793 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:30.165799 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:30.167592 (+ 1793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:30.167611 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:30.168225 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:30.168233 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:30.168557 (+ 324us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:30.169349 (+ 792us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:30.169382 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:30.172461 (+ 3079us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":131,"threads_started":1}
W20260812 17:43:30.174177 1094 heartbeater.cc:644] Failed to heartbeat to 127.17.255.62:44587 (0 consecutive failures): Not authorized: Failed to ping master at 127.17.255.62:44587: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Aug 12 17:43:30 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.2@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:30 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.2@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:30.180218 1100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:30.174808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.2:39083)
0812 17:43:30.174941 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:30.174958 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:30.175057 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:30.175298 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:30.175301 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:30.175485 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:30.175590 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:30.175596 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:30.176338 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:30.176342 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:30.176900 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:30.176909 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:30.177385 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:30.177388 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:30.177482 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:30.178028 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:30.178040 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:30.180027 (+ 1987us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":52}
W20260812 17:43:30.180295 856 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:30.174937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:39083 (local address 127.17.255.62:44587)
0812 17:43:30.175061 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:30.175065 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:30.175081 (+ 16us) server_negotiation.cc:407] Connection header received
0812 17:43:30.175139 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:30.175142 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:30.175191 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:30.175279 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:30.175710 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:30.176226 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:30.177042 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:30.177266 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:30.177394 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:30.180178 (+ 2784us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.2:39083: BlockingRecv error: recv got EOF from 127.17.255.2:39083 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 12 17:43:30 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.2@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:30 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.2@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:30.186633 1100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:30.181144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.2:46917)
0812 17:43:30.181407 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:30.181422 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:30.181549 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:30.181818 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:30.181821 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:30.181990 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:30.182068 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:30.182073 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:30.182968 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:30.182974 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:30.183521 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:30.183529 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:30.183974 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:30.183978 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:30.184052 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:30.184564 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:30.184576 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:30.186491 (+ 1915us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":192}
W20260812 17:43:30.186672 856 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:30.181274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:46917 (local address 127.17.255.62:44587)
0812 17:43:30.181409 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:30.181414 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:30.181465 (+ 51us) server_negotiation.cc:407] Connection header received
0812 17:43:30.181665 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:30.181673 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:30.181714 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:30.181800 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:30.182183 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:30.182861 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:30.183643 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:30.183859 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:30.183978 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:30.186571 (+ 2593us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.2:46917: BlockingRecv error: recv got EOF from 127.17.255.2:46917 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260812 17:43:30.186978 1094 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 17:43:30.286890 1101 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:30.287231 1101 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:30.287343 1101 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:30.291788 1101 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:30.291882 1101 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:30.291975 1101 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.3
I20260812 17:43:30.297737 1101 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:33221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/krb5kdc/oryx_127.17.255.3.keytab
--principal=oryx/127.17.255.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.3:41585
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.255.3
--webserver_port=36091
--tserver_master_addrs=127.17.255.62:44587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1101
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.3
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:30.299032 1101 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:30.300125 1101 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:30.310305 1113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:30.310245 1110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:30.310309 1106 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:30.310495 1101 server_base.cc:1034] running on GCE node
I20260812 17:43:30.311021 1101 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:30.311766 1101 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:30.312963 1101 hybrid_clock.cc:648] HybridClock initialized: now 1786556610312945 us; error 30 us; skew 500 ppm
Aug 12 17:43:30 dist-test-slave-tk9z krb5kdc[32026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556610, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.255.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:30.315788 1101 init.cc:377] Logged in from keytab as oryx/127.17.255.3@KRBTEST.COM (short username oryx)
I20260812 17:43:30.316679 1101 webserver.cc:460] Webserver started at http://127.17.255.3:36091/ using document root <none> and password file <none>
I20260812 17:43:30.317272 1101 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:30.317394 1101 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:30.321622 1101 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260812 17:43:30.323935 1125 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:30.325228 1101 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 17:43:30.325371 1101 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-2/wal
uuid: "f3db1790afc4419fa04074e3658f25f9"
format_stamp: "Formatted at 2026-08-12 17:43:29 on dist-test-slave-tk9z"
server_key: "71b876117e719efd2a7737674d909054"
server_key_iv: "cd030a44e08ef6f90695ad5a7a23164a"
server_key_version: "encryptionkey@0"
I20260812 17:43:30.325992 1101 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:30.344439 1101 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:30.348155 1101 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:30.348402 1101 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:30.349099 1101 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:43:30.350051 1101 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:43:30.350127 1101 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:30.350205 1101 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:43:30.350263 1101 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:30.359629 1101 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.3:41585
I20260812 17:43:30.359653 1309 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.3:41585 every 8 connection(s)
I20260812 17:43:30.360729 1101 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
I20260812 17:43:30.362345 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 1101
Aug 12 17:43:30 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.3@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:30 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.3@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:30.373620 1318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:30.363460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52128 (local address 127.17.255.62:44587)
0812 17:43:30.363748 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:30.363753 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:30.363769 (+ 16us) server_negotiation.cc:407] Connection header received
0812 17:43:30.363836 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:30.363839 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:30.363896 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:30.364017 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:30.365085 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:30.365643 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:30.366915 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:30.367140 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:30.367219 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:30.368763 (+ 1544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:30.368769 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:30.368784 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:30.368811 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:30.370832 (+ 2021us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:30.371425 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:30.371432 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:30.371437 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:30.371592 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:30.371985 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:30.371992 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:30.371996 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:30.372551 (+ 555us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:30.372781 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:30.373164 (+ 383us) server_negotiation.cc:299] Negotiation successful
0812 17:43:30.373475 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":201,"thread_start_us":99,"threads_started":1}
W20260812 17:43:30.374257 856 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:30.363044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:44551 (local address 127.17.255.62:44587)
0812 17:43:30.363207 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:30.363214 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:30.364502 (+ 1288us) server_negotiation.cc:407] Connection header received
0812 17:43:30.366163 (+ 1661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:30.366166 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:30.366209 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:30.366274 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:30.367859 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:30.368375 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:30.369619 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:30.369948 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:30.370065 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:30.374152 (+ 4087us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.3:44551: BlockingRecv error: recv got EOF from 127.17.255.3:44551 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 17:43:30.375059 1319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:30.363657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.3:44551)
0812 17:43:30.364312 (+ 655us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:30.364374 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:30.365928 (+ 1554us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:30.366522 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:30.366531 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:30.367021 (+ 490us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:30.367688 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:30.367706 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:30.368511 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:30.368517 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:30.369487 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:30.369497 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:30.370102 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:30.370105 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:30.370276 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:30.370908 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:30.370934 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:30.374015 (+ 3081us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":169,"threads_started":1}
W20260812 17:43:30.375692 1311 heartbeater.cc:644] Failed to heartbeat to 127.17.255.62:44587 (0 consecutive failures): Not authorized: Failed to ping master at 127.17.255.62:44587: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Aug 12 17:43:30 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.3@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:30 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.3@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:30.382551 1319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:30.376253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.3:37639)
0812 17:43:30.376630 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:30.376647 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:30.376753 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:30.377276 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:30.377279 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:30.377490 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:30.377731 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:30.377744 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:30.378658 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:30.378662 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:30.379309 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:30.379319 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:30.379849 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:30.379853 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:30.379974 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:30.380477 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:30.380490 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:30.382421 (+ 1931us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":64}
W20260812 17:43:30.382707 1318 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:30.376389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:37639 (local address 127.17.255.62:44587)
0812 17:43:30.376557 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:30.376562 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:30.376743 (+ 181us) server_negotiation.cc:407] Connection header received
0812 17:43:30.376861 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:30.376863 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:30.376913 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:30.377257 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:30.377908 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:30.378543 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:30.379445 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:30.379717 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:30.379841 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:30.382580 (+ 2739us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.3:37639: BlockingRecv error: recv got EOF from 127.17.255.3:37639 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
Aug 12 17:43:30 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.3@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:30 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.3@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:30.388535 1319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:30.383158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.3:58545)
0812 17:43:30.383279 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:30.383294 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:30.383380 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:30.383631 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:30.383635 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:30.383799 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:30.383873 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:30.383878 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:30.384607 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:30.384611 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:30.385138 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:30.385146 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:30.385600 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:30.385603 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:30.385683 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:30.386194 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:30.386206 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:30.388375 (+ 2169us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":49}
W20260812 17:43:30.388588 1318 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:30.383249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:58545 (local address 127.17.255.62:44587)
0812 17:43:30.383423 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:30.383429 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:30.383446 (+ 17us) server_negotiation.cc:407] Connection header received
0812 17:43:30.383491 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:30.383493 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:30.383528 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:30.383615 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:30.383995 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:30.384498 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:30.385257 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:30.385485 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:30.385595 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:30.388483 (+ 2888us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.3:58545: BlockingRecv error: recv got EOF from 127.17.255.3:58545 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
W20260812 17:43:30.388814 1311 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 12 17:43:30 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.1@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:30 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.1@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:31.000351 1321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:30.994061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.1:38497)
0812 17:43:30.994439 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:30.994462 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:30.994578 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:30.994899 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:30.994901 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:30.995101 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:30.995204 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:30.995209 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:30.996051 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:30.996054 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:30.996909 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:30.996924 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:30.997491 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:30.997494 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:30.997584 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:30.998222 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:30.998236 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:31.000209 (+ 1973us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":122,"threads_started":1}
W20260812 17:43:31.000782 1322 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:30.994162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:38497 (local address 127.17.255.62:44587)
0812 17:43:30.994473 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:30.994476 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:30.994515 (+ 39us) server_negotiation.cc:407] Connection header received
0812 17:43:30.994716 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:30.994719 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:30.994769 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:30.994857 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:30.995340 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:30.995883 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:30.997078 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:30.997323 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:30.997528 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:31.000626 (+ 3098us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.1:38497: BlockingRecv error: recv got EOF from 127.17.255.1:38497 (error 108)
Metrics: {"server-negotiator.queue_time_us":221,"thread_start_us":118,"threads_started":1}
Aug 12 17:43:31 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.2@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:31 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.2@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:31.196931 1324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:31.187580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.2:36043)
0812 17:43:31.187853 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:31.187866 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:31.187982 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:31.188218 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:31.188220 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:31.188409 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:31.188521 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:31.188526 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:31.189387 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:31.189391 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:31.190094 (+ 703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:31.190105 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:31.190718 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:31.190724 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:31.190846 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:31.194472 (+ 3626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:31.194487 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:31.196739 (+ 2252us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":97,"threads_started":1}
W20260812 17:43:31.196988 1322 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:31.187672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:36043 (local address 127.17.255.62:44587)
0812 17:43:31.187812 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:31.187816 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:31.187934 (+ 118us) server_negotiation.cc:407] Connection header received
0812 17:43:31.188063 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:31.188065 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:31.188109 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:31.188180 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:31.188665 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:31.189211 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:31.190222 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:31.190509 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:31.190605 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:31.196878 (+ 6273us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.2:36043: BlockingRecv error: recv got EOF from 127.17.255.2:36043 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 12 17:43:31 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.3@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:31 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.3@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:31.397287 1326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:31.389622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.3:35501)
0812 17:43:31.390107 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:31.390126 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:31.390273 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:31.390621 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:31.390624 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:31.390903 (+ 279us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:31.391048 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:31.391059 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:31.392131 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:31.392137 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:31.392963 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:31.392978 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:31.393625 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:31.393632 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:31.393766 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:31.394486 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:31.394507 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:31.397082 (+ 2575us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":239,"threads_started":1}
W20260812 17:43:31.397683 1322 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:31.389681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:35501 (local address 127.17.255.62:44587)
0812 17:43:31.389991 (+ 310us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:31.389995 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:31.390243 (+ 248us) server_negotiation.cc:407] Connection header received
0812 17:43:31.390422 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:31.390425 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:31.390499 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:31.390586 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:31.391170 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:31.392010 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:31.393140 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:31.393496 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:31.393587 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:31.397313 (+ 3726us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.3:35501: BlockingRecv error: recv got EOF from 127.17.255.3:35501 (error 108)
Metrics: {"server-negotiator.queue_time_us":196}
Aug 12 17:43:32 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.1@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:32 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.1@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:32.009920 1327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:32.001250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.1:60945)
0812 17:43:32.001578 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:32.001592 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:32.001690 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:32.001957 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:32.001959 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:32.002156 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:32.002259 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:32.002264 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:32.003143 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:32.003146 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:32.003764 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:32.003774 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:32.004237 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:32.004239 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:32.004330 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:32.007799 (+ 3469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:32.007814 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:32.009770 (+ 1956us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":114,"threads_started":1}
W20260812 17:43:32.010143 1328 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:32.001397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:60945 (local address 127.17.255.62:44587)
0812 17:43:32.001643 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:32.001647 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:32.001661 (+ 14us) server_negotiation.cc:407] Connection header received
0812 17:43:32.001779 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:32.001781 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:32.001825 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:32.001904 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:32.002474 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:32.003013 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:32.003888 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:32.004129 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:32.004212 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:32.009947 (+ 5735us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.1:60945: BlockingRecv error: recv got EOF from 127.17.255.1:60945 (error 108)
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":90,"threads_started":1}
Aug 12 17:43:32 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.2@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:32 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.2@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:32.204041 1330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:32.197903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.2:48965)
0812 17:43:32.198263 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:32.198277 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:32.198551 (+ 274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:32.198857 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:32.198860 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:32.199102 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:32.199206 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:32.199212 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:32.200002 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:32.200006 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:32.200608 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:32.200618 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:32.201097 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:32.201101 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:32.201188 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:32.201776 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:32.201789 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:32.203831 (+ 2042us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":126,"threads_started":1}
W20260812 17:43:32.204072 1328 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:32.198010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:48965 (local address 127.17.255.62:44587)
0812 17:43:32.198208 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:32.198213 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:32.198471 (+ 258us) server_negotiation.cc:407] Connection header received
0812 17:43:32.198671 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:32.198675 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:32.198733 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:32.198827 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:32.199334 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:32.199884 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:32.200747 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:32.200976 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:32.201087 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:32.203969 (+ 2882us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.2:48965: BlockingRecv error: recv got EOF from 127.17.255.2:48965 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 12 17:43:32 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.3@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:32 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.3@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:32.404500 1332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:32.398319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.3:39743)
0812 17:43:32.398673 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:32.398687 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:32.398813 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:32.399079 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:32.399081 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:32.399298 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:32.399406 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:32.399411 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:32.400185 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:32.400188 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:32.400752 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:32.400761 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:32.401311 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:32.401315 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:32.401387 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:32.401959 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:32.401973 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:32.404280 (+ 2307us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":111,"threads_started":1}
W20260812 17:43:32.404659 1328 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:32.398508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:39743 (local address 127.17.255.62:44587)
0812 17:43:32.398656 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:32.398659 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:32.398740 (+ 81us) server_negotiation.cc:407] Connection header received
0812 17:43:32.398913 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:32.398916 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:32.398964 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:32.399027 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:32.399537 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:32.400078 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:32.400931 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:32.401168 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:32.401269 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:32.404500 (+ 3231us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.3:39743: BlockingRecv error: recv got EOF from 127.17.255.3:39743 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 12 17:43:33 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.1@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:33 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.1@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:33.016152 1334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:33.010779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.1:37683)
0812 17:43:33.011068 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:33.011108 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:33.011229 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:33.011501 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:33.011503 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:33.011694 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:33.011795 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:33.011800 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:33.012551 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:33.012553 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:33.013107 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:33.013115 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:33.013536 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:33.013538 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:33.013599 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:33.014106 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:33.014118 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:33.016035 (+ 1917us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":86,"threads_started":1}
W20260812 17:43:33.016368 1336 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:33.010824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:37683 (local address 127.17.255.62:44587)
0812 17:43:33.011111 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:33.011121 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:33.011166 (+ 45us) server_negotiation.cc:407] Connection header received
0812 17:43:33.011316 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:33.011319 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:33.011363 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:33.011442 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:33.011916 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:33.012452 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:33.013208 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:33.013426 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:33.013500 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:33.016182 (+ 2682us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.1:37683: BlockingRecv error: recv got EOF from 127.17.255.1:37683 (error 108)
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":97,"threads_started":1}
Aug 12 17:43:33 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.2@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:33 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.2@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:33.211218 1338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:33.205004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.2:53491)
0812 17:43:33.205324 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:33.205338 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:33.205448 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:33.205712 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:33.205714 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:33.205918 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:33.206023 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:33.206028 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:33.206930 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:33.206934 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:33.207585 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:33.207594 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:33.208031 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:33.208034 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:33.208100 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:33.208854 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:33.208868 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:33.211027 (+ 2159us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":102,"threads_started":1}
W20260812 17:43:33.211302 1336 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:33.205073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:53491 (local address 127.17.255.62:44587)
0812 17:43:33.205252 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:33.205256 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:33.205441 (+ 185us) server_negotiation.cc:407] Connection header received
0812 17:43:33.205536 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:33.205539 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:33.205591 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:33.205655 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:33.206144 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:33.206798 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:33.207695 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:33.207921 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:33.207998 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:33.211182 (+ 3184us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.2:53491: BlockingRecv error: recv got EOF from 127.17.255.2:53491 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 12 17:43:33 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.3@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:33 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.3@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:33.412122 1340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:33.405608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.3:42809)
0812 17:43:33.405926 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:33.405943 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:33.406078 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:33.406419 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:33.406423 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:33.406688 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:33.406803 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:33.406809 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:33.407736 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:33.407742 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:33.408686 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:33.408699 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:33.409298 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:33.409301 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:33.409381 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:33.409923 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:33.409936 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:33.411996 (+ 2060us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":83,"threads_started":1}
W20260812 17:43:33.412257 1336 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:33.405801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:42809 (local address 127.17.255.62:44587)
0812 17:43:33.405984 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:33.405988 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:33.406022 (+ 34us) server_negotiation.cc:407] Connection header received
0812 17:43:33.406173 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:33.406175 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:33.406227 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:33.406301 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:33.406954 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:33.407561 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:33.408829 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:33.409185 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:33.409268 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:33.412135 (+ 2867us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.3:42809: BlockingRecv error: recv got EOF from 127.17.255.3:42809 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 12 17:43:34 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.1@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:34 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.1@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:34.022728 1341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:34.017016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.1:40271)
0812 17:43:34.017294 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:34.017314 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:34.017415 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:34.017652 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:34.017654 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:34.017841 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:34.017941 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:34.017946 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:34.018829 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:34.018832 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:34.019401 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:34.019409 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:34.019822 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:34.019824 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:34.019886 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:34.020397 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:34.020409 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:34.022563 (+ 2154us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":75,"threads_started":1}
W20260812 17:43:34.022878 1342 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:34.017144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:40271 (local address 127.17.255.62:44587)
0812 17:43:34.017426 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:34.017429 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:34.017447 (+ 18us) server_negotiation.cc:407] Connection header received
0812 17:43:34.017487 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:34.017489 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:34.017532 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:34.017611 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:34.018066 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:34.018723 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:34.019506 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:34.019723 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:34.019804 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:34.022742 (+ 2938us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.1:40271: BlockingRecv error: recv got EOF from 127.17.255.1:40271 (error 108)
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":80,"threads_started":1}
Aug 12 17:43:34 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.2@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:34 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.2@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:34.219686 1343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:34.212322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.2:58343)
0812 17:43:34.212722 (+ 400us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:34.212742 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:34.212897 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:34.213210 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:34.213215 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:34.213476 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:34.213625 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:34.213635 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:34.214651 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:34.214654 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:34.215571 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:34.215583 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:34.216389 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:34.216392 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:34.216464 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:34.217097 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:34.217113 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:34.219472 (+ 2359us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":157,"threads_started":1}
W20260812 17:43:34.219738 1342 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:34.212436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:58343 (local address 127.17.255.62:44587)
0812 17:43:34.212638 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:34.212643 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:34.212869 (+ 226us) server_negotiation.cc:407] Connection header received
0812 17:43:34.213010 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:34.213013 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:34.213068 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:34.213158 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:34.213759 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:34.214358 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:34.215754 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:34.216118 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:34.216234 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:34.219631 (+ 3397us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.2:58343: BlockingRecv error: recv got EOF from 127.17.255.2:58343 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 12 17:43:34 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.3@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:34 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.3@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:34.419163 1344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:34.412927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.3:54993)
0812 17:43:34.413238 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:34.413281 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:34.413399 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:34.413823 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:34.413826 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:34.414023 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:34.414140 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:34.414146 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:34.414970 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:34.414973 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:34.415558 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:34.415567 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:34.416129 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:34.416132 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:34.416201 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:34.416807 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:34.416819 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:34.419033 (+ 2214us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":74,"threads_started":1}
W20260812 17:43:34.419425 1342 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:34.413119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:54993 (local address 127.17.255.62:44587)
0812 17:43:34.413252 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:34.413256 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:34.413339 (+ 83us) server_negotiation.cc:407] Connection header received
0812 17:43:34.413611 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:34.413614 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:34.413667 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:34.413748 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:34.414258 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:34.414843 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:34.415729 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:34.415997 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:34.416103 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:34.419250 (+ 3147us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.3:54993: BlockingRecv error: recv got EOF from 127.17.255.3:54993 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 12 17:43:35 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.1@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:35 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.1@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:35.030400 1345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:35.023848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.1:41423)
0812 17:43:35.024162 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:35.024175 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:35.024261 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:35.024541 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:35.024543 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:35.024738 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:35.024853 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:35.024859 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:35.025793 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:35.025796 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:35.026627 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:35.026641 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:35.027201 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:35.027204 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:35.027326 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:35.028050 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:35.028062 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:35.030259 (+ 2197us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":120,"threads_started":1}
W20260812 17:43:35.030623 1347 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:35.023934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:41423 (local address 127.17.255.62:44587)
0812 17:43:35.024210 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:35.024214 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:35.024231 (+ 17us) server_negotiation.cc:407] Connection header received
0812 17:43:35.024363 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:35.024365 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:35.024413 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:35.024506 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:35.024973 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:35.025594 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:35.026746 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:35.027043 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:35.027172 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:35.030459 (+ 3287us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.1:41423: BlockingRecv error: recv got EOF from 127.17.255.1:41423 (error 108)
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":109,"threads_started":1}
Aug 12 17:43:35 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.2@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:35 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.2@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:35.226863 1349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:35.220679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.2:52203)
0812 17:43:35.221023 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:35.221038 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:35.221157 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:35.221426 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:35.221428 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:35.221627 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:35.221727 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:35.221732 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:35.222796 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:35.222799 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:35.223362 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:35.223370 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:35.223871 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:35.223875 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:35.223947 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:35.224499 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:35.224511 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:35.226724 (+ 2213us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":114,"threads_started":1}
W20260812 17:43:35.227008 1347 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:35.220904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:52203 (local address 127.17.255.62:44587)
0812 17:43:35.221065 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:35.221069 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:35.221085 (+ 16us) server_negotiation.cc:407] Connection header received
0812 17:43:35.221259 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:35.221262 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:35.221312 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:35.221384 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:35.221877 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:35.222665 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:35.223482 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:35.223724 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:35.223839 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:35.226881 (+ 3042us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.2:52203: BlockingRecv error: recv got EOF from 127.17.255.2:52203 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 12 17:43:35 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.3@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:35 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.3@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:35.426956 1350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:35.420161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.3:52297)
0812 17:43:35.420486 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:35.420500 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:35.420618 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:35.421005 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:35.421008 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:35.421204 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:35.421346 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:35.421352 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:35.422343 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:35.422346 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:35.423245 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:35.423255 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:35.423741 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:35.423745 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:35.423827 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:35.424424 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:35.424437 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:35.426748 (+ 2311us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":126,"threads_started":1}
W20260812 17:43:35.427142 1347 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:35.420263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:52297 (local address 127.17.255.62:44587)
0812 17:43:35.420425 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:35.420429 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:35.420647 (+ 218us) server_negotiation.cc:407] Connection header received
0812 17:43:35.420703 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:35.420705 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:35.420755 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:35.420904 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:35.421505 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:35.422171 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:35.423382 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:35.423614 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:35.423736 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:35.426980 (+ 3244us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.3:52297: BlockingRecv error: recv got EOF from 127.17.255.3:52297 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 12 17:43:36 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.1@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:36 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.1@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:36.037563 1351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:36.031368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.1:36199)
0812 17:43:36.031709 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:36.031724 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:36.031889 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:36.032291 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:36.032294 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:36.032638 (+ 344us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:36.032794 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:36.032801 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:36.033854 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:36.033858 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:36.034470 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:36.034480 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:36.034954 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:36.034957 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:36.035016 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:36.035546 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:36.035558 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:36.037446 (+ 1888us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":102,"threads_started":1}
W20260812 17:43:36.037773 1353 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:36.031509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:36199 (local address 127.17.255.62:44587)
0812 17:43:36.031762 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:36.031766 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:36.031836 (+ 70us) server_negotiation.cc:407] Connection header received
0812 17:43:36.032019 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:36.032021 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:36.032095 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:36.032202 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:36.032920 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:36.033749 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:36.034611 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:36.034847 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:36.034939 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:36.037592 (+ 2653us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.1:36199: BlockingRecv error: recv got EOF from 127.17.255.1:36199 (error 108)
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":70,"threads_started":1}
Aug 12 17:43:36 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.2@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:36 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.2@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:36.233986 1355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:36.227777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.2:40281)
0812 17:43:36.228077 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:36.228092 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:36.228207 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:36.228518 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:36.228521 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:36.228728 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:36.228838 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:36.228845 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:36.229735 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:36.229738 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:36.230429 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:36.230439 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:36.230968 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:36.230971 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:36.231059 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:36.231652 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:36.231665 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:36.233801 (+ 2136us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":82,"threads_started":1}
W20260812 17:43:36.234082 1353 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:36.227924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:40281 (local address 127.17.255.62:44587)
0812 17:43:36.228107 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:36.228112 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:36.228180 (+ 68us) server_negotiation.cc:407] Connection header received
0812 17:43:36.228302 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:36.228304 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:36.228367 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:36.228445 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:36.228990 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:36.229622 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:36.230592 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:36.230840 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:36.230962 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:36.233948 (+ 2986us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.2:40281: BlockingRecv error: recv got EOF from 127.17.255.2:40281 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 12 17:43:36 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.3@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:36 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.3@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:36.433985 1356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:36.427916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.3:34791)
0812 17:43:36.428202 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:36.428217 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:36.428361 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:36.428749 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:36.428751 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:36.428996 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:36.429100 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:36.429107 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:36.430029 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:36.430035 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:36.430714 (+ 679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:36.430724 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:36.431144 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:36.431147 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:36.431210 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:36.431794 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:36.431807 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:36.433846 (+ 2039us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":98,"threads_started":1}
W20260812 17:43:36.434252 1353 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:36.428014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:34791 (local address 127.17.255.62:44587)
0812 17:43:36.428171 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:36.428176 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:36.428300 (+ 124us) server_negotiation.cc:407] Connection header received
0812 17:43:36.428527 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:36.428533 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:36.428599 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:36.428710 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:36.429215 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:36.429908 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:36.430822 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:36.431046 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:36.431127 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:36.434005 (+ 2878us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.3:34791: BlockingRecv error: recv got EOF from 127.17.255.3:34791 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 12 17:43:37 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.1@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:37 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.1@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:37.051991 1358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:37.038469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.1:36261)
0812 17:43:37.038805 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:37.038819 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:37.038945 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:37.039224 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:37.039226 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:37.039420 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:37.039523 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:37.039529 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:37.040316 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:37.040319 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:37.040917 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:37.040931 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:37.041374 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:37.041377 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:37.041447 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:37.049264 (+ 7817us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:37.049280 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:37.051823 (+ 2543us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":77,"threads_started":1}
W20260812 17:43:37.052223 1362 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:37.038519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:36261 (local address 127.17.255.62:44587)
0812 17:43:37.038827 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:37.038831 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:37.038906 (+ 75us) server_negotiation.cc:407] Connection header received
0812 17:43:37.039048 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:37.039051 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:37.039099 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:37.039179 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:37.039636 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:37.040186 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:37.041040 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:37.041262 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:37.041340 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:37.052060 (+ 10720us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.1:36261: BlockingRecv error: recv got EOF from 127.17.255.1:36261 (error 108)
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":101,"threads_started":1}
Aug 12 17:43:37 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.2@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:37 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.2@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:37.241027 1363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:37.235084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.2:58583)
0812 17:43:37.235475 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:37.235489 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:37.235656 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:37.235954 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:37.235956 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:37.236185 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:37.236308 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:37.236314 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:37.237097 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:37.237102 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:37.237693 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:37.237703 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:37.238188 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:37.238192 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:37.238285 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:37.238888 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:37.238902 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:37.240881 (+ 1979us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":94,"threads_started":1}
W20260812 17:43:37.241212 1362 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:37.235185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:58583 (local address 127.17.255.62:44587)
0812 17:43:37.235373 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:37.235379 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:37.235591 (+ 212us) server_negotiation.cc:407] Connection header received
0812 17:43:37.235770 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:37.235776 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:37.235831 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:37.235925 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:37.236438 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:37.236980 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:37.237821 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:37.238060 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:37.238171 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:37.241069 (+ 2898us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.2:58583: BlockingRecv error: recv got EOF from 127.17.255.2:58583 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 12 17:43:37 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.3@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:37 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.3@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:37.440526 1364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:37.434846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.3:47625)
0812 17:43:37.435181 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:37.435194 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:37.435294 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:37.435578 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:37.435580 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:37.435768 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:37.435863 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:37.435868 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:37.436661 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:37.436665 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:37.437235 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:37.437244 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:37.437736 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:37.437739 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:37.437828 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:37.438346 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:37.438359 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:37.440405 (+ 2046us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":93,"threads_started":1}
W20260812 17:43:37.440675 1362 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:37.434927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:47625 (local address 127.17.255.62:44587)
0812 17:43:37.435081 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:37.435085 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:37.435266 (+ 181us) server_negotiation.cc:407] Connection header received
0812 17:43:37.435391 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:37.435394 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:37.435461 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:37.435535 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:37.435979 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:37.436534 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:37.437397 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:37.437615 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:37.437693 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:37.440545 (+ 2852us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.3:47625: BlockingRecv error: recv got EOF from 127.17.255.3:47625 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 12 17:43:38 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.1@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:38 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.1@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:38.058913 1365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:38.052980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.1:56897)
0812 17:43:38.053286 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:38.053299 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:38.053397 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:38.053678 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:38.053680 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:38.053865 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:38.053983 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:38.053989 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:38.054856 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:38.054858 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:38.055431 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:38.055441 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:38.055989 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:38.055992 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:38.056064 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:38.056622 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:38.056635 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:38.058782 (+ 2147us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":123,"threads_started":1}
W20260812 17:43:38.059130 1366 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:38.053161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:56897 (local address 127.17.255.62:44587)
0812 17:43:38.053424 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:38.053427 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:38.053459 (+ 32us) server_negotiation.cc:407] Connection header received
0812 17:43:38.053500 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:38.053502 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:38.053568 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:38.053641 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:38.054128 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:38.054752 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:38.055573 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:38.055846 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:38.055949 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:38.058956 (+ 3007us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.1:56897: BlockingRecv error: recv got EOF from 127.17.255.1:56897 (error 108)
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":62,"threads_started":1}
Aug 12 17:43:38 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.2@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:38 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.2@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:38.247831 1368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:38.241961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.2:33117)
0812 17:43:38.242320 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:38.242336 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:38.242479 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:38.242775 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:38.242778 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:38.242969 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:38.243077 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:38.243083 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:38.244054 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:38.244056 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:38.244636 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:38.244645 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:38.245115 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:38.245117 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:38.245178 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:38.245728 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:38.245740 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:38.247707 (+ 1967us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":137,"threads_started":1}
W20260812 17:43:38.248063 1366 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:38.242048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:33117 (local address 127.17.255.62:44587)
0812 17:43:38.242202 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:38.242206 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:38.242429 (+ 223us) server_negotiation.cc:407] Connection header received
0812 17:43:38.242570 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:38.242573 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:38.242622 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:38.242700 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:38.243193 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:38.243948 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:38.244763 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:38.245008 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:38.245097 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:38.247930 (+ 2833us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.2:33117: BlockingRecv error: recv got EOF from 127.17.255.2:33117 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 12 17:43:38 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.3@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:38 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.3@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:38.447217 1374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:38.441488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.3:42827)
0812 17:43:38.441820 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:38.441833 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:38.441940 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:38.442197 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:38.442199 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:38.442479 (+ 280us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:38.442594 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:38.442600 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:38.443524 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:38.443530 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:38.444103 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:38.444113 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:38.444588 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:38.444592 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:38.444683 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:38.445191 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:38.445203 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:38.447096 (+ 1893us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":140,"threads_started":1}
W20260812 17:43:38.447520 1366 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:38.441643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:42827 (local address 127.17.255.62:44587)
0812 17:43:38.441805 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:38.441808 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:38.441943 (+ 135us) server_negotiation.cc:407] Connection header received
0812 17:43:38.442013 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:38.442016 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:38.442066 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:38.442146 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:38.442747 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:38.443378 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:38.444233 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:38.444467 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:38.444577 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:38.447243 (+ 2666us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.3:42827: BlockingRecv error: recv got EOF from 127.17.255.3:42827 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 12 17:43:39 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.1@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:39 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.1@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:39.065564 1376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:39.059774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.1:35413)
0812 17:43:39.060080 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:39.060094 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:39.060192 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:39.060453 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:39.060455 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:39.060655 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:39.060756 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:39.060761 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:39.061517 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:39.061519 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:39.062087 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:39.062095 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:39.062626 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:39.062629 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:39.062695 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:39.063200 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:39.063211 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:39.065358 (+ 2147us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":97,"threads_started":1}
W20260812 17:43:39.065660 1379 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:39.059881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:35413 (local address 127.17.255.62:44587)
0812 17:43:39.060149 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:39.060153 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:39.060167 (+ 14us) server_negotiation.cc:407] Connection header received
0812 17:43:39.060285 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:39.060287 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:39.060333 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:39.060409 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:39.060859 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:39.061411 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:39.062206 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:39.062514 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:39.062608 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:39.065514 (+ 2906us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.1:35413: BlockingRecv error: recv got EOF from 127.17.255.1:35413 (error 108)
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":75,"threads_started":1}
Aug 12 17:43:39 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.2@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:39 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.2@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:39.254727 1380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:39.248647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.2:33179)
0812 17:43:39.249034 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:39.249051 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:39.249179 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:39.249506 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:39.249509 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:39.249740 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:39.249861 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:39.249867 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:39.250735 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:39.250740 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:39.251317 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:39.251326 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:39.251800 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:39.251803 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:39.251894 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:39.252503 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:39.252522 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:39.254584 (+ 2062us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":144,"threads_started":1}
W20260812 17:43:39.254881 1379 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:39.248837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:33179 (local address 127.17.255.62:44587)
0812 17:43:39.249023 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:39.249028 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:39.249116 (+ 88us) server_negotiation.cc:407] Connection header received
0812 17:43:39.249334 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:39.249337 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:39.249385 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:39.249477 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:39.249990 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:39.250620 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:39.251448 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:39.251678 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:39.251792 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:39.254728 (+ 2936us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.2:33179: BlockingRecv error: recv got EOF from 127.17.255.2:33179 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 12 17:43:39 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.3@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:39 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.3@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:39.453616 1381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:39.448102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.3:51767)
0812 17:43:39.448389 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:39.448402 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:39.448506 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:39.448747 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:39.448749 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:39.448936 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:39.449036 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:39.449041 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:39.449844 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:39.449846 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:39.450482 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:39.450492 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:39.450924 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:39.450927 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:39.450989 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:39.451563 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:39.451576 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:39.453476 (+ 1900us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":112,"threads_started":1}
W20260812 17:43:39.453812 1379 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:39.448147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:51767 (local address 127.17.255.62:44587)
0812 17:43:39.448283 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:39.448287 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:39.448468 (+ 181us) server_negotiation.cc:407] Connection header received
0812 17:43:39.448590 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:39.448592 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:39.448644 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:39.448707 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:39.449142 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:39.449745 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:39.450592 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:39.450827 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:39.450911 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:39.453639 (+ 2728us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.3:51767: BlockingRecv error: recv got EOF from 127.17.255.3:51767 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 12 17:43:40 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.1@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:40 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.1@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:40.072852 1382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:40.066915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.1:56225)
0812 17:43:40.067255 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:40.067280 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:40.067390 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:40.067655 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:40.067658 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:40.067846 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:40.067947 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:40.067952 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:40.068737 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:40.068740 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:40.069328 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:40.069336 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:40.069871 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:40.069875 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:40.069970 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:40.070584 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:40.070597 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:40.072647 (+ 2050us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":96,"threads_started":1}
W20260812 17:43:40.072896 1383 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:40.067021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:56225 (local address 127.17.255.62:44587)
0812 17:43:40.067328 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:40.067331 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:40.067347 (+ 16us) server_negotiation.cc:407] Connection header received
0812 17:43:40.067466 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:40.067468 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:40.067533 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:40.067611 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:40.068071 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:40.068623 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:40.069435 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:40.069739 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:40.069862 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:40.072775 (+ 2913us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.1:56225: BlockingRecv error: recv got EOF from 127.17.255.1:56225 (error 108)
Metrics: {"server-negotiator.queue_time_us":233,"thread_start_us":122,"threads_started":1}
Aug 12 17:43:40 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.2@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:40 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.2@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:40.261843 1385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:40.255621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.2:42293)
0812 17:43:40.256047 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:40.256060 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:40.256194 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:40.256492 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:40.256496 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:40.256737 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:40.256851 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:40.256857 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:40.257816 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:40.257821 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:40.258493 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:40.258504 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:40.259085 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:40.259088 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:40.259158 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:40.259752 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:40.259765 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:40.261718 (+ 1953us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":135,"threads_started":1}
W20260812 17:43:40.262077 1383 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:40.255698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:42293 (local address 127.17.255.62:44587)
0812 17:43:40.255886 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:40.255895 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:40.256148 (+ 253us) server_negotiation.cc:407] Connection header received
0812 17:43:40.256317 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:40.256320 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:40.256367 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:40.256466 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:40.256990 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:40.257591 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:40.258630 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:40.258965 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:40.259056 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:40.261936 (+ 2880us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.2:42293: BlockingRecv error: recv got EOF from 127.17.255.2:42293 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 12 17:43:40 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.3@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:40 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.3@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:40.461077 1387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:40.454621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.3:53281)
0812 17:43:40.455023 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:40.455040 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:40.455206 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:40.455521 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:40.455524 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:40.455748 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:40.455868 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:40.455874 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:40.456666 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:40.456671 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:40.457244 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:40.457252 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:40.457727 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:40.457731 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:40.457828 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:40.458614 (+ 786us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:40.458627 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:40.460900 (+ 2273us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":144,"threads_started":1}
W20260812 17:43:40.461138 1383 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:40.454848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:53281 (local address 127.17.255.62:44587)
0812 17:43:40.455029 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:40.455036 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:40.455143 (+ 107us) server_negotiation.cc:407] Connection header received
0812 17:43:40.455352 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:40.455355 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:40.455404 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:40.455499 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:40.456003 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:40.456550 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:40.457374 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:40.457603 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:40.457720 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:40.461029 (+ 3309us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.3:53281: BlockingRecv error: recv got EOF from 127.17.255.3:53281 (error 108)
Metrics: {"server-negotiator.queue_time_us":99}
Aug 12 17:43:41 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.1@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:41 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.1@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:41.079854 1389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:41.073814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.1:59919)
0812 17:43:41.074150 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:41.074165 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:41.074267 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:41.074619 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:41.074622 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:41.074849 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:41.074969 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:41.074975 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:41.075782 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:41.075787 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:41.076469 (+ 682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:41.076487 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:41.076964 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:41.076968 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:41.077061 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:41.077676 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:41.077689 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:41.079727 (+ 2038us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":106,"threads_started":1}
W20260812 17:43:41.080157 1393 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:41.073980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:59919 (local address 127.17.255.62:44587)
0812 17:43:41.074235 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:41.074239 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:41.074254 (+ 15us) server_negotiation.cc:407] Connection header received
0812 17:43:41.074423 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:41.074426 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:41.074473 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:41.074592 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:41.075106 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:41.075660 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:41.076599 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:41.076840 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:41.076958 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:41.080003 (+ 3045us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.1:59919: BlockingRecv error: recv got EOF from 127.17.255.1:59919 (error 108)
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":70,"threads_started":1}
Aug 12 17:43:41 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.2@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:41 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.2@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:41.268414 1394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:41.262663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.2:48371)
0812 17:43:41.262967 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:41.262984 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:41.263097 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:41.263356 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:41.263358 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:41.263564 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:41.263669 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:41.263674 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:41.264416 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:41.264419 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:41.264983 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:41.264992 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:41.265527 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:41.265530 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:41.265592 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:41.266151 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:41.266163 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:41.268278 (+ 2115us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":92,"threads_started":1}
W20260812 17:43:41.268748 1393 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:41.262855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:48371 (local address 127.17.255.62:44587)
0812 17:43:41.263025 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:41.263029 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:41.263045 (+ 16us) server_negotiation.cc:407] Connection header received
0812 17:43:41.263191 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:41.263194 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:41.263240 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:41.263309 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:41.263774 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:41.264298 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:41.265120 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:41.265401 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:41.265506 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:41.268532 (+ 3026us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.2:48371: BlockingRecv error: recv got EOF from 127.17.255.2:48371 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 12 17:43:41 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.3@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:41 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.3@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:41.472410 1395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:41.462117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.3:54159)
0812 17:43:41.464016 (+ 1899us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:41.464035 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:41.464178 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:41.466565 (+ 2387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:41.466568 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:41.466787 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:41.466894 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:41.466899 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:41.467703 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:41.467707 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:41.468283 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:41.468293 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:41.468980 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:41.468983 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:41.469054 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:41.469732 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:41.469754 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:41.472225 (+ 2471us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":1803,"thread_start_us":1702,"threads_started":1}
W20260812 17:43:41.472482 1393 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:41.466071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:54159 (local address 127.17.255.62:44587)
0812 17:43:41.466255 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:41.466261 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:41.466280 (+ 19us) server_negotiation.cc:407] Connection header received
0812 17:43:41.466331 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:41.466336 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:41.466425 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:41.466521 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:41.467026 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:41.467568 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:41.468395 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:41.468841 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:41.468937 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:41.472369 (+ 3432us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.3:54159: BlockingRecv error: recv got EOF from 127.17.255.3:54159 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 12 17:43:42 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.1@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:42 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.1@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:42.092906 1396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:42.080959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.1:49949)
0812 17:43:42.081296 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:42.081311 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:42.081447 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:42.081776 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:42.081780 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:42.081998 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:42.082103 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:42.082110 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:42.083107 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:42.083111 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:42.083942 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:42.083957 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:42.084558 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:42.084561 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:42.084631 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:42.090020 (+ 5389us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:42.090039 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:42.092764 (+ 2725us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":122,"threads_started":1}
W20260812 17:43:42.093242 1397 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:42.081136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:49949 (local address 127.17.255.62:44587)
0812 17:43:42.081422 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:42.081426 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:42.081442 (+ 16us) server_negotiation.cc:407] Connection header received
0812 17:43:42.081537 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:42.081539 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:42.081584 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:42.081679 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:42.082281 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:42.082949 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:42.084121 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:42.084432 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:42.084521 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:42.093069 (+ 8548us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.1:49949: BlockingRecv error: recv got EOF from 127.17.255.1:49949 (error 108)
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":111,"threads_started":1}
Aug 12 17:43:42 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.2@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:42 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.2@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:42.274933 1398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:42.269171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.2:53343)
0812 17:43:42.269541 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:42.269565 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:42.269712 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:42.270018 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:42.270021 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:42.270239 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:42.270352 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:42.270357 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:42.271157 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:42.271162 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:42.271725 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:42.271733 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:42.272218 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:42.272222 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:42.272309 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:42.272829 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:42.272842 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:42.274758 (+ 1916us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":117,"threads_started":1}
W20260812 17:43:42.275002 1397 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:42.269317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:53343 (local address 127.17.255.62:44587)
0812 17:43:42.269512 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:42.269517 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:42.269646 (+ 129us) server_negotiation.cc:407] Connection header received
0812 17:43:42.269839 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:42.269843 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:42.269900 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:42.269988 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:42.270509 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:42.271041 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:42.271861 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:42.272091 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:42.272201 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:42.274894 (+ 2693us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.2:53343: BlockingRecv error: recv got EOF from 127.17.255.2:53343 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 12 17:43:42 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.3@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:42 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.3@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:42.479434 1399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:42.473642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.3:37471)
0812 17:43:42.473981 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:42.473996 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:42.474143 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:42.474498 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:42.474503 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:42.474733 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:42.474850 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:42.474857 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:42.475614 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:42.475617 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:42.476190 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:42.476198 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:42.476699 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:42.476702 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:42.476775 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:42.477389 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:42.477403 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:42.479312 (+ 1909us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":90,"threads_started":1}
W20260812 17:43:42.479647 1397 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:42.473762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:37471 (local address 127.17.255.62:44587)
0812 17:43:42.473915 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:42.473922 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:42.474108 (+ 186us) server_negotiation.cc:407] Connection header received
0812 17:43:42.474263 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:42.474266 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:42.474323 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:42.474465 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:42.474965 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:42.475509 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:42.476320 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:42.476557 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:42.476647 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:42.479502 (+ 2855us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.3:37471: BlockingRecv error: recv got EOF from 127.17.255.3:37471 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 12 17:43:43 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.1@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:43 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.1@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:43.100232 1400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:43.094019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.1:55815)
0812 17:43:43.094539 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:43.094552 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:43.094703 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:43.095061 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:43.095064 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:43.095271 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:43.095411 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:43.095418 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:43.096255 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:43.096258 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:43.096872 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:43.096882 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:43.097352 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:43.097359 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:43.097444 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:43.098084 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:43.098097 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:43.100106 (+ 2009us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":100,"threads_started":1}
W20260812 17:43:43.100543 1401 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:43.094083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:55815 (local address 127.17.255.62:44587)
0812 17:43:43.094478 (+ 395us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:43.094483 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:43.094662 (+ 179us) server_negotiation.cc:407] Connection header received
0812 17:43:43.094815 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:43.094821 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:43.094889 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:43.095004 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:43.095559 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:43.096132 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:43.096992 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:43.097220 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:43.097302 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:43.100368 (+ 3066us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.1:55815: BlockingRecv error: recv got EOF from 127.17.255.1:55815 (error 108)
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":96,"threads_started":1}
Aug 12 17:43:43 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.2@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:43 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.2@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:43.282295 1403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:43.275950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.2:47951)
0812 17:43:43.276385 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:43.276401 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:43.276528 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:43.276896 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:43.276899 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:43.277143 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:43.277285 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:43.277294 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:43.278176 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:43.278178 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:43.278818 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:43.278827 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:43.279310 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:43.279313 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:43.279391 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:43.279981 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:43.279994 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:43.282113 (+ 2119us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":103,"threads_started":1}
W20260812 17:43:43.282565 1401 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:43.276185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:47951 (local address 127.17.255.62:44587)
0812 17:43:43.276382 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:43.276386 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:43.276484 (+ 98us) server_negotiation.cc:407] Connection header received
0812 17:43:43.276637 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:43.276640 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:43.276709 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:43.276814 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:43.277450 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:43.278071 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:43.278958 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:43.279183 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:43.279268 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:43.282324 (+ 3056us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.2:47951: BlockingRecv error: recv got EOF from 127.17.255.2:47951 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 12 17:43:43 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.3@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:43 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.3@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:43.486474 1405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:43.480294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.3:55853)
0812 17:43:43.480640 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:43.480658 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:43.480835 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:43.481134 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:43.481137 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:43.481369 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:43.481467 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:43.481473 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:43.482275 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:43.482278 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:43.483051 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:43.483067 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:43.483658 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:43.483661 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:43.483755 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:43.484338 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:43.484360 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:43.486257 (+ 1897us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":92,"threads_started":1}
W20260812 17:43:43.486519 1401 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:43.480454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:55853 (local address 127.17.255.62:44587)
0812 17:43:43.480631 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:43.480636 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:43.480756 (+ 120us) server_negotiation.cc:407] Connection header received
0812 17:43:43.480963 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:43.480966 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:43.481015 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:43.481103 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:43.481594 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:43.482134 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:43.483193 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:43.483528 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:43.483653 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:43.486416 (+ 2763us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.3:55853: BlockingRecv error: recv got EOF from 127.17.255.3:55853 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 12 17:43:44 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.1@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:44 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.1@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:44.108006 1406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:44.101335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.1:50953)
0812 17:43:44.101659 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:44.101678 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:44.101817 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:44.102123 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:44.102125 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:44.102324 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:44.102513 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:44.102519 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:44.103374 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:44.103377 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:44.104069 (+ 692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:44.104080 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:44.104711 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:44.104715 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:44.104836 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:44.105540 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:44.105554 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:44.107851 (+ 2297us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":87,"threads_started":1}
W20260812 17:43:44.108186 1409 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:44.101488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:50953 (local address 127.17.255.62:44587)
0812 17:43:44.101870 (+ 382us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:44.101874 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:44.101891 (+ 17us) server_negotiation.cc:407] Connection header received
0812 17:43:44.101940 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:44.101942 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:44.101988 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:44.102077 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:44.102664 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:44.103235 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:44.104228 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:44.104514 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:44.104634 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:44.108040 (+ 3406us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.1:50953: BlockingRecv error: recv got EOF from 127.17.255.1:50953 (error 108)
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":90,"threads_started":1}
Aug 12 17:43:44 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.2@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:44 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.2@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:44.289502 1411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:44.283329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.2:60463)
0812 17:43:44.283617 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:44.283632 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:44.283741 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:44.284032 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:44.284034 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:44.284225 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:44.284339 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:44.284344 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:44.285158 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:44.285162 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:44.285746 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:44.285755 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:44.286314 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:44.286317 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:44.286467 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:44.287091 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:44.287104 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:44.289308 (+ 2204us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":102,"threads_started":1}
W20260812 17:43:44.289728 1409 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:44.283389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:60463 (local address 127.17.255.62:44587)
0812 17:43:44.283569 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:44.283573 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:44.283743 (+ 170us) server_negotiation.cc:407] Connection header received
0812 17:43:44.283850 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:44.283853 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:44.283907 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:44.284005 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:44.284456 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:44.285038 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:44.285870 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:44.286138 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:44.286223 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:44.289595 (+ 3372us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.2:60463: BlockingRecv error: recv got EOF from 127.17.255.2:60463 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 12 17:43:44 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.3@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:44 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.3@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:44.493770 1412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:44.487386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.3:54139)
0812 17:43:44.487745 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:44.487769 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:44.487924 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:44.488209 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:44.488213 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:44.488450 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:44.488548 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:44.488555 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:44.489375 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:44.489379 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:44.489965 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:44.489974 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:44.490571 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:44.490575 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:44.490668 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:44.491202 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:44.491230 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:44.493535 (+ 2305us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":101,"threads_started":1}
W20260812 17:43:44.493933 1409 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:44.487493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:54139 (local address 127.17.255.62:44587)
0812 17:43:44.487705 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:44.487710 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:44.487852 (+ 142us) server_negotiation.cc:407] Connection header received
0812 17:43:44.488033 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:44.488036 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:44.488095 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:44.488185 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:44.488680 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:44.489230 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:44.490096 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:44.490440 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:44.490564 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:44.493703 (+ 3139us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.3:54139: BlockingRecv error: recv got EOF from 127.17.255.3:54139 (error 108)
Metrics: {"server-negotiator.queue_time_us":109}
Aug 12 17:43:45 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.1@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:45 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.1@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:45.115654 1413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:45.109047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.1:33639)
0812 17:43:45.109393 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:45.109407 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:45.109508 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:45.109845 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:45.109848 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:45.110048 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:45.110156 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:45.110162 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:45.111275 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:45.111278 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:45.112065 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:45.112080 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:45.112713 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:45.112717 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:45.112804 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:45.113437 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:45.113450 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:45.115535 (+ 2085us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":78,"threads_started":1}
W20260812 17:43:45.115898 1414 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:45.109199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:33639 (local address 127.17.255.62:44587)
0812 17:43:45.109484 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:45.109488 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:45.109504 (+ 16us) server_negotiation.cc:407] Connection header received
0812 17:43:45.109613 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:45.109616 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:45.109662 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:45.109750 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:45.110350 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:45.111128 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:45.112218 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:45.112574 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:45.112684 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:45.115727 (+ 3043us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.1:33639: BlockingRecv error: recv got EOF from 127.17.255.1:33639 (error 108)
Metrics: {"server-negotiator.queue_time_us":201,"thread_start_us":87,"threads_started":1}
Aug 12 17:43:45 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.2@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
Aug 12 17:43:45 dist-test-slave-tk9z krb5kdc[32026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.255.2@KRBTEST.COM for oryx/127.17.255.62@KRBTEST.COM, Server not found in Kerberos database
I20260812 17:43:45.297348 1416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:45.290931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:44587 (local address 127.17.255.2:45185)
0812 17:43:45.291220 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:45.291241 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:45.291392 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:45.291728 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:45.291731 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:45.291946 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:45.292055 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:45.292060 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:45.292824 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:45.292827 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:45.293441 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:45.293451 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:45.294088 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:45.294092 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:45.294159 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:45.294900 (+ 741us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:45.294913 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:45.297191 (+ 2278us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.255.62:44587: Server oryx/127.17.255.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":114,"threads_started":1}
W20260812 17:43:45.297531 1414 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:45.290978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:45185 (local address 127.17.255.62:44587)
0812 17:43:45.291150 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:45.291154 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:45.291362 (+ 208us) server_negotiation.cc:407] Connection header received
0812 17:43:45.291481 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:45.291484 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:45.291534 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:45.291624 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:45.292180 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:45.292714 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:45.293613 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:45.293947 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:45.294083 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:45.297378 (+ 3295us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.255.2:45185: BlockingRecv error: recv got EOF from 127.17.255.2:45185 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 17:43:45.365427 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 595
I20260812 17:43:45.380581 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 855
I20260812 17:43:45.397204 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 1101
I20260812 17:43:45.409232 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 464
2026-08-12T17:43:45Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18455 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-12T17:43:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:43:45Z Disabled control of system clock
I20260812 17:43:45.452841 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:45161
--webserver_interface=127.17.255.62
--webserver_port=0
--builtin_ntp_servers=127.17.255.20:39525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:45161
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260812 17:43:45.572275 1426 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:45.572569 1426 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:45.572604 1426 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:45.576824 1426 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:43:45.576893 1426 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:45.576910 1426 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:45.576932 1426 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:43:45.576987 1426 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:43:45.581965 1426 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:39525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:45161
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:45161
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1426
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:45.583205 1426 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:45.584662 1426 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:45.593583 1433 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:45.593746 1426 server_base.cc:1034] running on GCE node
W20260812 17:43:45.593588 1439 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:45.593552 1436 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:45.594676 1426 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:45.595944 1426 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:45.597131 1426 hybrid_clock.cc:648] HybridClock initialized: now 1786556625597096 us; error 51 us; skew 500 ppm
I20260812 17:43:45.599359 1426 webserver.cc:460] Webserver started at http://127.17.255.62:42109/ using document root <none> and password file <none>
I20260812 17:43:45.600004 1426 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:45.600068 1426 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:45.600299 1426 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:45.602447 1426 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "c3b51d1e465e4f17b076e33d1f202b73"
format_stamp: "Formatted at 2026-08-12 17:43:45 on dist-test-slave-tk9z"
server_key: "99a15c68a5b927e598d591d582609520"
server_key_iv: "941cc355a542563695cb1be622bbdb4e"
server_key_version: "encryptionkey@0"
I20260812 17:43:45.603055 1426 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "c3b51d1e465e4f17b076e33d1f202b73"
format_stamp: "Formatted at 2026-08-12 17:43:45 on dist-test-slave-tk9z"
server_key: "99a15c68a5b927e598d591d582609520"
server_key_iv: "941cc355a542563695cb1be622bbdb4e"
server_key_version: "encryptionkey@0"
I20260812 17:43:45.606817 1426 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 17:43:45.609333 1460 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:45.610638 1426 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 17:43:45.610787 1426 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "c3b51d1e465e4f17b076e33d1f202b73"
format_stamp: "Formatted at 2026-08-12 17:43:45 on dist-test-slave-tk9z"
server_key: "99a15c68a5b927e598d591d582609520"
server_key_iv: "941cc355a542563695cb1be622bbdb4e"
server_key_version: "encryptionkey@0"
I20260812 17:43:45.610913 1426 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:45.624728 1426 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:45.625535 1426 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:45.625756 1426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:45.633332 1426 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:45161
I20260812 17:43:45.633335 1556 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:45161 every 8 connection(s)
I20260812 17:43:45.634492 1426 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:43:45.638048 1557 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:45.639595 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 1426
I20260812 17:43:45.639751 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:43:45.640097 18428 external_mini_cluster.cc:1428] Setting key b38b76428f930dcfb2ffbbffa84abf0a
I20260812 17:43:45.644994 1557 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3b51d1e465e4f17b076e33d1f202b73: Bootstrap starting.
I20260812 17:43:45.647948 1557 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c3b51d1e465e4f17b076e33d1f202b73: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:45.648823 1557 log.cc:824] T 00000000000000000000000000000000 P c3b51d1e465e4f17b076e33d1f202b73: Log is configured to *not* fsync() on all Append() calls
I20260812 17:43:45.650204 1564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:45.641653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57308 (local address 127.17.255.62:45161)
0812 17:43:45.642330 (+ 677us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:45.642346 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:45.642440 (+ 94us) server_negotiation.cc:407] Connection header received
0812 17:43:45.643140 (+ 700us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:45.643160 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:45.643576 (+ 416us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:45.643864 (+ 288us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:45.644231 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:45.645259 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:45.646529 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:45.647034 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:45.647170 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:45.648150 (+ 980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:45.648156 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:45.648170 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:43:45.648584 (+ 414us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:45.648643 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:43:45.648665 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:45.648745 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:45.648949 (+ 204us) server_negotiation.cc:299] Negotiation successful
0812 17:43:45.649288 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":155,"threads_started":1}
I20260812 17:43:45.651193 1557 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3b51d1e465e4f17b076e33d1f202b73: No bootstrap required, opened a new log
I20260812 17:43:45.655359 1557 raft_consensus.cc:348] T 00000000000000000000000000000000 P c3b51d1e465e4f17b076e33d1f202b73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3b51d1e465e4f17b076e33d1f202b73" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45161 } }
I20260812 17:43:45.655632 1557 raft_consensus.cc:374] T 00000000000000000000000000000000 P c3b51d1e465e4f17b076e33d1f202b73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:45.655671 1557 raft_consensus.cc:729] T 00000000000000000000000000000000 P c3b51d1e465e4f17b076e33d1f202b73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b51d1e465e4f17b076e33d1f202b73, State: Initialized, Role: FOLLOWER
I20260812 17:43:45.656132 1557 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3b51d1e465e4f17b076e33d1f202b73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3b51d1e465e4f17b076e33d1f202b73" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45161 } }
I20260812 17:43:45.656266 1557 raft_consensus.cc:388] T 00000000000000000000000000000000 P c3b51d1e465e4f17b076e33d1f202b73 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:43:45.656318 1557 raft_consensus.cc:482] T 00000000000000000000000000000000 P c3b51d1e465e4f17b076e33d1f202b73 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:43:45.656410 1557 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c3b51d1e465e4f17b076e33d1f202b73 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:45.657514 1557 raft_consensus.cc:504] T 00000000000000000000000000000000 P c3b51d1e465e4f17b076e33d1f202b73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3b51d1e465e4f17b076e33d1f202b73" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45161 } }
I20260812 17:43:45.657852 1557 leader_election.cc:302] T 00000000000000000000000000000000 P c3b51d1e465e4f17b076e33d1f202b73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3b51d1e465e4f17b076e33d1f202b73; no voters:
I20260812 17:43:45.658234 1557 leader_election.cc:288] T 00000000000000000000000000000000 P c3b51d1e465e4f17b076e33d1f202b73 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:43:45.658376 1568 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c3b51d1e465e4f17b076e33d1f202b73 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:43:45.658710 1568 raft_consensus.cc:686] T 00000000000000000000000000000000 P c3b51d1e465e4f17b076e33d1f202b73 [term 1 LEADER]: Becoming Leader. State: Replica: c3b51d1e465e4f17b076e33d1f202b73, State: Running, Role: LEADER
I20260812 17:43:45.659128 1568 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3b51d1e465e4f17b076e33d1f202b73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3b51d1e465e4f17b076e33d1f202b73" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45161 } }
I20260812 17:43:45.659750 1557 sys_catalog.cc:564] T 00000000000000000000000000000000 P c3b51d1e465e4f17b076e33d1f202b73 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:43:45.661051 1571 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3b51d1e465e4f17b076e33d1f202b73 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3b51d1e465e4f17b076e33d1f202b73. Latest consensus state: current_term: 1 leader_uuid: "c3b51d1e465e4f17b076e33d1f202b73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3b51d1e465e4f17b076e33d1f202b73" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45161 } } }
I20260812 17:43:45.661087 1569 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3b51d1e465e4f17b076e33d1f202b73 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c3b51d1e465e4f17b076e33d1f202b73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3b51d1e465e4f17b076e33d1f202b73" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45161 } } }
I20260812 17:43:45.661191 1571 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3b51d1e465e4f17b076e33d1f202b73 [sys.catalog]: This master's current role is: LEADER
I20260812 17:43:45.661195 1569 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3b51d1e465e4f17b076e33d1f202b73 [sys.catalog]: This master's current role is: LEADER
I20260812 17:43:45.661579 1582 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:43:45.665055 1582 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:43:45.671762 1582 catalog_manager.cc:1347] Generated new cluster ID: e44cb0ca3d5f4788b669acc44279c7b7
I20260812 17:43:45.671845 1582 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:43:45.685629 1582 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:43:45.687109 1582 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:43:45.699096 1582 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c3b51d1e465e4f17b076e33d1f202b73: Generated new TSK 0
I20260812 17:43:45.700063 1582 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 17:43:45.712827 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.1:0
--local_ip_for_outbound_sockets=127.17.255.1
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:45161
--builtin_ntp_servers=127.17.255.20:39525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260812 17:43:45.838209 1595 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:45.838634 1595 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:45.838723 1595 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:45.842912 1595 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:45.842998 1595 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:45.843086 1595 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.1
I20260812 17:43:45.848026 1595 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:39525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:45161
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1595
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.1
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:45.849220 1595 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:45.850827 1595 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:45.861295 1608 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:45.861308 1611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:45.861295 1607 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:45.861639 1595 server_base.cc:1034] running on GCE node
I20260812 17:43:45.862221 1595 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:45.863044 1595 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:45.864213 1595 hybrid_clock.cc:648] HybridClock initialized: now 1786556625864190 us; error 41 us; skew 500 ppm
I20260812 17:43:45.866209 1595 webserver.cc:460] Webserver started at http://127.17.255.1:38367/ using document root <none> and password file <none>
I20260812 17:43:45.866882 1595 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:45.866950 1595 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:45.867132 1595 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:45.869532 1595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/data/instance:
uuid: "b5bdccacaa724a29a43fe922705b7b69"
format_stamp: "Formatted at 2026-08-12 17:43:45 on dist-test-slave-tk9z"
server_key: "73f96a2d964d3d43883da04d56c15832"
server_key_iv: "0fddf7249ca6f22b655c8d1f44c4ed32"
server_key_version: "encryptionkey@0"
I20260812 17:43:45.870121 1595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance:
uuid: "b5bdccacaa724a29a43fe922705b7b69"
format_stamp: "Formatted at 2026-08-12 17:43:45 on dist-test-slave-tk9z"
server_key: "73f96a2d964d3d43883da04d56c15832"
server_key_iv: "0fddf7249ca6f22b655c8d1f44c4ed32"
server_key_version: "encryptionkey@0"
I20260812 17:43:45.875007 1595 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 17:43:45.878065 1620 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:45.879518 1595 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:43:45.879629 1595 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/wal
uuid: "b5bdccacaa724a29a43fe922705b7b69"
format_stamp: "Formatted at 2026-08-12 17:43:45 on dist-test-slave-tk9z"
server_key: "73f96a2d964d3d43883da04d56c15832"
server_key_iv: "0fddf7249ca6f22b655c8d1f44c4ed32"
server_key_version: "encryptionkey@0"
I20260812 17:43:45.879737 1595 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:45.896385 1595 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:45.897156 1595 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:45.897326 1595 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:45.897939 1595 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:43:45.899057 1595 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:43:45.899108 1595 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:45.899151 1595 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:43:45.899166 1595 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:45.909145 1595 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.1:37669
I20260812 17:43:45.909168 1826 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.1:37669 every 8 connection(s)
I20260812 17:43:45.910187 1595 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
I20260812 17:43:45.911445 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 1595
I20260812 17:43:45.911571 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance
I20260812 17:43:45.911944 18428 external_mini_cluster.cc:1428] Setting key 59d34007bc671769a2178a677ceb7218
I20260812 17:43:45.914146 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.2:0
--local_ip_for_outbound_sockets=127.17.255.2
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:45161
--builtin_ntp_servers=127.17.255.20:39525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260812 17:43:45.922263 1564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:45.912558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:45381 (local address 127.17.255.62:45161)
0812 17:43:45.912734 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:45.912739 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:45.914148 (+ 1409us) server_negotiation.cc:407] Connection header received
0812 17:43:45.916331 (+ 2183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:45.916338 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:45.916413 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:45.916526 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:45.917439 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:45.918344 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:45.919772 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:45.920235 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:45.920381 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:45.921585 (+ 1204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:45.921591 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:45.921597 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:43:45.921617 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:45.921644 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:43:45.921660 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:45.921754 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:45.921927 (+ 173us) server_negotiation.cc:299] Negotiation successful
0812 17:43:45.922019 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 17:43:45.923107 1832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:45.913080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:45161 (local address 127.17.255.1:45381)
0812 17:43:45.913977 (+ 897us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:45.914037 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:45.916087 (+ 2050us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:45.916661 (+ 574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:45.916668 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:45.916759 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:45.917277 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:45.917289 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:45.918563 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:45.918566 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:45.919618 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:45.919629 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:45.920441 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:45.920444 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:45.920597 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:45.921273 (+ 676us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 17:43:45.921275 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:45.921319 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 17:43:45.921390 (+ 71us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:45.921757 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:45.921764 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:45.921769 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 17:43:45.921871 (+ 102us) client_negotiation.cc:240] Negotiation successful
0812 17:43:45.922125 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":165,"threads_started":1}
I20260812 17:43:45.924644 1829 heartbeater.cc:347] Connected to a master server at 127.17.255.62:45161
I20260812 17:43:45.924938 1829 heartbeater.cc:464] Registering TS with master...
I20260812 17:43:45.925580 1829 heartbeater.cc:511] Master 127.17.255.62:45161 requested a full tablet report, sending...
I20260812 17:43:45.927502 1492 ts_manager.cc:194] Registered new tserver with Master: b5bdccacaa724a29a43fe922705b7b69 (127.17.255.1:37669)
I20260812 17:43:45.928757 1492 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.255.1:45381
W20260812 17:43:46.037696 1834 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:46.038003 1834 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:46.038043 1834 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:46.042197 1834 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:46.042258 1834 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:46.042357 1834 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.2
I20260812 17:43:46.047312 1834 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:39525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:45161
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1834
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.2
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:46.048470 1834 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:46.049971 1834 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:46.060480 1844 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:46.060479 1854 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:46.060495 1845 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:46.061056 1834 server_base.cc:1034] running on GCE node
I20260812 17:43:46.061496 1834 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:46.062275 1834 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:46.063491 1834 hybrid_clock.cc:648] HybridClock initialized: now 1786556626063449 us; error 54 us; skew 500 ppm
I20260812 17:43:46.065631 1834 webserver.cc:460] Webserver started at http://127.17.255.2:39305/ using document root <none> and password file <none>
I20260812 17:43:46.066303 1834 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:46.066442 1834 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:46.066694 1834 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:46.069036 1834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/data/instance:
uuid: "206f07ad32834a8ea7d2555032d5364e"
format_stamp: "Formatted at 2026-08-12 17:43:46 on dist-test-slave-tk9z"
server_key: "89a2bc7402dff1903b79498f16f3cc6e"
server_key_iv: "fe26d260616f73f786e330ec06993c11"
server_key_version: "encryptionkey@0"
I20260812 17:43:46.069657 1834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance:
uuid: "206f07ad32834a8ea7d2555032d5364e"
format_stamp: "Formatted at 2026-08-12 17:43:46 on dist-test-slave-tk9z"
server_key: "89a2bc7402dff1903b79498f16f3cc6e"
server_key_iv: "fe26d260616f73f786e330ec06993c11"
server_key_version: "encryptionkey@0"
I20260812 17:43:46.073860 1834 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 17:43:46.076788 1863 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:46.078225 1834 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260812 17:43:46.078433 1834 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/wal
uuid: "206f07ad32834a8ea7d2555032d5364e"
format_stamp: "Formatted at 2026-08-12 17:43:46 on dist-test-slave-tk9z"
server_key: "89a2bc7402dff1903b79498f16f3cc6e"
server_key_iv: "fe26d260616f73f786e330ec06993c11"
server_key_version: "encryptionkey@0"
I20260812 17:43:46.078593 1834 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:46.098500 1834 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:46.099397 1834 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:46.099624 1834 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:46.100303 1834 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:43:46.101361 1834 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:43:46.101435 1834 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:46.101512 1834 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:43:46.101560 1834 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:46.111270 1834 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.2:44655
I20260812 17:43:46.111290 2052 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.2:44655 every 8 connection(s)
I20260812 17:43:46.112254 1834 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
I20260812 17:43:46.113085 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 1834
I20260812 17:43:46.113205 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance
I20260812 17:43:46.113565 18428 external_mini_cluster.cc:1428] Setting key a388965e28f5dbba115363a53cd9e644
I20260812 17:43:46.115796 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.3:0
--local_ip_for_outbound_sockets=127.17.255.3
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:45161
--builtin_ntp_servers=127.17.255.20:39525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260812 17:43:46.123703 1564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:46.114302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:46971 (local address 127.17.255.62:45161)
0812 17:43:46.114488 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:46.114493 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:46.115960 (+ 1467us) server_negotiation.cc:407] Connection header received
0812 17:43:46.117982 (+ 2022us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:46.117987 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:46.118054 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:46.118150 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:46.119168 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:46.120043 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:46.121316 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:46.121743 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:46.121878 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:46.123075 (+ 1197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:46.123082 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:46.123089 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:43:46.123109 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:46.123138 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:43:46.123149 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:46.123234 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:46.123408 (+ 174us) server_negotiation.cc:299] Negotiation successful
0812 17:43:46.123488 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260812 17:43:46.124502 2055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:46.114868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:45161 (local address 127.17.255.2:46971)
0812 17:43:46.115766 (+ 898us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:46.115826 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:46.117760 (+ 1934us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:46.118318 (+ 558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:46.118325 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:46.118466 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:46.119012 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:46.119026 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:46.120185 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:46.120188 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:46.121177 (+ 989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:46.121187 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:46.121912 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:46.121915 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:46.122082 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:46.122785 (+ 703us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 17:43:46.122787 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:46.122830 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 17:43:46.122901 (+ 71us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:46.123248 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:46.123255 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:46.123260 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 17:43:46.123353 (+ 93us) client_negotiation.cc:240] Negotiation successful
0812 17:43:46.123598 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":171,"threads_started":1}
I20260812 17:43:46.125773 2053 heartbeater.cc:347] Connected to a master server at 127.17.255.62:45161
I20260812 17:43:46.126029 2053 heartbeater.cc:464] Registering TS with master...
I20260812 17:43:46.126660 2053 heartbeater.cc:511] Master 127.17.255.62:45161 requested a full tablet report, sending...
I20260812 17:43:46.127789 1492 ts_manager.cc:194] Registered new tserver with Master: 206f07ad32834a8ea7d2555032d5364e (127.17.255.2:44655)
I20260812 17:43:46.128510 1492 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.255.2:46971
W20260812 17:43:46.237721 2056 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:46.238014 2056 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:46.238054 2056 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:46.242208 2056 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:46.242285 2056 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:46.242341 2056 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.3
I20260812 17:43:46.247991 2056 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:39525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:45161
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2056
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.3
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:46.249219 2056 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:46.250818 2056 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:46.262240 2068 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:46.262240 2073 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:46.262362 2066 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:46.262559 2056 server_base.cc:1034] running on GCE node
I20260812 17:43:46.263219 2056 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:46.264027 2056 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:46.265251 2056 hybrid_clock.cc:648] HybridClock initialized: now 1786556626265232 us; error 32 us; skew 500 ppm
I20260812 17:43:46.267522 2056 webserver.cc:460] Webserver started at http://127.17.255.3:41487/ using document root <none> and password file <none>
I20260812 17:43:46.268232 2056 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:46.268352 2056 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:46.268631 2056 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:46.271118 2056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/data/instance:
uuid: "0425c6e1988d40eb8698c89038383236"
format_stamp: "Formatted at 2026-08-12 17:43:46 on dist-test-slave-tk9z"
server_key: "a94188c3a11773468454a63ac7d40230"
server_key_iv: "32b245b4a9f35f36562afcd5aa5fcc1c"
server_key_version: "encryptionkey@0"
I20260812 17:43:46.271795 2056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance:
uuid: "0425c6e1988d40eb8698c89038383236"
format_stamp: "Formatted at 2026-08-12 17:43:46 on dist-test-slave-tk9z"
server_key: "a94188c3a11773468454a63ac7d40230"
server_key_iv: "32b245b4a9f35f36562afcd5aa5fcc1c"
server_key_version: "encryptionkey@0"
I20260812 17:43:46.276165 2056 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 17:43:46.279438 2083 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:46.280901 2056 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 17:43:46.281044 2056 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/wal
uuid: "0425c6e1988d40eb8698c89038383236"
format_stamp: "Formatted at 2026-08-12 17:43:46 on dist-test-slave-tk9z"
server_key: "a94188c3a11773468454a63ac7d40230"
server_key_iv: "32b245b4a9f35f36562afcd5aa5fcc1c"
server_key_version: "encryptionkey@0"
I20260812 17:43:46.281183 2056 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:46.294235 2056 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:46.295059 2056 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:46.295284 2056 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:46.295958 2056 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:43:46.297021 2056 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:43:46.297072 2056 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:46.297143 2056 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:43:46.297179 2056 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:46.307632 2056 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.3:45999
I20260812 17:43:46.307658 2281 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.3:45999 every 8 connection(s)
I20260812 17:43:46.308666 2056 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
I20260812 17:43:46.314025 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 2056
I20260812 17:43:46.314167 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance
I20260812 17:43:46.314541 18428 external_mini_cluster.cc:1428] Setting key 836ba2e98b3d596cae7e8c10edfe281a
I20260812 17:43:46.319903 1564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:46.310890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:58047 (local address 127.17.255.62:45161)
0812 17:43:46.311054 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:46.311058 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:46.312335 (+ 1277us) server_negotiation.cc:407] Connection header received
0812 17:43:46.313908 (+ 1573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:46.313911 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:46.313966 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:46.314124 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:46.315465 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:46.316261 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:46.317712 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:46.317961 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:46.318063 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:46.319372 (+ 1309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:46.319376 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:46.319378 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:43:46.319390 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:46.319415 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:43:46.319424 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:46.319501 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:46.319702 (+ 201us) server_negotiation.cc:299] Negotiation successful
0812 17:43:46.319764 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 17:43:46.320811 2286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:46.311361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:45161 (local address 127.17.255.3:58047)
0812 17:43:46.312166 (+ 805us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:46.312210 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:46.313610 (+ 1400us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:46.314489 (+ 879us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:46.314499 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:46.314640 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:46.315250 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:46.315264 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:46.316428 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:46.316431 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:46.317552 (+ 1121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:46.317563 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:46.318141 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:46.318145 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:46.318320 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:46.319087 (+ 767us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 17:43:46.319088 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:46.319134 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 17:43:46.319204 (+ 70us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:46.319522 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:46.319530 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:46.319535 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 17:43:46.319645 (+ 110us) client_negotiation.cc:240] Negotiation successful
0812 17:43:46.319901 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":134,"threads_started":1}
I20260812 17:43:46.322244 2282 heartbeater.cc:347] Connected to a master server at 127.17.255.62:45161
I20260812 17:43:46.322643 2282 heartbeater.cc:464] Registering TS with master...
I20260812 17:43:46.323326 2282 heartbeater.cc:511] Master 127.17.255.62:45161 requested a full tablet report, sending...
I20260812 17:43:46.324630 1492 ts_manager.cc:194] Registered new tserver with Master: 0425c6e1988d40eb8698c89038383236 (127.17.255.3:45999)
I20260812 17:43:46.325230 1492 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.255.3:58047
I20260812 17:43:46.329355 18428 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 17:43:46.332407 1564 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:46.331532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57314 (local address 127.17.255.62:45161)
0812 17:43:46.331678 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:46.331682 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:46.331849 (+ 167us) server_negotiation.cc:407] Connection header received
0812 17:43:46.331924 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:46.331926 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:46.331973 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:46.332053 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:46.332287 (+ 234us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57314: BlockingRecv error: recv got EOF from 127.0.0.1:57314 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 17:43:46.332659 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 1595
I20260812 17:43:46.368830 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 1834
I20260812 17:43:46.384281 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 2056
I20260812 17:43:46.406999 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 1426
2026-08-12T17:43:46Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (997 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-12T17:43:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:43:46Z Disabled control of system clock
I20260812 17:43:46.450757 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:38761
--webserver_interface=127.17.255.62
--webserver_port=0
--builtin_ntp_servers=127.17.255.20:32827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:38761
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 17:43:46.569934 2297 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:46.570225 2297 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:46.570278 2297 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:46.574358 2297 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:43:46.574517 2297 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:46.574541 2297 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:46.574571 2297 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:43:46.574601 2297 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:43:46.579655 2297 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:32827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:38761
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:38761
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2297
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:46.580849 2297 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:46.582301 2297 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:46.591706 2304 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:46.591948 2305 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:46.591696 2313 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:46.592088 2297 server_base.cc:1034] running on GCE node
I20260812 17:43:46.592796 2297 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:46.594065 2297 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:46.595232 2297 hybrid_clock.cc:648] HybridClock initialized: now 1786556626595202 us; error 45 us; skew 500 ppm
I20260812 17:43:46.597246 2297 webserver.cc:460] Webserver started at http://127.17.255.62:41089/ using document root <none> and password file <none>
I20260812 17:43:46.597867 2297 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:46.597936 2297 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:46.598207 2297 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:46.600445 2297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "5fcf3c43b5ff458b8399c0809bbe4463"
format_stamp: "Formatted at 2026-08-12 17:43:46 on dist-test-slave-tk9z"
server_key: "5d9c70b5cad3fa0f0f324f2093e82361"
server_key_iv: "b77020e7ebe98a5a34fcca2e7264bd7c"
server_key_version: "encryptionkey@0"
I20260812 17:43:46.601078 2297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "5fcf3c43b5ff458b8399c0809bbe4463"
format_stamp: "Formatted at 2026-08-12 17:43:46 on dist-test-slave-tk9z"
server_key: "5d9c70b5cad3fa0f0f324f2093e82361"
server_key_iv: "b77020e7ebe98a5a34fcca2e7264bd7c"
server_key_version: "encryptionkey@0"
I20260812 17:43:46.605036 2297 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260812 17:43:46.607721 2324 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:46.609154 2297 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 17:43:46.609311 2297 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "5fcf3c43b5ff458b8399c0809bbe4463"
format_stamp: "Formatted at 2026-08-12 17:43:46 on dist-test-slave-tk9z"
server_key: "5d9c70b5cad3fa0f0f324f2093e82361"
server_key_iv: "b77020e7ebe98a5a34fcca2e7264bd7c"
server_key_version: "encryptionkey@0"
I20260812 17:43:46.609443 2297 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:46.614652 2297 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:46.615356 2297 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:46.615561 2297 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:46.623208 2297 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:38761
I20260812 17:43:46.623236 2411 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:38761 every 8 connection(s)
I20260812 17:43:46.624248 2297 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:43:46.627251 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 2297
I20260812 17:43:46.627359 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:43:46.627745 18428 external_mini_cluster.cc:1428] Setting key 77b65a9fe0f9d0252518650ab9c2094b
I20260812 17:43:46.628165 2415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:46.633744 2420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:46.629146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41104 (local address 127.17.255.62:38761)
0812 17:43:46.629806 (+ 660us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:46.629822 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:46.629858 (+ 36us) server_negotiation.cc:407] Connection header received
0812 17:43:46.630640 (+ 782us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:46.630661 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:46.631046 (+ 385us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:46.631341 (+ 295us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:46.632315 (+ 974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:46.632321 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:46.632334 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:43:46.632346 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:46.632409 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:43:46.632427 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:46.632557 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:46.632692 (+ 135us) server_negotiation.cc:299] Negotiation successful
0812 17:43:46.633008 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286,"thread_start_us":146,"threads_started":1}
I20260812 17:43:46.635641 2415 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5fcf3c43b5ff458b8399c0809bbe4463: Bootstrap starting.
I20260812 17:43:46.638054 2415 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5fcf3c43b5ff458b8399c0809bbe4463: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:46.639025 2415 log.cc:824] T 00000000000000000000000000000000 P 5fcf3c43b5ff458b8399c0809bbe4463: Log is configured to *not* fsync() on all Append() calls
I20260812 17:43:46.641225 2415 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5fcf3c43b5ff458b8399c0809bbe4463: No bootstrap required, opened a new log
I20260812 17:43:46.644918 2415 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5fcf3c43b5ff458b8399c0809bbe4463 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fcf3c43b5ff458b8399c0809bbe4463" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 38761 } }
I20260812 17:43:46.645195 2415 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5fcf3c43b5ff458b8399c0809bbe4463 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:46.645280 2415 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5fcf3c43b5ff458b8399c0809bbe4463 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fcf3c43b5ff458b8399c0809bbe4463, State: Initialized, Role: FOLLOWER
I20260812 17:43:46.645744 2415 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5fcf3c43b5ff458b8399c0809bbe4463 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fcf3c43b5ff458b8399c0809bbe4463" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 38761 } }
I20260812 17:43:46.645905 2415 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5fcf3c43b5ff458b8399c0809bbe4463 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:43:46.646039 2415 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5fcf3c43b5ff458b8399c0809bbe4463 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:43:46.646158 2415 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5fcf3c43b5ff458b8399c0809bbe4463 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:46.647231 2415 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5fcf3c43b5ff458b8399c0809bbe4463 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fcf3c43b5ff458b8399c0809bbe4463" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 38761 } }
I20260812 17:43:46.647612 2415 leader_election.cc:302] T 00000000000000000000000000000000 P 5fcf3c43b5ff458b8399c0809bbe4463 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5fcf3c43b5ff458b8399c0809bbe4463; no voters:
I20260812 17:43:46.647956 2415 leader_election.cc:288] T 00000000000000000000000000000000 P 5fcf3c43b5ff458b8399c0809bbe4463 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:43:46.648141 2423 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5fcf3c43b5ff458b8399c0809bbe4463 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:43:46.648514 2423 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5fcf3c43b5ff458b8399c0809bbe4463 [term 1 LEADER]: Becoming Leader. State: Replica: 5fcf3c43b5ff458b8399c0809bbe4463, State: Running, Role: LEADER
I20260812 17:43:46.648895 2423 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5fcf3c43b5ff458b8399c0809bbe4463 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fcf3c43b5ff458b8399c0809bbe4463" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 38761 } }
I20260812 17:43:46.649333 2415 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5fcf3c43b5ff458b8399c0809bbe4463 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:43:46.650655 2425 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5fcf3c43b5ff458b8399c0809bbe4463 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5fcf3c43b5ff458b8399c0809bbe4463. Latest consensus state: current_term: 1 leader_uuid: "5fcf3c43b5ff458b8399c0809bbe4463" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fcf3c43b5ff458b8399c0809bbe4463" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 38761 } } }
I20260812 17:43:46.650799 2425 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5fcf3c43b5ff458b8399c0809bbe4463 [sys.catalog]: This master's current role is: LEADER
I20260812 17:43:46.651144 2424 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5fcf3c43b5ff458b8399c0809bbe4463 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5fcf3c43b5ff458b8399c0809bbe4463" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fcf3c43b5ff458b8399c0809bbe4463" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 38761 } } }
I20260812 17:43:46.651249 2424 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5fcf3c43b5ff458b8399c0809bbe4463 [sys.catalog]: This master's current role is: LEADER
I20260812 17:43:46.651260 2437 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:43:46.654572 2437 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:43:46.660723 2437 catalog_manager.cc:1347] Generated new cluster ID: fa4f85e973374a1f80567a84516d7839
I20260812 17:43:46.660820 2437 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:43:46.678279 2437 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:43:46.678702 2437 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:43:46.688956 2437 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5fcf3c43b5ff458b8399c0809bbe4463: Generated new TSK 0
I20260812 17:43:46.689884 2437 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 17:43:46.703313 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.1:0
--local_ip_for_outbound_sockets=127.17.255.1
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:38761
--builtin_ntp_servers=127.17.255.20:32827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 17:43:46.829675 2458 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:46.830022 2458 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:46.830096 2458 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:46.834339 2458 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:46.834465 2458 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:46.834568 2458 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.1
I20260812 17:43:46.839628 2458 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:32827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:38761
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2458
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.1
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:46.840991 2458 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:46.842584 2458 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:46.853438 2466 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:46.853480 2464 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:46.853459 2463 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:46.853698 2458 server_base.cc:1034] running on GCE node
I20260812 17:43:46.854198 2458 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:46.854946 2458 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:46.856155 2458 hybrid_clock.cc:648] HybridClock initialized: now 1786556626856140 us; error 26 us; skew 500 ppm
I20260812 17:43:46.858259 2458 webserver.cc:460] Webserver started at http://127.17.255.1:43089/ using document root <none> and password file <none>
I20260812 17:43:46.858990 2458 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:46.859064 2458 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:46.859251 2458 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:46.861663 2458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/data/instance:
uuid: "24aee8c2a74c4eebbee9b7394c9a0f88"
format_stamp: "Formatted at 2026-08-12 17:43:46 on dist-test-slave-tk9z"
server_key: "99fce3df7d54fb72b7d7fcfc8e970c9b"
server_key_iv: "fa9d2d5132c0655e15e635d405ea918c"
server_key_version: "encryptionkey@0"
I20260812 17:43:46.862239 2458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance:
uuid: "24aee8c2a74c4eebbee9b7394c9a0f88"
format_stamp: "Formatted at 2026-08-12 17:43:46 on dist-test-slave-tk9z"
server_key: "99fce3df7d54fb72b7d7fcfc8e970c9b"
server_key_iv: "fa9d2d5132c0655e15e635d405ea918c"
server_key_version: "encryptionkey@0"
I20260812 17:43:46.866362 2458 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.000s
I20260812 17:43:46.869189 2480 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:46.870673 2458 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:43:46.870790 2458 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/wal
uuid: "24aee8c2a74c4eebbee9b7394c9a0f88"
format_stamp: "Formatted at 2026-08-12 17:43:46 on dist-test-slave-tk9z"
server_key: "99fce3df7d54fb72b7d7fcfc8e970c9b"
server_key_iv: "fa9d2d5132c0655e15e635d405ea918c"
server_key_version: "encryptionkey@0"
I20260812 17:43:46.870945 2458 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:46.876153 2458 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:46.876848 2458 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:46.877054 2458 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:46.877779 2458 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:43:46.878907 2458 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:43:46.878957 2458 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:46.879035 2458 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:43:46.879068 2458 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:46.888774 2458 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.1:38737
I20260812 17:43:46.888797 2656 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.1:38737 every 8 connection(s)
I20260812 17:43:46.889813 2458 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
I20260812 17:43:46.891155 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 2458
I20260812 17:43:46.891287 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance
I20260812 17:43:46.891672 18428 external_mini_cluster.cc:1428] Setting key b3d6c9f5577ed1589dfdd6d6a4bd26b1
I20260812 17:43:46.893855 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.2:0
--local_ip_for_outbound_sockets=127.17.255.2
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:38761
--builtin_ntp_servers=127.17.255.20:32827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260812 17:43:46.897332 2420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:46.891970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:37503 (local address 127.17.255.62:38761)
0812 17:43:46.892119 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:46.892123 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:46.893488 (+ 1365us) server_negotiation.cc:407] Connection header received
0812 17:43:46.895088 (+ 1600us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:46.895095 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:46.895153 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:46.895261 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:46.896836 (+ 1575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:46.896841 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:46.896845 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:43:46.896865 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:46.896893 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:43:46.896907 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:46.897021 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:46.897167 (+ 146us) server_negotiation.cc:299] Negotiation successful
0812 17:43:46.897213 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 17:43:46.898836 2663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:46.892495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:38761 (local address 127.17.255.1:37503)
0812 17:43:46.893306 (+ 811us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:46.893363 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:46.894835 (+ 1472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:46.895501 (+ 666us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:46.895511 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:46.895724 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:46.896491 (+ 767us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 17:43:46.896492 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:46.896541 (+ 49us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 17:43:46.896630 (+ 89us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:46.897013 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:46.897022 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:46.897028 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 17:43:46.897196 (+ 168us) client_negotiation.cc:240] Negotiation successful
0812 17:43:46.897503 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":160,"threads_started":1}
I20260812 17:43:46.900527 2658 heartbeater.cc:347] Connected to a master server at 127.17.255.62:38761
I20260812 17:43:46.900820 2658 heartbeater.cc:464] Registering TS with master...
I20260812 17:43:46.901312 2658 heartbeater.cc:511] Master 127.17.255.62:38761 requested a full tablet report, sending...
I20260812 17:43:46.903326 2347 ts_manager.cc:194] Registered new tserver with Master: 24aee8c2a74c4eebbee9b7394c9a0f88 (127.17.255.1:38737)
W20260812 17:43:47.023182 2664 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:47.023468 2664 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:47.023509 2664 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:47.027493 2664 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:47.027549 2664 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:47.027604 2664 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.2
I20260812 17:43:47.032354 2664 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:32827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:38761
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2664
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.2
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:47.033522 2664 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:47.035018 2664 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:47.045536 2677 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:47.045550 2674 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:47.045603 2673 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:47.046044 2664 server_base.cc:1034] running on GCE node
I20260812 17:43:47.046590 2664 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:47.047309 2664 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:47.048514 2664 hybrid_clock.cc:648] HybridClock initialized: now 1786556627048472 us; error 57 us; skew 500 ppm
I20260812 17:43:47.050989 2664 webserver.cc:460] Webserver started at http://127.17.255.2:39665/ using document root <none> and password file <none>
I20260812 17:43:47.051676 2664 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:47.051774 2664 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:47.052032 2664 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:47.054333 2664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/data/instance:
uuid: "7db9c999e97b42c6bc4014ae8b93b040"
format_stamp: "Formatted at 2026-08-12 17:43:47 on dist-test-slave-tk9z"
server_key: "f1a8642c3a7290c66168b781476d721d"
server_key_iv: "72c782985f8497203c55932bfe79b754"
server_key_version: "encryptionkey@0"
I20260812 17:43:47.055028 2664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance:
uuid: "7db9c999e97b42c6bc4014ae8b93b040"
format_stamp: "Formatted at 2026-08-12 17:43:47 on dist-test-slave-tk9z"
server_key: "f1a8642c3a7290c66168b781476d721d"
server_key_iv: "72c782985f8497203c55932bfe79b754"
server_key_version: "encryptionkey@0"
I20260812 17:43:47.059185 2664 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 17:43:47.062067 2686 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:47.063550 2664 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:43:47.063701 2664 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/wal
uuid: "7db9c999e97b42c6bc4014ae8b93b040"
format_stamp: "Formatted at 2026-08-12 17:43:47 on dist-test-slave-tk9z"
server_key: "f1a8642c3a7290c66168b781476d721d"
server_key_iv: "72c782985f8497203c55932bfe79b754"
server_key_version: "encryptionkey@0"
I20260812 17:43:47.063862 2664 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:47.068750 2664 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:47.069403 2664 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:47.069591 2664 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:47.070180 2664 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:43:47.071239 2664 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:43:47.071312 2664 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:47.071377 2664 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:43:47.071420 2664 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:47.081158 2664 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.2:40297
I20260812 17:43:47.081187 2902 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.2:40297 every 8 connection(s)
I20260812 17:43:47.082185 2664 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
I20260812 17:43:47.083408 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 2664
I20260812 17:43:47.083552 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance
I20260812 17:43:47.083863 18428 external_mini_cluster.cc:1428] Setting key db824e061058baec4b429dab6d475837
I20260812 17:43:47.086210 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.3:0
--local_ip_for_outbound_sockets=127.17.255.3
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:38761
--builtin_ntp_servers=127.17.255.20:32827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260812 17:43:47.090076 2420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:47.084361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:55045 (local address 127.17.255.62:38761)
0812 17:43:47.084526 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:47.084531 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:47.086055 (+ 1524us) server_negotiation.cc:407] Connection header received
0812 17:43:47.088191 (+ 2136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:47.088197 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:47.088255 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:47.088353 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:47.089615 (+ 1262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:47.089618 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:47.089620 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:43:47.089632 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:47.089653 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:43:47.089662 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:47.089743 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:47.089915 (+ 172us) server_negotiation.cc:299] Negotiation successful
0812 17:43:47.089959 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260812 17:43:47.091531 2906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:47.084936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:38761 (local address 127.17.255.2:55045)
0812 17:43:47.085850 (+ 914us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:47.085934 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:47.087907 (+ 1973us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:47.088550 (+ 643us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:47.088557 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:47.088652 (+ 95us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:47.089277 (+ 625us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 17:43:47.089278 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:47.089322 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 17:43:47.089441 (+ 119us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:47.089753 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:47.089765 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:47.089774 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 17:43:47.089968 (+ 194us) client_negotiation.cc:240] Negotiation successful
0812 17:43:47.090229 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":148,"threads_started":1}
I20260812 17:43:47.092965 2904 heartbeater.cc:347] Connected to a master server at 127.17.255.62:38761
I20260812 17:43:47.093250 2904 heartbeater.cc:464] Registering TS with master...
I20260812 17:43:47.093753 2904 heartbeater.cc:511] Master 127.17.255.62:38761 requested a full tablet report, sending...
I20260812 17:43:47.094992 2347 ts_manager.cc:194] Registered new tserver with Master: 7db9c999e97b42c6bc4014ae8b93b040 (127.17.255.2:40297)
W20260812 17:43:47.206595 2907 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:47.206930 2907 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:47.207005 2907 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:47.211207 2907 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:47.211313 2907 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:47.211406 2907 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.3
I20260812 17:43:47.216758 2907 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:32827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:38761
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2907
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.3
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:47.218005 2907 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:47.219573 2907 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:47.230036 2916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:47.230062 2919 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:47.230089 2907 server_base.cc:1034] running on GCE node
W20260812 17:43:47.230033 2917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:47.230863 2907 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:47.231618 2907 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:47.232865 2907 hybrid_clock.cc:648] HybridClock initialized: now 1786556627232833 us; error 50 us; skew 500 ppm
I20260812 17:43:47.238291 2907 webserver.cc:460] Webserver started at http://127.17.255.3:38091/ using document root <none> and password file <none>
I20260812 17:43:47.239015 2907 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:47.239125 2907 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:47.239396 2907 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:47.241660 2907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/data/instance:
uuid: "3b1ac01ac66846cd996c6df2f72e1add"
format_stamp: "Formatted at 2026-08-12 17:43:47 on dist-test-slave-tk9z"
server_key: "1e4fcab2465b48708f44c9d3a57fee2f"
server_key_iv: "61f161901f64eff3695bfd953e9321e0"
server_key_version: "encryptionkey@0"
I20260812 17:43:47.242305 2907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance:
uuid: "3b1ac01ac66846cd996c6df2f72e1add"
format_stamp: "Formatted at 2026-08-12 17:43:47 on dist-test-slave-tk9z"
server_key: "1e4fcab2465b48708f44c9d3a57fee2f"
server_key_iv: "61f161901f64eff3695bfd953e9321e0"
server_key_version: "encryptionkey@0"
I20260812 17:43:47.246501 2907 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 17:43:47.249666 2933 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:47.251461 2907 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:43:47.251628 2907 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/wal
uuid: "3b1ac01ac66846cd996c6df2f72e1add"
format_stamp: "Formatted at 2026-08-12 17:43:47 on dist-test-slave-tk9z"
server_key: "1e4fcab2465b48708f44c9d3a57fee2f"
server_key_iv: "61f161901f64eff3695bfd953e9321e0"
server_key_version: "encryptionkey@0"
I20260812 17:43:47.251770 2907 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:47.256769 2907 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:47.257440 2907 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:47.257637 2907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:47.258234 2907 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:43:47.259279 2907 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:43:47.259351 2907 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:47.259424 2907 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:43:47.259467 2907 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:47.268848 2907 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.3:37927
I20260812 17:43:47.268869 3156 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.3:37927 every 8 connection(s)
I20260812 17:43:47.269850 2907 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
I20260812 17:43:47.275111 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 2907
I20260812 17:43:47.275302 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance
I20260812 17:43:47.275660 18428 external_mini_cluster.cc:1428] Setting key 3465e0986c71625aa56ee3f98f55c405
I20260812 17:43:47.276711 2420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:47.271917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:56381 (local address 127.17.255.62:38761)
0812 17:43:47.272084 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:47.272089 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:47.273241 (+ 1152us) server_negotiation.cc:407] Connection header received
0812 17:43:47.274657 (+ 1416us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:47.274660 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:47.274706 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:47.274787 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:47.276135 (+ 1348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:47.276139 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:47.276141 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:43:47.276154 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:47.276176 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:43:47.276193 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:47.276297 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:47.276511 (+ 214us) server_negotiation.cc:299] Negotiation successful
0812 17:43:47.276563 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 17:43:47.277689 3168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:47.272333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:38761 (local address 127.17.255.3:56381)
0812 17:43:47.273068 (+ 735us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:47.273121 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:47.274433 (+ 1312us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:47.274958 (+ 525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:47.275023 (+ 65us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:47.275148 (+ 125us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:47.275818 (+ 670us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 17:43:47.275820 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:47.275863 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 17:43:47.275986 (+ 123us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:47.276321 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:47.276330 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:47.276337 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 17:43:47.276553 (+ 216us) client_negotiation.cc:240] Negotiation successful
0812 17:43:47.276831 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":111,"threads_started":1}
I20260812 17:43:47.279062 3162 heartbeater.cc:347] Connected to a master server at 127.17.255.62:38761
I20260812 17:43:47.279312 3162 heartbeater.cc:464] Registering TS with master...
I20260812 17:43:47.279749 3162 heartbeater.cc:511] Master 127.17.255.62:38761 requested a full tablet report, sending...
I20260812 17:43:47.280926 2347 ts_manager.cc:194] Registered new tserver with Master: 3b1ac01ac66846cd996c6df2f72e1add (127.17.255.3:37927)
I20260812 17:43:47.290589 18428 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 17:43:47.293845 2420 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:43:47.292771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41110 (local address 127.17.255.62:38761)
0812 17:43:47.292980 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:47.292986 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:47.293097 (+ 111us) server_negotiation.cc:407] Connection header received
0812 17:43:47.293276 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:47.293280 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:47.293326 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:47.293423 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:47.293720 (+ 297us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41110: BlockingRecv error: recv got EOF from 127.0.0.1:41110 (error 108)
Metrics: {"server-negotiator.queue_time_us":106}
I20260812 17:43:47.294551 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 2458
I20260812 17:43:47.315685 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 2664
I20260812 17:43:47.336634 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 2907
I20260812 17:43:47.360520 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 2297
2026-08-12T17:43:47Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (952 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:43:47 dist-test-slave-tk9z krb5kdc[3182](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:43:47 dist-test-slave-tk9z krb5kdc[3182](info): set up 2 sockets
Aug 12 17:43:47 dist-test-slave-tk9z krb5kdc[3182](info): commencing operation
krb5kdc: starting...
W20260812 17:43:48.680037 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.286s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:43:48 dist-test-slave-tk9z krb5kdc[3182](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556628, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:43:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:43:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.255.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
I20260812 17:43:48.827167 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:40367
--webserver_interface=127.17.255.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:33099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:40367
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:43:48.946930 3207 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:48.947273 3207 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:48.947365 3207 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:48.951566 3207 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:43:48.951659 3207 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:48.951697 3207 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:48.951756 3207 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:43:48.951793 3207 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:43:48.957333 3207 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:33099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:40367
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:40367
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3207
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:48.958668 3207 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:48.959781 3207 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:48.968654 3214 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:48.968904 3217 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:48.968654 3215 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:48.969040 3207 server_base.cc:1034] running on GCE node
I20260812 17:43:48.970327 3207 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:48.971774 3207 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:48.973001 3207 hybrid_clock.cc:648] HybridClock initialized: now 1786556628972978 us; error 42 us; skew 500 ppm
Aug 12 17:43:48 dist-test-slave-tk9z krb5kdc[3182](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556628, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:48.976001 3207 init.cc:377] Logged in from keytab as kudu/127.17.255.62@KRBTEST.COM (short username kudu)
I20260812 17:43:48.976982 3207 webserver.cc:460] Webserver started at http://127.17.255.62:44855/ using document root <none> and password file <none>
I20260812 17:43:48.977572 3207 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:48.977665 3207 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:48.977907 3207 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:48.980201 3207 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "61524f38380c420ab946c7ea007035af"
format_stamp: "Formatted at 2026-08-12 17:43:48 on dist-test-slave-tk9z"
server_key: "c0d0c31d6e82701c0c9195b1e20f0993"
server_key_iv: "ac226429fcd385df2603baf0f3f46821"
server_key_version: "encryptionkey@0"
I20260812 17:43:48.980836 3207 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "61524f38380c420ab946c7ea007035af"
format_stamp: "Formatted at 2026-08-12 17:43:48 on dist-test-slave-tk9z"
server_key: "c0d0c31d6e82701c0c9195b1e20f0993"
server_key_iv: "ac226429fcd385df2603baf0f3f46821"
server_key_version: "encryptionkey@0"
I20260812 17:43:48.984978 3207 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 17:43:48.987567 3224 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:48.988989 3207 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:43:48.989112 3207 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "61524f38380c420ab946c7ea007035af"
format_stamp: "Formatted at 2026-08-12 17:43:48 on dist-test-slave-tk9z"
server_key: "c0d0c31d6e82701c0c9195b1e20f0993"
server_key_iv: "ac226429fcd385df2603baf0f3f46821"
server_key_version: "encryptionkey@0"
I20260812 17:43:48.989208 3207 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:49.009243 3207 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:49.012763 3207 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:49.012943 3207 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:49.020851 3207 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:40367
I20260812 17:43:49.020954 3316 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:40367 every 8 connection(s)
I20260812 17:43:49.021880 3207 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:43:49.024847 3318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:49.025343 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 3207
I20260812 17:43:49.025481 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:43:49.025812 18428 external_mini_cluster.cc:1428] Setting key eafae93744a85a3626bbbf9bc82523b9
I20260812 17:43:49.033043 3318 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61524f38380c420ab946c7ea007035af: Bootstrap starting.
Aug 12 17:43:49 dist-test-slave-tk9z krb5kdc[3182](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556628, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:43:49.036834 3318 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 61524f38380c420ab946c7ea007035af: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:49.037879 3318 log.cc:824] T 00000000000000000000000000000000 P 61524f38380c420ab946c7ea007035af: Log is configured to *not* fsync() on all Append() calls
I20260812 17:43:49.040939 3318 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61524f38380c420ab946c7ea007035af: No bootstrap required, opened a new log
I20260812 17:43:49.044047 3324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:49.027335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44726 (local address 127.17.255.62:40367)
0812 17:43:49.027773 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:49.027790 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:49.027828 (+ 38us) server_negotiation.cc:407] Connection header received
0812 17:43:49.028508 (+ 680us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:49.028526 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:49.028876 (+ 350us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:49.029177 (+ 301us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:49.030132 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:49.031267 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:49.032754 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:49.033707 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:49.033840 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:49.037353 (+ 3513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:49.037361 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:49.037381 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:49.037422 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:49.039999 (+ 2577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:49.040611 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:49.040618 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:49.040625 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:49.040834 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:49.041259 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:49.041263 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:49.041265 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:49.041896 (+ 631us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:49.042111 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:49.042446 (+ 335us) server_negotiation.cc:299] Negotiation successful
0812 17:43:49.042838 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":142,"threads_started":1}
I20260812 17:43:49.046277 3318 raft_consensus.cc:348] T 00000000000000000000000000000000 P 61524f38380c420ab946c7ea007035af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61524f38380c420ab946c7ea007035af" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40367 } }
I20260812 17:43:49.046660 3318 raft_consensus.cc:374] T 00000000000000000000000000000000 P 61524f38380c420ab946c7ea007035af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:49.046778 3318 raft_consensus.cc:729] T 00000000000000000000000000000000 P 61524f38380c420ab946c7ea007035af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61524f38380c420ab946c7ea007035af, State: Initialized, Role: FOLLOWER
I20260812 17:43:49.047318 3318 consensus_queue.cc:260] T 00000000000000000000000000000000 P 61524f38380c420ab946c7ea007035af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61524f38380c420ab946c7ea007035af" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40367 } }
I20260812 17:43:49.047467 3318 raft_consensus.cc:388] T 00000000000000000000000000000000 P 61524f38380c420ab946c7ea007035af [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:43:49.047513 3318 raft_consensus.cc:482] T 00000000000000000000000000000000 P 61524f38380c420ab946c7ea007035af [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:43:49.047596 3318 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 61524f38380c420ab946c7ea007035af [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:49.048871 3318 raft_consensus.cc:504] T 00000000000000000000000000000000 P 61524f38380c420ab946c7ea007035af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61524f38380c420ab946c7ea007035af" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40367 } }
I20260812 17:43:49.049235 3318 leader_election.cc:302] T 00000000000000000000000000000000 P 61524f38380c420ab946c7ea007035af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 61524f38380c420ab946c7ea007035af; no voters:
I20260812 17:43:49.049583 3318 leader_election.cc:288] T 00000000000000000000000000000000 P 61524f38380c420ab946c7ea007035af [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:43:49.049731 3326 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 61524f38380c420ab946c7ea007035af [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:43:49.049993 3326 raft_consensus.cc:686] T 00000000000000000000000000000000 P 61524f38380c420ab946c7ea007035af [term 1 LEADER]: Becoming Leader. State: Replica: 61524f38380c420ab946c7ea007035af, State: Running, Role: LEADER
I20260812 17:43:49.050520 3326 consensus_queue.cc:237] T 00000000000000000000000000000000 P 61524f38380c420ab946c7ea007035af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61524f38380c420ab946c7ea007035af" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40367 } }
I20260812 17:43:49.051180 3318 sys_catalog.cc:564] T 00000000000000000000000000000000 P 61524f38380c420ab946c7ea007035af [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:43:49.052356 3328 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61524f38380c420ab946c7ea007035af [sys.catalog]: SysCatalogTable state changed. Reason: New leader 61524f38380c420ab946c7ea007035af. Latest consensus state: current_term: 1 leader_uuid: "61524f38380c420ab946c7ea007035af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61524f38380c420ab946c7ea007035af" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40367 } } }
I20260812 17:43:49.052495 3328 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61524f38380c420ab946c7ea007035af [sys.catalog]: This master's current role is: LEADER
I20260812 17:43:49.052857 3327 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61524f38380c420ab946c7ea007035af [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "61524f38380c420ab946c7ea007035af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61524f38380c420ab946c7ea007035af" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40367 } } }
I20260812 17:43:49.052979 3327 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61524f38380c420ab946c7ea007035af [sys.catalog]: This master's current role is: LEADER
I20260812 17:43:49.052997 3340 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:43:49.056464 3340 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:43:49.062652 3340 catalog_manager.cc:1347] Generated new cluster ID: e1e31f7c25014746bcc035bf030bedf7
I20260812 17:43:49.062737 3340 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:43:49.074080 3340 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:43:49.075559 3340 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:43:49.092994 3340 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 61524f38380c420ab946c7ea007035af: Generated new TSK 0
I20260812 17:43:49.093963 3340 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.255.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab.
Entry for principal kudu/127.17.255.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab.
I20260812 17:43:49.130160 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.1:0
--local_ip_for_outbound_sockets=127.17.255.1
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:40367
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:33099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:43:49.268668 3362 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:49.269037 3362 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:49.269120 3362 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:49.273976 3362 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:49.274135 3362 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:49.274253 3362 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.1
I20260812 17:43:49.280493 3362 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:33099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:40367
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3362
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.1
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:49.281857 3362 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:49.283017 3362 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:49.294059 3370 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:49.294234 3362 server_base.cc:1034] running on GCE node
W20260812 17:43:49.294116 3373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:49.294116 3371 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:49.294958 3362 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:49.295742 3362 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:49.296999 3362 hybrid_clock.cc:648] HybridClock initialized: now 1786556629296975 us; error 39 us; skew 500 ppm
Aug 12 17:43:49 dist-test-slave-tk9z krb5kdc[3182](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556629, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:49.300380 3362 init.cc:377] Logged in from keytab as kudu/127.17.255.1@KRBTEST.COM (short username kudu)
I20260812 17:43:49.301432 3362 webserver.cc:460] Webserver started at http://127.17.255.1:32933/ using document root <none> and password file <none>
I20260812 17:43:49.302100 3362 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:49.302198 3362 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:49.302557 3362 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:49.304811 3362 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/data/instance:
uuid: "56c7e8ae633248c18f3c3c37fa82858d"
format_stamp: "Formatted at 2026-08-12 17:43:49 on dist-test-slave-tk9z"
server_key: "28b81cfec244b0101d2d69da0b066d2a"
server_key_iv: "73c96b4f649e661692ec8e7d317625d6"
server_key_version: "encryptionkey@0"
I20260812 17:43:49.305421 3362 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance:
uuid: "56c7e8ae633248c18f3c3c37fa82858d"
format_stamp: "Formatted at 2026-08-12 17:43:49 on dist-test-slave-tk9z"
server_key: "28b81cfec244b0101d2d69da0b066d2a"
server_key_iv: "73c96b4f649e661692ec8e7d317625d6"
server_key_version: "encryptionkey@0"
I20260812 17:43:49.309641 3362 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260812 17:43:49.312598 3388 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:49.313939 3362 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 17:43:49.314105 3362 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/wal
uuid: "56c7e8ae633248c18f3c3c37fa82858d"
format_stamp: "Formatted at 2026-08-12 17:43:49 on dist-test-slave-tk9z"
server_key: "28b81cfec244b0101d2d69da0b066d2a"
server_key_iv: "73c96b4f649e661692ec8e7d317625d6"
server_key_version: "encryptionkey@0"
I20260812 17:43:49.314249 3362 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:49.335335 3362 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:49.338833 3362 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:49.339066 3362 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:49.339778 3362 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:43:49.340713 3362 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:43:49.340801 3362 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:49.340895 3362 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:43:49.340945 3362 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:49.350663 3362 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.1:34243
I20260812 17:43:49.350682 3589 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.1:34243 every 8 connection(s)
I20260812 17:43:49.351732 3362 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
I20260812 17:43:49.359877 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 3362
I20260812 17:43:49.360010 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance
I20260812 17:43:49.360321 18428 external_mini_cluster.cc:1428] Setting key 029236d4e86e9a3a370743f0212c4700
Aug 12 17:43:49 dist-test-slave-tk9z krb5kdc[3182](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556629, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:43:49.368203 3324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:49.354001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:34773 (local address 127.17.255.62:40367)
0812 17:43:49.354158 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:49.354162 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:49.355205 (+ 1043us) server_negotiation.cc:407] Connection header received
0812 17:43:49.356847 (+ 1642us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:49.356850 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:49.356920 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:49.357009 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:49.358437 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:49.358984 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:49.360334 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:49.360640 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:49.360757 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:49.364045 (+ 3288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:49.364048 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:49.364050 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:49.364078 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:49.365765 (+ 1687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:49.366423 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:49.366427 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:49.366428 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:49.366522 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:49.366914 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:49.366919 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:49.366920 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:49.367184 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:49.367292 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:49.367882 (+ 590us) server_negotiation.cc:299] Negotiation successful
0812 17:43:49.368029 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 17:43:49.369167 3594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:49.354477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40367 (local address 127.17.255.1:34773)
0812 17:43:49.355028 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:49.355076 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:49.356544 (+ 1468us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:49.357218 (+ 674us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:49.357227 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:49.357659 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:49.358218 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:49.358233 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:49.359139 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:49.359147 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:49.360185 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:49.360197 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:49.360830 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:49.360835 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:49.361077 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:49.361836 (+ 759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:49.361862 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:49.363815 (+ 1953us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:49.365943 (+ 2128us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:49.365951 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:49.365973 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:49.366284 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:49.366635 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:49.366638 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:49.366640 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:49.366809 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:49.367292 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:49.367302 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:49.367611 (+ 309us) client_negotiation.cc:769] Sending connection context
0812 17:43:49.367832 (+ 221us) client_negotiation.cc:240] Negotiation successful
0812 17:43:49.368224 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":134,"threads_started":1}
I20260812 17:43:49.370741 3591 heartbeater.cc:347] Connected to a master server at 127.17.255.62:40367
I20260812 17:43:49.371081 3591 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.17.255.2@KRBTEST.COM; defaulting to no policy
I20260812 17:43:49.371838 3591 heartbeater.cc:511] Master 127.17.255.62:40367 requested a full tablet report, sending...
I20260812 17:43:49.373855 3253 ts_manager.cc:194] Registered new tserver with Master: 56c7e8ae633248c18f3c3c37fa82858d (127.17.255.1:34243)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.2@KRBTEST.COM" created.
I20260812 17:43:49.375459 3253 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.1@KRBTEST.COM'} at 127.17.255.1:34773
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab.
Entry for principal kudu/127.17.255.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab.
I20260812 17:43:49.395418 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.2:0
--local_ip_for_outbound_sockets=127.17.255.2
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:40367
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:33099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:43:49.515777 3600 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:49.516060 3600 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:49.516108 3600 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:49.520448 3600 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:49.520516 3600 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:49.520612 3600 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.2
I20260812 17:43:49.526049 3600 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:33099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:40367
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3600
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.2
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:49.527274 3600 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:49.528364 3600 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:49.538504 3610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:49.538504 3612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:49.538597 3600 server_base.cc:1034] running on GCE node
W20260812 17:43:49.538597 3609 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:49.539264 3600 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:49.539981 3600 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:49.541181 3600 hybrid_clock.cc:648] HybridClock initialized: now 1786556629541144 us; error 47 us; skew 500 ppm
Aug 12 17:43:49 dist-test-slave-tk9z krb5kdc[3182](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556629, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:49.544222 3600 init.cc:377] Logged in from keytab as kudu/127.17.255.2@KRBTEST.COM (short username kudu)
I20260812 17:43:49.545179 3600 webserver.cc:460] Webserver started at http://127.17.255.2:42379/ using document root <none> and password file <none>
I20260812 17:43:49.545792 3600 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:49.545887 3600 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:49.546149 3600 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:49.548413 3600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/data/instance:
uuid: "08f530db3d764869acbe0fc399e807ec"
format_stamp: "Formatted at 2026-08-12 17:43:49 on dist-test-slave-tk9z"
server_key: "61521dfc260fb5d23251095c420d1874"
server_key_iv: "e6c745e627a59992284f0c10d5b35b81"
server_key_version: "encryptionkey@0"
I20260812 17:43:49.549067 3600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance:
uuid: "08f530db3d764869acbe0fc399e807ec"
format_stamp: "Formatted at 2026-08-12 17:43:49 on dist-test-slave-tk9z"
server_key: "61521dfc260fb5d23251095c420d1874"
server_key_iv: "e6c745e627a59992284f0c10d5b35b81"
server_key_version: "encryptionkey@0"
I20260812 17:43:49.553596 3600 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260812 17:43:49.556510 3620 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:49.558147 3600 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 17:43:49.558415 3600 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/wal
uuid: "08f530db3d764869acbe0fc399e807ec"
format_stamp: "Formatted at 2026-08-12 17:43:49 on dist-test-slave-tk9z"
server_key: "61521dfc260fb5d23251095c420d1874"
server_key_iv: "e6c745e627a59992284f0c10d5b35b81"
server_key_version: "encryptionkey@0"
I20260812 17:43:49.558590 3600 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:49.573884 3600 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:49.577419 3600 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:49.577659 3600 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:49.578346 3600 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:43:49.579334 3600 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:43:49.579407 3600 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:49.579489 3600 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:43:49.579540 3600 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:49.588810 3600 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.2:38673
I20260812 17:43:49.588877 3812 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.2:38673 every 8 connection(s)
I20260812 17:43:49.589824 3600 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
I20260812 17:43:49.593400 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 3600
I20260812 17:43:49.593545 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance
I20260812 17:43:49.593837 18428 external_mini_cluster.cc:1428] Setting key 4b7837d60c259ff8187b23766827325e
Aug 12 17:43:49 dist-test-slave-tk9z krb5kdc[3182](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556629, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.255.3@KRBTEST.COM; defaulting to no policy
I20260812 17:43:49.607407 3324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:49.591859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:37611 (local address 127.17.255.62:40367)
0812 17:43:49.592030 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:49.592034 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:49.593055 (+ 1021us) server_negotiation.cc:407] Connection header received
0812 17:43:49.595025 (+ 1970us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:49.595028 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:49.595078 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:49.595177 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:49.596997 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:49.597814 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:49.599167 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:49.599599 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:49.599739 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:49.602990 (+ 3251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:49.602996 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:49.603000 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:49.603040 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:49.604877 (+ 1837us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:49.605572 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:49.605576 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:49.605577 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:49.605668 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:49.606080 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:49.606084 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:49.606086 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:49.606361 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:49.606529 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:49.607105 (+ 576us) server_negotiation.cc:299] Negotiation successful
0812 17:43:49.607239 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.3@KRBTEST.COM" created.
I20260812 17:43:49.608445 3818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:49.592282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40367 (local address 127.17.255.2:37611)
0812 17:43:49.592845 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:49.592921 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:49.594723 (+ 1802us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:49.595416 (+ 693us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:49.595426 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:49.595988 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:49.596785 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:49.596811 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:49.597986 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:49.597989 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:49.599031 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:49.599043 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:49.599775 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:49.599778 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:49.599942 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:49.600679 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:49.600703 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:49.602726 (+ 2023us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:49.605031 (+ 2305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:49.605038 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:49.605054 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:49.605425 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:49.605772 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:49.605776 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:49.605778 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:49.605966 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:49.606540 (+ 574us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:49.606546 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:49.606839 (+ 293us) client_negotiation.cc:769] Sending connection context
0812 17:43:49.607014 (+ 175us) client_negotiation.cc:240] Negotiation successful
0812 17:43:49.607328 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":118,"threads_started":1}
I20260812 17:43:49.610013 3814 heartbeater.cc:347] Connected to a master server at 127.17.255.62:40367
I20260812 17:43:49.610319 3814 heartbeater.cc:464] Registering TS with master...
I20260812 17:43:49.610960 3814 heartbeater.cc:511] Master 127.17.255.62:40367 requested a full tablet report, sending...
I20260812 17:43:49.612237 3253 ts_manager.cc:194] Registered new tserver with Master: 08f530db3d764869acbe0fc399e807ec (127.17.255.2:38673)
I20260812 17:43:49.613170 3253 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.2@KRBTEST.COM'} at 127.17.255.2:37611
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab.
Entry for principal kudu/127.17.255.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab.
I20260812 17:43:49.627982 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.3:0
--local_ip_for_outbound_sockets=127.17.255.3
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:40367
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:33099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:43:49.750927 3821 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:43:49.751272 3821 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:43:49.751386 3821 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:43:49.755914 3821 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:43:49.756022 3821 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:43:49.756121 3821 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.3
I20260812 17:43:49.761803 3821 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:33099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:40367
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3821
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.3
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:43:49.763226 3821 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:43:49.764472 3821 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:43:49.775475 3836 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:43:49.775520 3829 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:49.775728 3821 server_base.cc:1034] running on GCE node
W20260812 17:43:49.775490 3832 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:43:49.776305 3821 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:43:49.777078 3821 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:43:49.778321 3821 hybrid_clock.cc:648] HybridClock initialized: now 1786556629778267 us; error 65 us; skew 500 ppm
Aug 12 17:43:49 dist-test-slave-tk9z krb5kdc[3182](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556629, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:43:49.781513 3821 init.cc:377] Logged in from keytab as kudu/127.17.255.3@KRBTEST.COM (short username kudu)
I20260812 17:43:49.782713 3821 webserver.cc:460] Webserver started at http://127.17.255.3:34935/ using document root <none> and password file <none>
I20260812 17:43:49.783320 3821 fs_manager.cc:359] Metadata directory not provided
I20260812 17:43:49.783448 3821 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:43:49.783704 3821 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:43:49.785930 3821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/data/instance:
uuid: "7b55b4551fa74372935b146364c7530f"
format_stamp: "Formatted at 2026-08-12 17:43:49 on dist-test-slave-tk9z"
server_key: "7760328469bd6cd0f52600b97fc56eec"
server_key_iv: "1ca2154d2c0b90f60cefa80f34ebd00d"
server_key_version: "encryptionkey@0"
I20260812 17:43:49.786634 3821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance:
uuid: "7b55b4551fa74372935b146364c7530f"
format_stamp: "Formatted at 2026-08-12 17:43:49 on dist-test-slave-tk9z"
server_key: "7760328469bd6cd0f52600b97fc56eec"
server_key_iv: "1ca2154d2c0b90f60cefa80f34ebd00d"
server_key_version: "encryptionkey@0"
I20260812 17:43:49.790566 3821 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 17:43:49.793152 3848 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:49.794713 3821 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:43:49.794854 3821 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/wal
uuid: "7b55b4551fa74372935b146364c7530f"
format_stamp: "Formatted at 2026-08-12 17:43:49 on dist-test-slave-tk9z"
server_key: "7760328469bd6cd0f52600b97fc56eec"
server_key_iv: "1ca2154d2c0b90f60cefa80f34ebd00d"
server_key_version: "encryptionkey@0"
I20260812 17:43:49.794981 3821 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:43:49.807840 3821 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:43:49.811358 3821 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:43:49.811594 3821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:43:49.812256 3821 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:43:49.813174 3821 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:43:49.813246 3821 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:49.813321 3821 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:43:49.813362 3821 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:43:49.823544 3821 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.3:38121
I20260812 17:43:49.823567 4035 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.3:38121 every 8 connection(s)
I20260812 17:43:49.824613 3821 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
I20260812 17:43:49.826081 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 3821
I20260812 17:43:49.826232 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance
I20260812 17:43:49.826576 18428 external_mini_cluster.cc:1428] Setting key 5d4a18ae439746fadf0c2a9355ef44c6
Aug 12 17:43:49 dist-test-slave-tk9z krb5kdc[3182](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556629, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:43:49.840181 3324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:49.826926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:34003 (local address 127.17.255.62:40367)
0812 17:43:49.827091 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:49.827096 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:49.828264 (+ 1168us) server_negotiation.cc:407] Connection header received
0812 17:43:49.829851 (+ 1587us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:49.829854 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:49.829911 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:49.829996 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:49.831351 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:49.831897 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:49.833104 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:49.833341 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:49.833460 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:49.836351 (+ 2891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:49.836355 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:49.836357 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:49.836387 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:49.837786 (+ 1399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:49.838327 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:49.838330 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:49.838332 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:49.838507 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:49.838857 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:49.838860 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:49.838861 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:49.839065 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:49.839148 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:49.839833 (+ 685us) server_negotiation.cc:299] Negotiation successful
0812 17:43:49.839998 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 17:43:49.841352 4038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:49.827503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40367 (local address 127.17.255.3:34003)
0812 17:43:49.828117 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:49.828165 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:49.829635 (+ 1470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:49.830177 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:49.830185 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:49.830671 (+ 486us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:43:49.831201 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:49.831216 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:49.832058 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:49.832061 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:49.832970 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:49.832980 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:49.833516 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:49.833520 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:49.833703 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:49.834475 (+ 772us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:43:49.834496 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:43:49.836154 (+ 1658us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:43:49.837911 (+ 1757us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:49.837917 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:49.837941 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:49.838231 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:49.838598 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:43:49.838601 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:43:49.838602 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:43:49.838759 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:43:49.839189 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:43:49.839197 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:43:49.839551 (+ 354us) client_negotiation.cc:769] Sending connection context
0812 17:43:49.839780 (+ 229us) client_negotiation.cc:240] Negotiation successful
0812 17:43:49.840183 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":396,"thread_start_us":213,"threads_started":1}
I20260812 17:43:49.842558 4036 heartbeater.cc:347] Connected to a master server at 127.17.255.62:40367
I20260812 17:43:49.842857 4036 heartbeater.cc:464] Registering TS with master...
I20260812 17:43:49.843451 4036 heartbeater.cc:511] Master 127.17.255.62:40367 requested a full tablet report, sending...
I20260812 17:43:49.844651 3253 ts_manager.cc:194] Registered new tserver with Master: 7b55b4551fa74372935b146364c7530f (127.17.255.3:38121)
I20260812 17:43:49.845213 3253 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.3@KRBTEST.COM'} at 127.17.255.3:34003
I20260812 17:43:49.853636 18428 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 17:43:49.864502 3324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:49.856026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44730 (local address 127.17.255.62:40367)
0812 17:43:49.856164 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:49.856168 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:49.856315 (+ 147us) server_negotiation.cc:407] Connection header received
0812 17:43:49.856434 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:49.856436 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:49.856480 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:49.856561 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:43:49.857327 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:49.857868 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:49.858908 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:49.859143 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:49.859239 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:49.860759 (+ 1520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:43:49.860763 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:43:49.860765 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:43:49.860793 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:43:49.862432 (+ 1639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:49.863025 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:49.863029 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:49.863030 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:49.863146 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:43:49.863516 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:43:49.863519 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:43:49.863520 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:43:49.863776 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:43:49.863895 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:49.864236 (+ 341us) server_negotiation.cc:299] Negotiation successful
0812 17:43:49.864350 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 17:43:49.868237 3253 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44730:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 17:43:49.871623 3253 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 17:43:49.888828 4057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:49.882607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:38673 (local address 127.0.0.1:48442)
0812 17:43:49.883581 (+ 974us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:49.883598 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:49.883707 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:49.884519 (+ 812us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:49.884522 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:49.884539 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:43:49.884659 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:49.884669 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:49.885916 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:49.885922 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:49.887153 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:49.887164 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:49.888247 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:49.888251 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:49.888386 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:49.888431 (+ 45us) client_negotiation.cc:769] Sending connection context
0812 17:43:49.888542 (+ 111us) client_negotiation.cc:240] Negotiation successful
0812 17:43:49.888669 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":903,"thread_start_us":120,"threads_started":1}
I20260812 17:43:49.888880 4058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:49.882930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48442 (local address 127.17.255.2:38673)
0812 17:43:49.883567 (+ 637us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:49.883583 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:49.883707 (+ 124us) server_negotiation.cc:407] Connection header received
0812 17:43:49.883941 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:49.883948 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:49.884177 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:49.884342 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:43:49.884816 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:49.885763 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:49.887296 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:49.888102 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:49.888225 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:49.888389 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:49.888622 (+ 233us) server_negotiation.cc:299] Negotiation successful
0812 17:43:49.888721 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":525,"thread_start_us":134,"threads_started":1}
I20260812 17:43:49.889297 4059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:49.883292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.3:38121 (local address 127.0.0.1:34572)
0812 17:43:49.883874 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:49.883889 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:49.883975 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:49.884696 (+ 721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:49.884702 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:49.884726 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:43:49.884825 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:49.884832 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:49.886218 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:49.886221 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:49.887520 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:49.887532 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:49.888484 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:49.888488 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:49.888603 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:49.888630 (+ 27us) client_negotiation.cc:769] Sending connection context
0812 17:43:49.888704 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 17:43:49.889180 (+ 476us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":507,"mutex_wait_us":86,"thread_start_us":94,"threads_started":1}
I20260812 17:43:49.889673 4055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:49.882463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34200 (local address 127.17.255.1:34243)
0812 17:43:49.883341 (+ 878us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:49.883350 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:49.883646 (+ 296us) server_negotiation.cc:407] Connection header received
0812 17:43:49.883940 (+ 294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:49.883947 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:49.884173 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:49.884343 (+ 170us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:43:49.884661 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:49.886114 (+ 1453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:49.887655 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:49.888516 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:49.888623 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:49.888774 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:49.889376 (+ 602us) server_negotiation.cc:299] Negotiation successful
0812 17:43:49.889501 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":737,"thread_start_us":138,"threads_started":1}
I20260812 17:43:49.889837 4060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:49.883739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34572 (local address 127.17.255.3:38121)
0812 17:43:49.884181 (+ 442us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:49.884193 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:49.884217 (+ 24us) server_negotiation.cc:407] Connection header received
0812 17:43:49.884360 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:49.884365 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:49.884543 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:49.884842 (+ 299us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:43:49.885022 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:49.886056 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:49.887695 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:49.888281 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:49.888385 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:49.888528 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:49.889146 (+ 618us) server_negotiation.cc:299] Negotiation successful
0812 17:43:49.889670 (+ 524us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":139,"threads_started":1}
I20260812 17:43:49.889302 4053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:49.882358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:34243 (local address 127.0.0.1:34200)
0812 17:43:49.883473 (+ 1115us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:49.883533 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:49.883695 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:49.884340 (+ 645us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:49.884347 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:49.884370 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:43:49.884520 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:49.884527 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:49.886227 (+ 1700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:49.886229 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:49.887520 (+ 1291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:49.887532 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:49.888846 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:49.888849 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:49.888941 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:49.888965 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 17:43:49.889062 (+ 97us) client_negotiation.cc:240] Negotiation successful
0812 17:43:49.889133 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":811,"mutex_wait_us":33,"thread_start_us":96,"threads_started":1}
I20260812 17:43:49.892684 3924 tablet_service.cc:1467] Processing CreateTablet for tablet 14fd2c172a0b441a94c555bc870e8608 (DEFAULT_TABLE table=test-table [id=c3f1756a93bf419d8d60f147f92d3477]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:43:49.892831 3473 tablet_service.cc:1467] Processing CreateTablet for tablet 14fd2c172a0b441a94c555bc870e8608 (DEFAULT_TABLE table=test-table [id=c3f1756a93bf419d8d60f147f92d3477]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:43:49.892838 3708 tablet_service.cc:1467] Processing CreateTablet for tablet 14fd2c172a0b441a94c555bc870e8608 (DEFAULT_TABLE table=test-table [id=c3f1756a93bf419d8d60f147f92d3477]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:43:49.894048 3924 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14fd2c172a0b441a94c555bc870e8608. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:49.894042 3473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14fd2c172a0b441a94c555bc870e8608. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:49.894042 3708 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14fd2c172a0b441a94c555bc870e8608. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:43:49.903682 4061 tablet_bootstrap.cc:492] T 14fd2c172a0b441a94c555bc870e8608 P 56c7e8ae633248c18f3c3c37fa82858d: Bootstrap starting.
I20260812 17:43:49.904465 4064 tablet_bootstrap.cc:492] T 14fd2c172a0b441a94c555bc870e8608 P 08f530db3d764869acbe0fc399e807ec: Bootstrap starting.
I20260812 17:43:49.906179 4061 tablet_bootstrap.cc:654] T 14fd2c172a0b441a94c555bc870e8608 P 56c7e8ae633248c18f3c3c37fa82858d: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:49.906800 4063 tablet_bootstrap.cc:492] T 14fd2c172a0b441a94c555bc870e8608 P 7b55b4551fa74372935b146364c7530f: Bootstrap starting.
I20260812 17:43:49.906962 4064 tablet_bootstrap.cc:654] T 14fd2c172a0b441a94c555bc870e8608 P 08f530db3d764869acbe0fc399e807ec: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:49.907222 4061 log.cc:824] T 14fd2c172a0b441a94c555bc870e8608 P 56c7e8ae633248c18f3c3c37fa82858d: Log is configured to *not* fsync() on all Append() calls
I20260812 17:43:49.907824 4064 log.cc:824] T 14fd2c172a0b441a94c555bc870e8608 P 08f530db3d764869acbe0fc399e807ec: Log is configured to *not* fsync() on all Append() calls
I20260812 17:43:49.909377 4061 tablet_bootstrap.cc:492] T 14fd2c172a0b441a94c555bc870e8608 P 56c7e8ae633248c18f3c3c37fa82858d: No bootstrap required, opened a new log
I20260812 17:43:49.909423 4063 tablet_bootstrap.cc:654] T 14fd2c172a0b441a94c555bc870e8608 P 7b55b4551fa74372935b146364c7530f: Neither blocks nor log segments found. Creating new log.
I20260812 17:43:49.909610 4061 ts_tablet_manager.cc:1397] T 14fd2c172a0b441a94c555bc870e8608 P 56c7e8ae633248c18f3c3c37fa82858d: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260812 17:43:49.909869 4064 tablet_bootstrap.cc:492] T 14fd2c172a0b441a94c555bc870e8608 P 08f530db3d764869acbe0fc399e807ec: No bootstrap required, opened a new log
I20260812 17:43:49.910061 4064 ts_tablet_manager.cc:1397] T 14fd2c172a0b441a94c555bc870e8608 P 08f530db3d764869acbe0fc399e807ec: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 17:43:49.910241 4063 log.cc:824] T 14fd2c172a0b441a94c555bc870e8608 P 7b55b4551fa74372935b146364c7530f: Log is configured to *not* fsync() on all Append() calls
I20260812 17:43:49.912319 4063 tablet_bootstrap.cc:492] T 14fd2c172a0b441a94c555bc870e8608 P 7b55b4551fa74372935b146364c7530f: No bootstrap required, opened a new log
I20260812 17:43:49.912508 4063 ts_tablet_manager.cc:1397] T 14fd2c172a0b441a94c555bc870e8608 P 7b55b4551fa74372935b146364c7530f: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260812 17:43:49.913834 4061 raft_consensus.cc:348] T 14fd2c172a0b441a94c555bc870e8608 P 56c7e8ae633248c18f3c3c37fa82858d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c7e8ae633248c18f3c3c37fa82858d" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34243 } } peers { permanent_uuid: "08f530db3d764869acbe0fc399e807ec" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38673 } } peers { permanent_uuid: "7b55b4551fa74372935b146364c7530f" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 38121 } }
I20260812 17:43:49.913903 4064 raft_consensus.cc:348] T 14fd2c172a0b441a94c555bc870e8608 P 08f530db3d764869acbe0fc399e807ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c7e8ae633248c18f3c3c37fa82858d" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34243 } } peers { permanent_uuid: "08f530db3d764869acbe0fc399e807ec" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38673 } } peers { permanent_uuid: "7b55b4551fa74372935b146364c7530f" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 38121 } }
I20260812 17:43:49.914099 4061 raft_consensus.cc:374] T 14fd2c172a0b441a94c555bc870e8608 P 56c7e8ae633248c18f3c3c37fa82858d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:49.914156 4061 raft_consensus.cc:729] T 14fd2c172a0b441a94c555bc870e8608 P 56c7e8ae633248c18f3c3c37fa82858d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c7e8ae633248c18f3c3c37fa82858d, State: Initialized, Role: FOLLOWER
I20260812 17:43:49.914168 4064 raft_consensus.cc:374] T 14fd2c172a0b441a94c555bc870e8608 P 08f530db3d764869acbe0fc399e807ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:49.914219 4064 raft_consensus.cc:729] T 14fd2c172a0b441a94c555bc870e8608 P 08f530db3d764869acbe0fc399e807ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08f530db3d764869acbe0fc399e807ec, State: Initialized, Role: FOLLOWER
I20260812 17:43:49.914716 4064 consensus_queue.cc:260] T 14fd2c172a0b441a94c555bc870e8608 P 08f530db3d764869acbe0fc399e807ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c7e8ae633248c18f3c3c37fa82858d" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34243 } } peers { permanent_uuid: "08f530db3d764869acbe0fc399e807ec" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38673 } } peers { permanent_uuid: "7b55b4551fa74372935b146364c7530f" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 38121 } }
I20260812 17:43:49.914700 4061 consensus_queue.cc:260] T 14fd2c172a0b441a94c555bc870e8608 P 56c7e8ae633248c18f3c3c37fa82858d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c7e8ae633248c18f3c3c37fa82858d" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34243 } } peers { permanent_uuid: "08f530db3d764869acbe0fc399e807ec" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38673 } } peers { permanent_uuid: "7b55b4551fa74372935b146364c7530f" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 38121 } }
I20260812 17:43:49.915809 4064 ts_tablet_manager.cc:1428] T 14fd2c172a0b441a94c555bc870e8608 P 08f530db3d764869acbe0fc399e807ec: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260812 17:43:49.915817 4061 ts_tablet_manager.cc:1428] T 14fd2c172a0b441a94c555bc870e8608 P 56c7e8ae633248c18f3c3c37fa82858d: Time spent starting tablet: real 0.006s user 0.004s sys 0.003s
I20260812 17:43:49.916239 3814 heartbeater.cc:503] Master 127.17.255.62:40367 was elected leader, sending a full tablet report...
I20260812 17:43:49.916383 4063 raft_consensus.cc:348] T 14fd2c172a0b441a94c555bc870e8608 P 7b55b4551fa74372935b146364c7530f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c7e8ae633248c18f3c3c37fa82858d" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34243 } } peers { permanent_uuid: "08f530db3d764869acbe0fc399e807ec" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38673 } } peers { permanent_uuid: "7b55b4551fa74372935b146364c7530f" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 38121 } }
I20260812 17:43:49.916633 4063 raft_consensus.cc:374] T 14fd2c172a0b441a94c555bc870e8608 P 7b55b4551fa74372935b146364c7530f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:43:49.916733 4063 raft_consensus.cc:729] T 14fd2c172a0b441a94c555bc870e8608 P 7b55b4551fa74372935b146364c7530f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b55b4551fa74372935b146364c7530f, State: Initialized, Role: FOLLOWER
I20260812 17:43:49.917155 4063 consensus_queue.cc:260] T 14fd2c172a0b441a94c555bc870e8608 P 7b55b4551fa74372935b146364c7530f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c7e8ae633248c18f3c3c37fa82858d" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34243 } } peers { permanent_uuid: "08f530db3d764869acbe0fc399e807ec" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38673 } } peers { permanent_uuid: "7b55b4551fa74372935b146364c7530f" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 38121 } }
I20260812 17:43:49.917521 3591 heartbeater.cc:503] Master 127.17.255.62:40367 was elected leader, sending a full tablet report...
I20260812 17:43:49.917949 4036 heartbeater.cc:503] Master 127.17.255.62:40367 was elected leader, sending a full tablet report...
I20260812 17:43:49.918215 4063 ts_tablet_manager.cc:1428] T 14fd2c172a0b441a94c555bc870e8608 P 7b55b4551fa74372935b146364c7530f: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260812 17:43:49.958830 4076 raft_consensus.cc:482] T 14fd2c172a0b441a94c555bc870e8608 P 56c7e8ae633248c18f3c3c37fa82858d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:43:49.959115 4076 raft_consensus.cc:504] T 14fd2c172a0b441a94c555bc870e8608 P 56c7e8ae633248c18f3c3c37fa82858d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c7e8ae633248c18f3c3c37fa82858d" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34243 } } peers { permanent_uuid: "08f530db3d764869acbe0fc399e807ec" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38673 } } peers { permanent_uuid: "7b55b4551fa74372935b146364c7530f" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 38121 } }
I20260812 17:43:49.960506 4076 leader_election.cc:288] T 14fd2c172a0b441a94c555bc870e8608 P 56c7e8ae633248c18f3c3c37fa82858d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08f530db3d764869acbe0fc399e807ec (127.17.255.2:38673), 7b55b4551fa74372935b146364c7530f (127.17.255.3:38121)
I20260812 17:43:49.965289 4058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:49.960939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:46871 (local address 127.17.255.2:38673)
0812 17:43:49.961092 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:49.961096 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:49.961351 (+ 255us) server_negotiation.cc:407] Connection header received
0812 17:43:49.961575 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:49.961582 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:49.961647 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:49.961701 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:43:49.962174 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:49.962812 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:49.964148 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:49.964648 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:49.964748 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:49.964789 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:49.965084 (+ 295us) server_negotiation.cc:299] Negotiation successful
0812 17:43:49.965167 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 17:43:49.965292 4079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:49.960853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:38673 (local address 127.17.255.1:46871)
0812 17:43:49.961227 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:49.961244 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:49.961375 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:49.961882 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:49.961885 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:49.961907 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:43:49.962068 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:49.962075 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:49.962933 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:49.962939 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:49.964016 (+ 1077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:49.964027 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:49.964780 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:49.964786 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:49.964911 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:49.964967 (+ 56us) client_negotiation.cc:769] Sending connection context
0812 17:43:49.965043 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 17:43:49.965119 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"mutex_wait_us":25,"thread_start_us":149,"threads_started":1}
I20260812 17:43:49.965317 4082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:49.961359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.3:38121 (local address 127.17.255.1:43855)
0812 17:43:49.961670 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:49.961682 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 17:43:49.961784 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:43:49.962044 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:43:49.962046 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:43:49.962060 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:43:49.962214 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:49.962219 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:49.963019 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:49.963026 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:49.964118 (+ 1092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:43:49.964132 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:43:49.964879 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:43:49.964882 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:43:49.965000 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:49.965044 (+ 44us) client_negotiation.cc:769] Sending connection context
0812 17:43:49.965124 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 17:43:49.965186 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"mutex_wait_us":22,"thread_start_us":97,"threads_started":1}
I20260812 17:43:49.965350 4060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:49.961544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:43855 (local address 127.17.255.3:38121)
0812 17:43:49.961698 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:49.961702 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:49.961767 (+ 65us) server_negotiation.cc:407] Connection header received
0812 17:43:49.961885 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:49.961887 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:49.961948 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:49.962029 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:43:49.962330 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:49.962894 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:49.964316 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:49.964751 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:49.964875 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:49.964945 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:49.965157 (+ 212us) server_negotiation.cc:299] Negotiation successful
0812 17:43:49.965232 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 17:43:49.966001 3955 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14fd2c172a0b441a94c555bc870e8608" candidate_uuid: "56c7e8ae633248c18f3c3c37fa82858d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b55b4551fa74372935b146364c7530f" is_pre_election: true
I20260812 17:43:49.966005 3741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14fd2c172a0b441a94c555bc870e8608" candidate_uuid: "56c7e8ae633248c18f3c3c37fa82858d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08f530db3d764869acbe0fc399e807ec" is_pre_election: true
I20260812 17:43:49.966354 3955 raft_consensus.cc:2454] T 14fd2c172a0b441a94c555bc870e8608 P 7b55b4551fa74372935b146364c7530f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56c7e8ae633248c18f3c3c37fa82858d in term 0.
I20260812 17:43:49.966354 3741 raft_consensus.cc:2454] T 14fd2c172a0b441a94c555bc870e8608 P 08f530db3d764869acbe0fc399e807ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56c7e8ae633248c18f3c3c37fa82858d in term 0.
I20260812 17:43:49.966871 3391 leader_election.cc:302] T 14fd2c172a0b441a94c555bc870e8608 P 56c7e8ae633248c18f3c3c37fa82858d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08f530db3d764869acbe0fc399e807ec, 56c7e8ae633248c18f3c3c37fa82858d; no voters:
I20260812 17:43:49.967113 4076 raft_consensus.cc:2781] T 14fd2c172a0b441a94c555bc870e8608 P 56c7e8ae633248c18f3c3c37fa82858d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 17:43:49.967192 4076 raft_consensus.cc:482] T 14fd2c172a0b441a94c555bc870e8608 P 56c7e8ae633248c18f3c3c37fa82858d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 17:43:49.967224 4076 raft_consensus.cc:3037] T 14fd2c172a0b441a94c555bc870e8608 P 56c7e8ae633248c18f3c3c37fa82858d [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:49.968284 4076 raft_consensus.cc:504] T 14fd2c172a0b441a94c555bc870e8608 P 56c7e8ae633248c18f3c3c37fa82858d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c7e8ae633248c18f3c3c37fa82858d" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34243 } } peers { permanent_uuid: "08f530db3d764869acbe0fc399e807ec" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38673 } } peers { permanent_uuid: "7b55b4551fa74372935b146364c7530f" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 38121 } }
I20260812 17:43:49.968628 4076 leader_election.cc:288] T 14fd2c172a0b441a94c555bc870e8608 P 56c7e8ae633248c18f3c3c37fa82858d [CANDIDATE]: Term 1 election: Requested vote from peers 08f530db3d764869acbe0fc399e807ec (127.17.255.2:38673), 7b55b4551fa74372935b146364c7530f (127.17.255.3:38121)
I20260812 17:43:49.969067 3955 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14fd2c172a0b441a94c555bc870e8608" candidate_uuid: "56c7e8ae633248c18f3c3c37fa82858d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b55b4551fa74372935b146364c7530f"
I20260812 17:43:49.969067 3741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14fd2c172a0b441a94c555bc870e8608" candidate_uuid: "56c7e8ae633248c18f3c3c37fa82858d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08f530db3d764869acbe0fc399e807ec"
I20260812 17:43:49.969195 3741 raft_consensus.cc:3037] T 14fd2c172a0b441a94c555bc870e8608 P 08f530db3d764869acbe0fc399e807ec [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:49.969195 3955 raft_consensus.cc:3037] T 14fd2c172a0b441a94c555bc870e8608 P 7b55b4551fa74372935b146364c7530f [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:43:49.970621 3741 raft_consensus.cc:2454] T 14fd2c172a0b441a94c555bc870e8608 P 08f530db3d764869acbe0fc399e807ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56c7e8ae633248c18f3c3c37fa82858d in term 1.
I20260812 17:43:49.970621 3955 raft_consensus.cc:2454] T 14fd2c172a0b441a94c555bc870e8608 P 7b55b4551fa74372935b146364c7530f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56c7e8ae633248c18f3c3c37fa82858d in term 1.
I20260812 17:43:49.970934 3391 leader_election.cc:302] T 14fd2c172a0b441a94c555bc870e8608 P 56c7e8ae633248c18f3c3c37fa82858d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08f530db3d764869acbe0fc399e807ec, 56c7e8ae633248c18f3c3c37fa82858d; no voters:
I20260812 17:43:49.971128 4076 raft_consensus.cc:2781] T 14fd2c172a0b441a94c555bc870e8608 P 56c7e8ae633248c18f3c3c37fa82858d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:43:49.971349 4076 raft_consensus.cc:686] T 14fd2c172a0b441a94c555bc870e8608 P 56c7e8ae633248c18f3c3c37fa82858d [term 1 LEADER]: Becoming Leader. State: Replica: 56c7e8ae633248c18f3c3c37fa82858d, State: Running, Role: LEADER
I20260812 17:43:49.971735 4076 consensus_queue.cc:237] T 14fd2c172a0b441a94c555bc870e8608 P 56c7e8ae633248c18f3c3c37fa82858d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c7e8ae633248c18f3c3c37fa82858d" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34243 } } peers { permanent_uuid: "08f530db3d764869acbe0fc399e807ec" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38673 } } peers { permanent_uuid: "7b55b4551fa74372935b146364c7530f" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 38121 } }
I20260812 17:43:49.975637 3252 catalog_manager.cc:5495] T 14fd2c172a0b441a94c555bc870e8608 P 56c7e8ae633248c18f3c3c37fa82858d reported cstate change: term changed from 0 to 1, leader changed from <none> to 56c7e8ae633248c18f3c3c37fa82858d (127.17.255.1). New cstate: current_term: 1 leader_uuid: "56c7e8ae633248c18f3c3c37fa82858d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c7e8ae633248c18f3c3c37fa82858d" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 34243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08f530db3d764869acbe0fc399e807ec" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b55b4551fa74372935b146364c7530f" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 38121 } health_report { overall_health: UNKNOWN } } }
I20260812 17:43:49.991822 4055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:49.988004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34214 (local address 127.17.255.1:34243)
0812 17:43:49.988133 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0812 17:43:49.988137 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:43:49.988150 (+ 13us) server_negotiation.cc:407] Connection header received
0812 17:43:49.988383 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:43:49.988386 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:43:49.988460 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:43:49.988578 (+ 118us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:43:49.988792 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:49.989355 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:49.990218 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:43:49.990647 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:43:49.990734 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:43:49.991011 (+ 277us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:43:49.991444 (+ 433us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:43:49.991536 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 17:43:49.991596 (+ 60us) server_negotiation.cc:299] Negotiation successful
0812 17:43:49.991644 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 17:43:49.998221 3741 raft_consensus.cc:1261] T 14fd2c172a0b441a94c555bc870e8608 P 08f530db3d764869acbe0fc399e807ec [term 1 FOLLOWER]: Refusing update from remote peer 56c7e8ae633248c18f3c3c37fa82858d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:43:49.998221 3955 raft_consensus.cc:1261] T 14fd2c172a0b441a94c555bc870e8608 P 7b55b4551fa74372935b146364c7530f [term 1 FOLLOWER]: Refusing update from remote peer 56c7e8ae633248c18f3c3c37fa82858d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:43:49.999058 4076 consensus_queue.cc:1035] T 14fd2c172a0b441a94c555bc870e8608 P 56c7e8ae633248c18f3c3c37fa82858d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b55b4551fa74372935b146364c7530f" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 38121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:43:49.999332 4083 consensus_queue.cc:1035] T 14fd2c172a0b441a94c555bc870e8608 P 56c7e8ae633248c18f3c3c37fa82858d [LEADER]: Connected to new peer: Peer: permanent_uuid: "08f530db3d764869acbe0fc399e807ec" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 38673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:43:50.008056 4089 mvcc.cc:205] Tried to move back new op lower bound from 7317735956464549888 to 7317735956367421440. Current Snapshot: MvccSnapshot[applied={T|T < 7317735956464549888}]
I20260812 17:43:50.011512 4087 mvcc.cc:205] Tried to move back new op lower bound from 7317735956464549888 to 7317735956367421440. Current Snapshot: MvccSnapshot[applied={T|T < 7317735956464549888 or (T in {7317735956464549888})}]
I20260812 17:43:50.018293 3253 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44730:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:43:50.018579 3253 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44730:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:43:50.022634 3253 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 61524f38380c420ab946c7ea007035af: Sending DeleteTablet for 3 replicas of tablet 14fd2c172a0b441a94c555bc870e8608
I20260812 17:43:50.023624 3473 tablet_service.cc:1514] Processing DeleteTablet for tablet 14fd2c172a0b441a94c555bc870e8608 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:43:50 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:34200
I20260812 17:43:50.024212 4097 tablet_replica.cc:330] T 14fd2c172a0b441a94c555bc870e8608 P 56c7e8ae633248c18f3c3c37fa82858d: stopping tablet replica
I20260812 17:43:50.024616 4097 raft_consensus.cc:2229] T 14fd2c172a0b441a94c555bc870e8608 P 56c7e8ae633248c18f3c3c37fa82858d [term 1 LEADER]: Raft consensus shutting down.
I20260812 17:43:50.024784 3708 tablet_service.cc:1514] Processing DeleteTablet for tablet 14fd2c172a0b441a94c555bc870e8608 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:43:50 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:48442
I20260812 17:43:50.025197 4097 raft_consensus.cc:2258] T 14fd2c172a0b441a94c555bc870e8608 P 56c7e8ae633248c18f3c3c37fa82858d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:43:50.025314 3924 tablet_service.cc:1514] Processing DeleteTablet for tablet 14fd2c172a0b441a94c555bc870e8608 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:43:50 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:34572
I20260812 17:43:50.026216 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 3362
I20260812 17:43:50.027209 4099 tablet_replica.cc:330] T 14fd2c172a0b441a94c555bc870e8608 P 7b55b4551fa74372935b146364c7530f: stopping tablet replica
I20260812 17:43:50.027581 4099 raft_consensus.cc:2229] T 14fd2c172a0b441a94c555bc870e8608 P 7b55b4551fa74372935b146364c7530f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:43:50.027951 4099 raft_consensus.cc:2258] T 14fd2c172a0b441a94c555bc870e8608 P 7b55b4551fa74372935b146364c7530f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:43:50.038923 4099 ts_tablet_manager.cc:1905] T 14fd2c172a0b441a94c555bc870e8608 P 7b55b4551fa74372935b146364c7530f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:43:50.041306 4099 ts_tablet_manager.cc:1918] T 14fd2c172a0b441a94c555bc870e8608 P 7b55b4551fa74372935b146364c7530f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 17:43:50.041452 4099 log.cc:1196] T 14fd2c172a0b441a94c555bc870e8608 P 7b55b4551fa74372935b146364c7530f: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786556557564181-18428-0/minicluster-data/ts-2/wal/wals/14fd2c172a0b441a94c555bc870e8608
I20260812 17:43:50.041839 4099 ts_tablet_manager.cc:1939] T 14fd2c172a0b441a94c555bc870e8608 P 7b55b4551fa74372935b146364c7530f: Deleting consensus metadata
I20260812 17:43:50.041827 4098 tablet_replica.cc:330] T 14fd2c172a0b441a94c555bc870e8608 P 08f530db3d764869acbe0fc399e807ec: stopping tablet replica
I20260812 17:43:50.042312 4098 raft_consensus.cc:2229] T 14fd2c172a0b441a94c555bc870e8608 P 08f530db3d764869acbe0fc399e807ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:43:50.042785 4098 raft_consensus.cc:2258] T 14fd2c172a0b441a94c555bc870e8608 P 08f530db3d764869acbe0fc399e807ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:43:50.043365 3226 catalog_manager.cc:4841] TS 7b55b4551fa74372935b146364c7530f (127.17.255.3:38121): tablet 14fd2c172a0b441a94c555bc870e8608 (table test-table [id=c3f1756a93bf419d8d60f147f92d3477]) successfully deleted
I20260812 17:43:50.044672 4098 ts_tablet_manager.cc:1905] T 14fd2c172a0b441a94c555bc870e8608 P 08f530db3d764869acbe0fc399e807ec: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 17:43:50.044723 3230 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.255.1:34243 (error 108)
I20260812 17:43:50.045843 4057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:50.045547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:34243 (local address 127.0.0.1:34226)
0812 17:43:50.045687 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:50.045760 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.1:34243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260812 17:43:50.045903 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 3600
W20260812 17:43:50.052304 3230 catalog_manager.cc:4584] TS 56c7e8ae633248c18f3c3c37fa82858d (127.17.255.1:34243): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 14fd2c172a0b441a94c555bc870e8608: Network error: Client connection negotiation failed: client connection to 127.17.255.1:34243: connect: Connection refused (error 111)
I20260812 17:43:50.058163 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 3821
I20260812 17:43:50.062152 4057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:43:50.061730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:38673 (local address 127.0.0.1:48446)
0812 17:43:50.061976 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0812 17:43:50.062041 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.2:38673: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148}
I20260812 17:43:50.072345 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 3207
2026-08-12T17:43:50Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2714 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:43:50 dist-test-slave-tk9z krb5kdc[4105](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:43:50 dist-test-slave-tk9z krb5kdc[4105](info): set up 2 sockets
Aug 12 17:43:50 dist-test-slave-tk9z krb5kdc[4105](info): commencing operation
krb5kdc: starting...
W20260812 17:43:51.435647 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.327s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:43:51 dist-test-slave-tk9z krb5kdc[4105](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556631, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:43:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:43:51Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.17.255.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.17.255.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.17.255.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/krb5kdc/rangeradmin_127.17.255.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.17.255.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/krb5kdc/rangeradmin_127.17.255.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.17.255.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.17.255.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.17.255.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/krb5kdc/rangerlookup_127.17.255.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.17.255.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/krb5kdc/rangerlookup_127.17.255.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.17.255.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.17.255.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.17.255.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/krb5kdc/HTTP_127.17.255.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.17.255.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/krb5kdc/HTTP_127.17.255.20@KRBTEST.COM.keytab.
I20260812 17:43:51.642016 18428 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskHxSJQV/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/postgres -l logfile start
2026-08-12 17:43:54.591 UTC [4159] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-12 17:43:54.591 UTC [4159] LOG: listening on IPv4 address "127.17.255.20", port 41261
2026-08-12 17:43:54.596 UTC [4159] LOG: listening on Unix socket "/tmp/.s.PGSQL.41261"
2026-08-12 17:43:54.632 UTC [4164] LOG: database system was shut down at 2026-08-12 17:43:52 UTC
2026-08-12 17:43:54.637 UTC [4159] LOG: database system is ready to accept connections
I20260812 17:43:55.904450 18428 mini_postgres.cc:96] Postgres bound to 41261
2026-08-12 17:43:55.913 UTC [4178] FATAL: database "slave" does not exist
127.17.255.20:41261 - accepting connections
I20260812 17:43:55.914160 18428 mini_ranger.cc:161] Starting Ranger...
I20260812 17:43:55.931473 18428 mini_ranger.cc:84] Created miniranger Postgres user
I20260812 17:43:56.470017 18428 mini_ranger.cc:87] Created ranger Postgres database
I20260812 17:43:56.470139 18428 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ranger-admin
2026-08-12 17:43:56,951 [I] DB FLAVOR :POSTGRES
2026-08-12 17:43:56,951 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 17:43:56,952 [I] Checking connection..
2026-08-12 17:43:56,952 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:41261/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-12 17:43:57,272 [I] Checking connection passed.
2026-08-12 17:43:57,272 [I] --------- Verifying version history table ---------
2026-08-12 17:43:57,273 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:41261/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 17:43:57,591 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 17:43:57,592 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:41261/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 17:43:57,877 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 17:43:57,877 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-12 17:43:57,878 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:41261/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-12 17:43:58.159 UTC [4289] WARNING: there is no transaction in progress
2026-08-12 17:43:58,167 [I] create_dbversion_catalog.sql file imported successfully
2026-08-12 17:43:58,167 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:41261/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 17:43:58,439 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-12 17:43:58,439 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 17:43:58,439 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:41261/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-12 17:43:58,726 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:41261/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-12 17:43:58,986 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:41261/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-tk9z.c.gcp-upstream.internal','N') ;"
2026-08-12 17:43:59,227 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:41261/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 17:43:59,505 [I] Table x_portal_user does not exist in database ranger
2026-08-12 17:43:59,505 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:41261/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 17:43:59,799 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-12 17:43:59,799 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:41261/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 17:44:00,089 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:41261/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 17:44:00,367 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-12 17:44:00,367 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:41261/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-12 17:44:01.463 UTC [4465] WARNING: there is no transaction in progress
2026-08-12 17:44:01.482 UTC [4465] WARNING: there is no transaction in progress
2026-08-12 17:44:01.502 UTC [4465] WARNING: there is no transaction in progress
2026-08-12 17:44:01.521 UTC [4465] WARNING: there is no transaction in progress
2026-08-12 17:44:01.541 UTC [4465] WARNING: there is no transaction in progress
2026-08-12 17:44:01.562 UTC [4465] WARNING: there is no transaction in progress
2026-08-12 17:44:01.648 UTC [4465] WARNING: there is no transaction in progress
2026-08-12 17:44:01.656 UTC [4465] WARNING: there is no transaction in progress
2026-08-12 17:44:01.673 UTC [4465] WARNING: there is no transaction in progress
2026-08-12 17:44:01.685 UTC [4465] WARNING: there is no transaction in progress
2026-08-12 17:44:01.698 UTC [4465] WARNING: there is no transaction in progress
2026-08-12 17:44:01.715 UTC [4465] WARNING: there is no transaction in progress
2026-08-12 17:44:01.726 UTC [4465] WARNING: there is no transaction in progress
2026-08-12 17:44:01.734 UTC [4465] WARNING: there is no transaction in progress
2026-08-12 17:44:01.743 UTC [4465] WARNING: there is no transaction in progress
2026-08-12 17:44:01.752 UTC [4465] WARNING: there is no transaction in progress
2026-08-12 17:44:02,669 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-12 17:44:02,670 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:41261/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-12 17:44:02,961 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-12 17:44:02,961 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:41261/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 17:44:03,238 [I] Table x_portal_user already exists in database 'ranger'
2026-08-12 17:44:03,239 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:41261/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 17:44:03,508 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-12 17:44:03,509 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:41261/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 17:44:03,770 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:41261/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 17:44:04,026 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:41261/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-tk9z.c.gcp-upstream.internal';"
2026-08-12 17:44:04,279 [I] CORE_DB_SCHEMA import status has been updated
2026-08-12 17:44:04,279 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:41261/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-12 17:44:04,539 [I] DB_PATCHES have already been applied
I20260812 17:44:04.545254 18428 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ranger-admin:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskHxSJQV/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260812 17:44:04.545339 18428 mini_ranger.cc:193] Using host: 127.17.255.20
I20260812 17:44:04.550109 18428 mini_ranger.cc:227] Ranger admin URL: http://127.17.255.20:50375
Aug 12, 2026 5:44:04 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 5:44:04 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 5:44:05 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ranger-admin/ews/webapp
Aug 12, 2026 5:44:05 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 12, 2026 5:44:05 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 12, 2026 5:44:05 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ranger-admin/ews/webapp].
Aug 12, 2026 5:44:05 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260812 17:44:05.985266 18428 mini_ranger.cc:160] Time spent starting Ranger: real 10.071s user 0.000s sys 0.013s
Aug 12, 2026 5:44:26 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 12, 2026 5:44:26 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 12, 2026 5:44:26 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 12, 2026 5:44:26 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 12, 2026 5:44:26 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 12, 2026 5:44:26 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 12, 2026 5:44:26 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 12, 2026 5:44:26 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 12, 2026 5:44:26 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 12, 2026 5:44:26 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 12, 2026 5:44:26 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 12, 2026 5:44:26 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 12, 2026 5:44:26 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 12, 2026 5:44:26 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 12, 2026 5:44:26 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 12, 2026 5:44:26 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 12, 2026 5:44:26 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 12, 2026 5:44:27 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260812 17:44:28.421012 18428 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.17.255.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.17.255.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.17.255.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/krb5kdc/rangerkms_127.17.255.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.17.255.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/krb5kdc/rangerkms_127.17.255.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.17.255.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.17.255.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.17.255.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/krb5kdc/HTTP_127.17.255.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.17.255.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/krb5kdc/HTTP_127.17.255.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 12 17:44:28 dist-test-slave-tk9z krb5kdc[4105](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556668, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260812 17:44:28.514650 18428 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260812 17:44:28.525236 18428 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260812 17:44:29.516059 18428 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260812 17:44:29.516153 18428 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ranger-kms
I20260812 17:44:29.516258 18428 mini_ranger_kms.cc:227] Using postgres at 127.17.255.20:41261
2026-08-12 17:44:30,184 [I] DB FLAVOR :POSTGRES
2026-08-12 17:44:30,185 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 17:44:30,185 [I] Checking connection
2026-08-12 17:44:30,185 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:41261/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-12 17:44:30,459 [I] connection success
2026-08-12 17:44:30,459 [I] --------- Verifying Ranger DB tables ---------
2026-08-12 17:44:30,459 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-12 17:44:30,459 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:41261/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-12 17:44:30,716 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-12 17:44:30,716 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 17:44:30,716 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-12 17:44:30,717 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:41261/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-12 17:44:31,008 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260812 17:44:31.574229 18428 mini_ranger_kms.cc:310] Created kms service
I20260812 17:44:31.789278 18428 mini_ranger_kms.cc:326] Created kudu user
I20260812 17:44:31.842993 18428 mini_ranger_kms.cc:343] Created rangerkms user
Aug 12 17:44:31 dist-test-slave-tk9z krb5kdc[4105](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556668, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.17.255.20@KRBTEST.COM
I20260812 17:44:32.297928 18428 mini_ranger_kms.cc:384] Added ranger policy
I20260812 17:44:32.298187 18428 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ranger-kms:/tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260812 17:44:32.298220 18428 mini_ranger_kms.cc:240] Using host: 127.17.255.20
I20260812 17:44:32.302945 18428 mini_ranger_kms.cc:276] Ranger KMS PID: 4769
I20260812 17:44:32.303112 18428 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.17.255.20:42833
Aug 12, 2026 5:44:33 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 5:44:33 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 5:44:33 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 12, 2026 5:44:33 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 12, 2026 5:44:33 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ranger-kms/ews/webapp].
Aug 12, 2026 5:44:33 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 12 17:44:34 dist-test-slave-tk9z krb5kdc[4105](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786556674, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.255.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:44:35.244485 18428 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.730s user 0.036s sys 0.291s
I20260812 17:44:35.244642 18428 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260812 17:44:35.244814 18428 mini_ranger_kms.cc:401] 127.17.255.20:42833/kms/v1/keys
Aug 12 17:44:35 dist-test-slave-tk9z krb5kdc[4105](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556674, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.255.20@KRBTEST.COM for HTTP/127.17.255.20@KRBTEST.COM
Aug 12 17:44:35 dist-test-slave-tk9z krb5kdc[4105](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556674, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.255.20@KRBTEST.COM for HTTP/127.17.255.20@KRBTEST.COM
Aug 12 17:44:37 dist-test-slave-tk9z krb5kdc[4105](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556677, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.17.255.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
I20260812 17:44:37.995091 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:40393
--webserver_interface=127.17.255.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:33257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:40393
--ranger_config_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.255.20:42833/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:44:38.128156 4867 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:44:38.128474 4867 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:44:38.128517 4867 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:44:38.132882 4867 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:44:38.132959 4867 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:44:38.132978 4867 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:44:38.132997 4867 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:44:38.133011 4867 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:44:38.139083 4867 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:33257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/master-0/wal
--ranger_kms_url=127.17.255.20:42833/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:40393
--ranger_config_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:40393
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4867
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:44:38.140376 4867 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:44:38.141583 4867 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:44:38.151208 4878 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:44:38.151222 4873 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:44:38.151208 4875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:44:38.151847 4867 server_base.cc:1034] running on GCE node
I20260812 17:44:38.152602 4867 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:44:38.154105 4867 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:44:38.155305 4867 hybrid_clock.cc:648] HybridClock initialized: now 1786556678155259 us; error 55 us; skew 500 ppm
Aug 12 17:44:38 dist-test-slave-tk9z krb5kdc[4105](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556678, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:44:38.163831 4867 init.cc:377] Logged in from keytab as kudu/127.17.255.62@KRBTEST.COM (short username kudu)
I20260812 17:44:38.165052 4867 webserver.cc:460] Webserver started at http://127.17.255.62:42973/ using document root <none> and password file <none>
I20260812 17:44:38.165680 4867 fs_manager.cc:359] Metadata directory not provided
I20260812 17:44:38.165766 4867 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:44:38.166015 4867 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 17:44:38 dist-test-slave-tk9z krb5kdc[4105](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556678, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for HTTP/127.17.255.20@KRBTEST.COM
I20260812 17:44:38.217368 4867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "95d3077da55f44c6be7c115d3719e923"
format_stamp: "Formatted at 2026-08-12 17:44:38 on dist-test-slave-tk9z"
server_key: "62fea47c8e299b46f1088c96135783f1"
server_key_iv: "5d25aa2d884ef20ef7ade3746a83efae"
server_key_version: "kuduclusterkey@0"
I20260812 17:44:38.218149 4867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "95d3077da55f44c6be7c115d3719e923"
format_stamp: "Formatted at 2026-08-12 17:44:38 on dist-test-slave-tk9z"
server_key: "62fea47c8e299b46f1088c96135783f1"
server_key_iv: "5d25aa2d884ef20ef7ade3746a83efae"
server_key_version: "kuduclusterkey@0"
I20260812 17:44:38.223551 4867 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260812 17:44:38.243501 4887 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:44:38.245124 4867 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260812 17:44:38.245282 4867 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "95d3077da55f44c6be7c115d3719e923"
format_stamp: "Formatted at 2026-08-12 17:44:38 on dist-test-slave-tk9z"
server_key: "62fea47c8e299b46f1088c96135783f1"
server_key_iv: "5d25aa2d884ef20ef7ade3746a83efae"
server_key_version: "kuduclusterkey@0"
I20260812 17:44:38.245438 4867 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:44:38.285593 4867 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:44:38.288945 4867 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:44:38.289166 4867 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:44:38.298672 4867 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:40393
I20260812 17:44:38.298702 4962 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:40393 every 8 connection(s)
I20260812 17:44:38.299790 4867 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:44:38.302942 4963 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:44:38.305670 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 4867
I20260812 17:44:38.305809 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:44:38.306139 18428 external_mini_cluster.cc:1428] Setting key 48d48e56a403b16cdb22a6bc397da9db
I20260812 17:44:38.310274 4963 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95d3077da55f44c6be7c115d3719e923: Bootstrap starting.
I20260812 17:44:38.313220 4963 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 95d3077da55f44c6be7c115d3719e923: Neither blocks nor log segments found. Creating new log.
I20260812 17:44:38.314273 4963 log.cc:824] T 00000000000000000000000000000000 P 95d3077da55f44c6be7c115d3719e923: Log is configured to *not* fsync() on all Append() calls
I20260812 17:44:38.316718 4963 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95d3077da55f44c6be7c115d3719e923: No bootstrap required, opened a new log
Aug 12 17:44:38 dist-test-slave-tk9z krb5kdc[4105](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556677, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:44:38.320828 4963 raft_consensus.cc:348] T 00000000000000000000000000000000 P 95d3077da55f44c6be7c115d3719e923 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95d3077da55f44c6be7c115d3719e923" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40393 } }
I20260812 17:44:38.321203 4963 raft_consensus.cc:374] T 00000000000000000000000000000000 P 95d3077da55f44c6be7c115d3719e923 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:44:38.321316 4963 raft_consensus.cc:729] T 00000000000000000000000000000000 P 95d3077da55f44c6be7c115d3719e923 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95d3077da55f44c6be7c115d3719e923, State: Initialized, Role: FOLLOWER
I20260812 17:44:38.322000 4963 consensus_queue.cc:260] T 00000000000000000000000000000000 P 95d3077da55f44c6be7c115d3719e923 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95d3077da55f44c6be7c115d3719e923" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40393 } }
I20260812 17:44:38.322175 4963 raft_consensus.cc:388] T 00000000000000000000000000000000 P 95d3077da55f44c6be7c115d3719e923 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:44:38.322280 4963 raft_consensus.cc:482] T 00000000000000000000000000000000 P 95d3077da55f44c6be7c115d3719e923 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:44:38.322430 4963 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 95d3077da55f44c6be7c115d3719e923 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:44:38.323618 4963 raft_consensus.cc:504] T 00000000000000000000000000000000 P 95d3077da55f44c6be7c115d3719e923 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95d3077da55f44c6be7c115d3719e923" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40393 } }
I20260812 17:44:38.324024 4963 leader_election.cc:302] T 00000000000000000000000000000000 P 95d3077da55f44c6be7c115d3719e923 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 95d3077da55f44c6be7c115d3719e923; no voters:
I20260812 17:44:38.324391 4963 leader_election.cc:288] T 00000000000000000000000000000000 P 95d3077da55f44c6be7c115d3719e923 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:44:38.325866 4963 sys_catalog.cc:564] T 00000000000000000000000000000000 P 95d3077da55f44c6be7c115d3719e923 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:44:38.326007 4966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:44:38.307733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59358 (local address 127.17.255.62:40393)
0812 17:44:38.308249 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0812 17:44:38.308269 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0812 17:44:38.308314 (+ 45us) server_negotiation.cc:407] Connection header received
0812 17:44:38.309247 (+ 933us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:44:38.309275 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:44:38.309740 (+ 465us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:44:38.310131 (+ 391us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:44:38.311108 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:44:38.312636 (+ 1528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:44:38.313964 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:44:38.314749 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:44:38.314966 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:44:38.320268 (+ 5302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:44:38.320283 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:44:38.320304 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:44:38.320355 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:44:38.322605 (+ 2250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:44:38.323157 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:44:38.323163 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:44:38.323170 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:44:38.323336 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:44:38.323660 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:44:38.323664 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:44:38.323665 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:44:38.324254 (+ 589us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:44:38.324481 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0812 17:44:38.324749 (+ 268us) server_negotiation.cc:299] Negotiation successful
0812 17:44:38.325049 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":349,"thread_start_us":155,"threads_started":1}
I20260812 17:44:38.326864 4970 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 95d3077da55f44c6be7c115d3719e923 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:44:38.327138 4970 raft_consensus.cc:686] T 00000000000000000000000000000000 P 95d3077da55f44c6be7c115d3719e923 [term 1 LEADER]: Becoming Leader. State: Replica: 95d3077da55f44c6be7c115d3719e923, State: Running, Role: LEADER
I20260812 17:44:38.327548 4970 consensus_queue.cc:237] T 00000000000000000000000000000000 P 95d3077da55f44c6be7c115d3719e923 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95d3077da55f44c6be7c115d3719e923" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40393 } }
I20260812 17:44:38.329003 4971 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95d3077da55f44c6be7c115d3719e923 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "95d3077da55f44c6be7c115d3719e923" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95d3077da55f44c6be7c115d3719e923" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40393 } } }
I20260812 17:44:38.329211 4971 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95d3077da55f44c6be7c115d3719e923 [sys.catalog]: This master's current role is: LEADER
I20260812 17:44:38.329411 4963 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 17:44:38.329559 4978 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95d3077da55f44c6be7c115d3719e923 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 95d3077da55f44c6be7c115d3719e923. Latest consensus state: current_term: 1 leader_uuid: "95d3077da55f44c6be7c115d3719e923" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95d3077da55f44c6be7c115d3719e923" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40393 } } }
I20260812 17:44:38.329653 4978 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95d3077da55f44c6be7c115d3719e923 [sys.catalog]: This master's current role is: LEADER
I20260812 17:44:38.329962 4988 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:44:38.333437 4988 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:44:38.348354 4988 catalog_manager.cc:1347] Generated new cluster ID: ba79d56f47e641b79107a8e94f4fe763
I20260812 17:44:38.348441 4988 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:44:38.364133 4988 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:44:38.366811 4988 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:44:38.376645 4988 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 95d3077da55f44c6be7c115d3719e923: Generated new TSK 0
I20260812 17:44:38.377732 4988 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.255.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab.
Entry for principal kudu/127.17.255.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab.
I20260812 17:44:39.150414 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.255.20:42833/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.1:0
--local_ip_for_outbound_sockets=127.17.255.1
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:40393
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:33257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:44:39.340360 5038 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:44:39.340952 5038 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:44:39.341030 5038 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:44:39.348956 5038 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:44:39.349062 5038 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:44:39.349188 5038 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.1
I20260812 17:44:39.360085 5038 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:33257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.17.255.20:42833/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:40393
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5038
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.1
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:44:39.361945 5038 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:44:39.363658 5038 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:44:39.379421 5055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:44:39.379422 5052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:44:39.379421 5050 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:44:39.379969 5038 server_base.cc:1034] running on GCE node
I20260812 17:44:39.380515 5038 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:44:39.381234 5038 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:44:39.382484 5038 hybrid_clock.cc:648] HybridClock initialized: now 1786556679382433 us; error 72 us; skew 500 ppm
Aug 12 17:44:39 dist-test-slave-tk9z krb5kdc[4105](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556679, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:44:39.386140 5038 init.cc:377] Logged in from keytab as kudu/127.17.255.1@KRBTEST.COM (short username kudu)
I20260812 17:44:39.387221 5038 webserver.cc:460] Webserver started at http://127.17.255.1:46753/ using document root <none> and password file <none>
I20260812 17:44:39.387854 5038 fs_manager.cc:359] Metadata directory not provided
I20260812 17:44:39.387952 5038 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:44:39.388206 5038 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 17:44:39 dist-test-slave-tk9z krb5kdc[4105](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556679, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for HTTP/127.17.255.20@KRBTEST.COM
I20260812 17:44:39.409278 5038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-0/data/instance:
uuid: "67be618752b842e29df9001a80264339"
format_stamp: "Formatted at 2026-08-12 17:44:39 on dist-test-slave-tk9z"
server_key: "1dee3d5f9571cbfea7ee01b094bd18a2"
server_key_iv: "325851663e31c2323166ef36e6341ee5"
server_key_version: "kuduclusterkey@0"
I20260812 17:44:39.409992 5038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance:
uuid: "67be618752b842e29df9001a80264339"
format_stamp: "Formatted at 2026-08-12 17:44:39 on dist-test-slave-tk9z"
server_key: "1dee3d5f9571cbfea7ee01b094bd18a2"
server_key_iv: "325851663e31c2323166ef36e6341ee5"
server_key_version: "kuduclusterkey@0"
I20260812 17:44:39.414600 5038 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 17:44:39.448951 5069 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:44:39.451200 5038 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 17:44:39.451433 5038 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-0/wal
uuid: "67be618752b842e29df9001a80264339"
format_stamp: "Formatted at 2026-08-12 17:44:39 on dist-test-slave-tk9z"
server_key: "1dee3d5f9571cbfea7ee01b094bd18a2"
server_key_iv: "325851663e31c2323166ef36e6341ee5"
server_key_version: "kuduclusterkey@0"
I20260812 17:44:39.451675 5038 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:44:39.465059 5038 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:44:39.468277 5038 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:44:39.468506 5038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:44:39.469224 5038 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:44:39.470712 5038 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:44:39.470839 5038 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:44:39.470965 5038 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:44:39.471037 5038 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:44:39.488749 5038 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.1:37707
I20260812 17:44:39.489059 5259 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.1:37707 every 8 connection(s)
I20260812 17:44:39.490131 5038 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
I20260812 17:44:39.495085 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 5038
I20260812 17:44:39.495225 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance
I20260812 17:44:39.495585 18428 external_mini_cluster.cc:1428] Setting key 37c41775bf5be1d48dc42b9abe973288
Aug 12 17:44:39 dist-test-slave-tk9z krb5kdc[4105](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556679, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:44:39.509337 5265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:44:39.494277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:46859 (local address 127.17.255.62:40393)
0812 17:44:39.495526 (+ 1249us) server_negotiation.cc:206] Beginning negotiation
0812 17:44:39.495532 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:44:39.495546 (+ 14us) server_negotiation.cc:407] Connection header received
0812 17:44:39.495593 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:44:39.495596 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:44:39.495646 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:44:39.497394 (+ 1748us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:44:39.497513 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:44:39.498401 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:44:39.500100 (+ 1699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:44:39.500460 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:44:39.500585 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:44:39.504028 (+ 3443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:44:39.504033 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:44:39.504036 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:44:39.504064 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:44:39.506260 (+ 2196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:44:39.507003 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:44:39.507007 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:44:39.507024 (+ 17us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:44:39.507142 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:44:39.507680 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:44:39.507684 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:44:39.507686 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:44:39.507981 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:44:39.508076 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 17:44:39.508920 (+ 844us) server_negotiation.cc:299] Negotiation successful
0812 17:44:39.509096 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1164,"thread_start_us":109,"threads_started":1}
WARNING: no policy specified for kudu/127.17.255.2@KRBTEST.COM; defaulting to no policy
I20260812 17:44:39.511723 5264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:44:39.493086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40393 (local address 127.17.255.1:46859)
0812 17:44:39.493697 (+ 611us) negotiation.cc:107] Waiting for socket to connect
0812 17:44:39.493757 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0812 17:44:39.495059 (+ 1302us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:44:39.495996 (+ 937us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:44:39.496006 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:44:39.496388 (+ 382us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:44:39.497219 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:44:39.497242 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:44:39.498545 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:44:39.498548 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:44:39.499923 (+ 1375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:44:39.499935 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:44:39.500646 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:44:39.500650 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:44:39.500926 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:44:39.501711 (+ 785us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:44:39.501732 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:44:39.503802 (+ 2070us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:44:39.506424 (+ 2622us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:44:39.506433 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:44:39.506453 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:44:39.506876 (+ 423us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:44:39.507276 (+ 400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:44:39.507279 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:44:39.507281 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:44:39.507484 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:44:39.508170 (+ 686us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:44:39.508178 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:44:39.508522 (+ 344us) client_negotiation.cc:769] Sending connection context
0812 17:44:39.509900 (+ 1378us) client_negotiation.cc:240] Negotiation successful
0812 17:44:39.510327 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":145,"threads_started":1}
I20260812 17:44:39.513721 5260 heartbeater.cc:347] Connected to a master server at 127.17.255.62:40393
I20260812 17:44:39.514038 5260 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.2@KRBTEST.COM" created.
I20260812 17:44:39.514847 5260 heartbeater.cc:511] Master 127.17.255.62:40393 requested a full tablet report, sending...
I20260812 17:44:39.518575 4915 ts_manager.cc:194] Registered new tserver with Master: 67be618752b842e29df9001a80264339 (127.17.255.1:37707)
I20260812 17:44:39.520387 4915 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.1@KRBTEST.COM'} at 127.17.255.1:46859
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab.
Entry for principal kudu/127.17.255.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab.
I20260812 17:44:39.535815 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.255.20:42833/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.2:0
--local_ip_for_outbound_sockets=127.17.255.2
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:40393
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:33257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 17:44:39 dist-test-slave-tk9z krb5kdc[4105](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786556679, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260812 17:44:39.700922 5275 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:44:39.701277 5275 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:44:39.701391 5275 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:44:39.706450 5275 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:44:39.706571 5275 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:44:39.706687 5275 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.2
I20260812 17:44:39.713112 5275 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:33257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.17.255.20:42833/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:40393
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5275
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.2
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:44:39.714449 5275 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:44:39.715579 5275 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:44:39.727396 5285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:44:39.727321 5286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:44:39.728081 5290 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:44:39.729074 5275 server_base.cc:1034] running on GCE node
I20260812 17:44:39.729640 5275 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:44:39.730584 5275 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:44:39.731781 5275 hybrid_clock.cc:648] HybridClock initialized: now 1786556679731739 us; error 56 us; skew 500 ppm
Aug 12 17:44:39 dist-test-slave-tk9z krb5kdc[4105](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556679, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:44:39.735788 5275 init.cc:377] Logged in from keytab as kudu/127.17.255.2@KRBTEST.COM (short username kudu)
I20260812 17:44:39.736977 5275 webserver.cc:460] Webserver started at http://127.17.255.2:38329/ using document root <none> and password file <none>
I20260812 17:44:39.737753 5275 fs_manager.cc:359] Metadata directory not provided
I20260812 17:44:39.737862 5275 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:44:39.738170 5275 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 17:44:39 dist-test-slave-tk9z krb5kdc[4105](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556679, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for HTTP/127.17.255.20@KRBTEST.COM
I20260812 17:44:39.763671 5275 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-1/data/instance:
uuid: "4f03df7f1ece46ed962865ea233314a0"
format_stamp: "Formatted at 2026-08-12 17:44:39 on dist-test-slave-tk9z"
server_key: "bc75337b74ed3c8a5f7aa459a2bc26c0"
server_key_iv: "837873741a81053608fb7d37c1e9c729"
server_key_version: "kuduclusterkey@0"
I20260812 17:44:39.764664 5275 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance:
uuid: "4f03df7f1ece46ed962865ea233314a0"
format_stamp: "Formatted at 2026-08-12 17:44:39 on dist-test-slave-tk9z"
server_key: "bc75337b74ed3c8a5f7aa459a2bc26c0"
server_key_iv: "837873741a81053608fb7d37c1e9c729"
server_key_version: "kuduclusterkey@0"
I20260812 17:44:39.771020 5275 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260812 17:44:39.800371 5307 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:44:39.803042 5275 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.005s sys 0.000s
I20260812 17:44:39.803241 5275 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-1/wal
uuid: "4f03df7f1ece46ed962865ea233314a0"
format_stamp: "Formatted at 2026-08-12 17:44:39 on dist-test-slave-tk9z"
server_key: "bc75337b74ed3c8a5f7aa459a2bc26c0"
server_key_iv: "837873741a81053608fb7d37c1e9c729"
server_key_version: "kuduclusterkey@0"
I20260812 17:44:39.803435 5275 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:44:39.834641 5275 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:44:39.838943 5275 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:44:39.839215 5275 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:44:39.840051 5275 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:44:39.841365 5275 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:44:39.841490 5275 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:44:39.841583 5275 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:44:39.841635 5275 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:44:39.866395 5275 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.2:40533
I20260812 17:44:39.868263 5275 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
I20260812 17:44:39.871230 5500 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.2:40533 every 8 connection(s)
I20260812 17:44:39.877894 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 5275
I20260812 17:44:39.878057 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance
I20260812 17:44:39.878494 18428 external_mini_cluster.cc:1428] Setting key 965f19515ec716a075508e7388960cea
Aug 12 17:44:39 dist-test-slave-tk9z krb5kdc[4105](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556679, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:44:39.893748 5265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:44:39.874682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:49251 (local address 127.17.255.62:40393)
0812 17:44:39.874883 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0812 17:44:39.874889 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:44:39.877571 (+ 2682us) server_negotiation.cc:407] Connection header received
0812 17:44:39.879470 (+ 1899us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:44:39.879475 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:44:39.879535 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:44:39.879597 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:44:39.882127 (+ 2530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:44:39.883172 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:44:39.885005 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:44:39.885419 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:44:39.885504 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:44:39.889197 (+ 3693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:44:39.889201 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:44:39.889204 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:44:39.889235 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:44:39.891084 (+ 1849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:44:39.891762 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:44:39.891765 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:44:39.891767 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:44:39.891861 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:44:39.892293 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:44:39.892296 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:44:39.892298 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:44:39.892532 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:44:39.892610 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 17:44:39.893422 (+ 812us) server_negotiation.cc:299] Negotiation successful
0812 17:44:39.893568 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 17:44:39.895905 5506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:44:39.875616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40393 (local address 127.17.255.2:49251)
0812 17:44:39.877358 (+ 1742us) negotiation.cc:107] Waiting for socket to connect
0812 17:44:39.877430 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0812 17:44:39.879174 (+ 1744us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:44:39.880570 (+ 1396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:44:39.880580 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:44:39.881107 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:44:39.881937 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:44:39.881963 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:44:39.883369 (+ 1406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:44:39.883372 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:44:39.884852 (+ 1480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:44:39.884864 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:44:39.885734 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:44:39.885738 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:44:39.885971 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:44:39.886927 (+ 956us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:44:39.886950 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:44:39.888972 (+ 2022us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:44:39.891250 (+ 2278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:44:39.891255 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:44:39.891283 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:44:39.891638 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:44:39.891977 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:44:39.891979 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:44:39.891981 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:44:39.892166 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:44:39.892700 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:44:39.892707 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:44:39.893056 (+ 349us) client_negotiation.cc:769] Sending connection context
0812 17:44:39.894274 (+ 1218us) client_negotiation.cc:240] Negotiation successful
0812 17:44:39.894687 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1431,"thread_start_us":251,"threads_started":1}
I20260812 17:44:39.901976 5503 heartbeater.cc:347] Connected to a master server at 127.17.255.62:40393
I20260812 17:44:39.902293 5503 heartbeater.cc:464] Registering TS with master...
I20260812 17:44:39.902997 5503 heartbeater.cc:511] Master 127.17.255.62:40393 requested a full tablet report, sending...
I20260812 17:44:39.904455 4915 ts_manager.cc:194] Registered new tserver with Master: 4f03df7f1ece46ed962865ea233314a0 (127.17.255.2:40533)
I20260812 17:44:39.905258 4915 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.2@KRBTEST.COM'} at 127.17.255.2:49251
WARNING: no policy specified for kudu/127.17.255.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab.
Entry for principal kudu/127.17.255.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab.
I20260812 17:44:39.945698 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.255.20:42833/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.3:0
--local_ip_for_outbound_sockets=127.17.255.3
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:40393
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:33257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:44:40.209232 5509 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:44:40.209910 5509 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:44:40.210089 5509 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:44:40.217825 5509 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:44:40.217936 5509 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:44:40.218053 5509 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.3
I20260812 17:44:40.229763 5509 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:33257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.17.255.20:42833/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:40393
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5509
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.3
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:44:40.231796 5509 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:44:40.233554 5509 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:44:40.251148 5521 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:44:40.251616 5517 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:44:40.253103 5509 server_base.cc:1034] running on GCE node
W20260812 17:44:40.255189 5514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:44:40.255911 5509 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:44:40.256791 5509 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
Aug 12 17:44:40 dist-test-slave-tk9z krb5kdc[4105](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556679, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for HTTP/127.17.255.20@KRBTEST.COM
I20260812 17:44:40.288434 5509 hybrid_clock.cc:648] HybridClock initialized: now 1786556680288335 us; error 112 us; skew 500 ppm
Aug 12 17:44:40 dist-test-slave-tk9z krb5kdc[4105](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556680, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:44:40.293594 5509 init.cc:377] Logged in from keytab as kudu/127.17.255.3@KRBTEST.COM (short username kudu)
I20260812 17:44:40.295588 5509 webserver.cc:460] Webserver started at http://127.17.255.3:37453/ using document root <none> and password file <none>
I20260812 17:44:40.296547 5509 fs_manager.cc:359] Metadata directory not provided
I20260812 17:44:40.296737 5509 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:44:40.297088 5509 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 17:44:40 dist-test-slave-tk9z krb5kdc[4105](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556680, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for HTTP/127.17.255.20@KRBTEST.COM
I20260812 17:44:40.317804 5509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-2/data/instance:
uuid: "9ac07feccebe4a9595d16c3c85440684"
format_stamp: "Formatted at 2026-08-12 17:44:40 on dist-test-slave-tk9z"
server_key: "7edd403ce0be921fecc816b133b32df1"
server_key_iv: "33c6396ff3a7c3d7c9e03c66c531d0b5"
server_key_version: "kuduclusterkey@0"
I20260812 17:44:40.318904 5509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance:
uuid: "9ac07feccebe4a9595d16c3c85440684"
format_stamp: "Formatted at 2026-08-12 17:44:40 on dist-test-slave-tk9z"
server_key: "7edd403ce0be921fecc816b133b32df1"
server_key_iv: "33c6396ff3a7c3d7c9e03c66c531d0b5"
server_key_version: "kuduclusterkey@0"
I20260812 17:44:40.335482 5509 fs_manager.cc:691] Time spent creating directory manager: real 0.016s user 0.001s sys 0.004s
I20260812 17:44:40.360150 5532 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:44:40.362088 5509 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.001s sys 0.000s
I20260812 17:44:40.362255 5509 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-2/wal
uuid: "9ac07feccebe4a9595d16c3c85440684"
format_stamp: "Formatted at 2026-08-12 17:44:40 on dist-test-slave-tk9z"
server_key: "7edd403ce0be921fecc816b133b32df1"
server_key_iv: "33c6396ff3a7c3d7c9e03c66c531d0b5"
server_key_version: "kuduclusterkey@0"
I20260812 17:44:40.362453 5509 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:44:40.383745 5509 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:44:40.388345 5509 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:44:40.388634 5509 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:44:40.389528 5509 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:44:40.390930 5509 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:44:40.391045 5509 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:44:40.391148 5509 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:44:40.391213 5509 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:44:40.413887 5509 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.3:40403
I20260812 17:44:40.416947 5509 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
I20260812 17:44:40.419239 5735 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.3:40403 every 8 connection(s)
I20260812 17:44:40.426549 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 5509
I20260812 17:44:40.426693 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance
I20260812 17:44:40.427050 18428 external_mini_cluster.cc:1428] Setting key 54f76a16ca94b835c6e23c9b199907db
Aug 12 17:44:40 dist-test-slave-tk9z krb5kdc[4105](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556680, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:44:40.436998 5739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:44:40.420182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:56601 (local address 127.17.255.62:40393)
0812 17:44:40.420520 (+ 338us) server_negotiation.cc:206] Beginning negotiation
0812 17:44:40.420525 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:44:40.421569 (+ 1044us) server_negotiation.cc:407] Connection header received
0812 17:44:40.423093 (+ 1524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:44:40.423097 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:44:40.423159 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:44:40.423225 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:44:40.425159 (+ 1934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:44:40.425955 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:44:40.428008 (+ 2053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:44:40.428346 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:44:40.428437 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:44:40.432203 (+ 3766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:44:40.432206 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:44:40.432209 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:44:40.432238 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:44:40.434228 (+ 1990us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:44:40.434973 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:44:40.434977 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:44:40.434979 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:44:40.435087 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:44:40.435567 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:44:40.435571 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:44:40.435572 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:44:40.435806 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:44:40.435890 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 17:44:40.436670 (+ 780us) server_negotiation.cc:299] Negotiation successful
0812 17:44:40.436818 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":257,"thread_start_us":145,"threads_started":1}
I20260812 17:44:40.439296 5740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:44:40.420733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40393 (local address 127.17.255.3:56601)
0812 17:44:40.421396 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0812 17:44:40.421452 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0812 17:44:40.422823 (+ 1371us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:44:40.423679 (+ 856us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:44:40.423688 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:44:40.424228 (+ 540us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:44:40.424977 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:44:40.424998 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:44:40.426135 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:44:40.426138 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:44:40.427861 (+ 1723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:44:40.427872 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:44:40.428672 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:44:40.428676 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:44:40.428968 (+ 292us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:44:40.429856 (+ 888us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:44:40.429878 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:44:40.431986 (+ 2108us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:44:40.434430 (+ 2444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:44:40.434437 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:44:40.434459 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:44:40.434843 (+ 384us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:44:40.435216 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:44:40.435219 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:44:40.435223 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:44:40.435449 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:44:40.435960 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:44:40.435968 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:44:40.436352 (+ 384us) client_negotiation.cc:769] Sending connection context
0812 17:44:40.437530 (+ 1178us) client_negotiation.cc:240] Negotiation successful
0812 17:44:40.437936 (+ 406us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":212,"threads_started":1}
I20260812 17:44:40.441337 5736 heartbeater.cc:347] Connected to a master server at 127.17.255.62:40393
I20260812 17:44:40.441607 5736 heartbeater.cc:464] Registering TS with master...
I20260812 17:44:40.442090 5736 heartbeater.cc:511] Master 127.17.255.62:40393 requested a full tablet report, sending...
I20260812 17:44:40.443171 4914 ts_manager.cc:194] Registered new tserver with Master: 9ac07feccebe4a9595d16c3c85440684 (127.17.255.3:40403)
I20260812 17:44:40.444007 4914 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.3@KRBTEST.COM'} at 127.17.255.3:56601
I20260812 17:44:40.453389 18428 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 17:44:40.473869 5739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:44:40.456216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59374 (local address 127.17.255.62:40393)
0812 17:44:40.456362 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0812 17:44:40.456368 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:44:40.457099 (+ 731us) server_negotiation.cc:407] Connection header received
0812 17:44:40.457294 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:44:40.457298 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:44:40.457393 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:44:40.457460 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:44:40.459379 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:44:40.460624 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:44:40.462976 (+ 2352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:44:40.463575 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:44:40.463732 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:44:40.467273 (+ 3541us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:44:40.467278 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:44:40.467281 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:44:40.467392 (+ 111us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:44:40.470189 (+ 2797us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:44:40.471214 (+ 1025us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:44:40.471219 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:44:40.471230 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:44:40.471368 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:44:40.471956 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:44:40.471975 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:44:40.471978 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:44:40.472425 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:44:40.472648 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0812 17:44:40.473280 (+ 632us) server_negotiation.cc:299] Negotiation successful
0812 17:44:40.473528 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 17:44:40.481119 4914 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59374:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 17:44:40.486654 4914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 17:44:40.514055 5759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:44:40.503050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:37707 (local address 127.0.0.1:36916)
0812 17:44:40.505596 (+ 2546us) negotiation.cc:107] Waiting for socket to connect
0812 17:44:40.505653 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 17:44:40.505791 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:44:40.507036 (+ 1245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:44:40.507043 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:44:40.507069 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:44:40.507333 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:44:40.507341 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:44:40.508986 (+ 1645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:44:40.508990 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:44:40.510795 (+ 1805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:44:40.510807 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:44:40.513510 (+ 2703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:44:40.513513 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:44:40.513637 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:44:40.513685 (+ 48us) client_negotiation.cc:769] Sending connection context
0812 17:44:40.513771 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 17:44:40.513892 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2275,"thread_start_us":207,"threads_started":1}
I20260812 17:44:40.514786 5765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:44:40.504705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36916 (local address 127.17.255.1:37707)
0812 17:44:40.506498 (+ 1793us) server_negotiation.cc:206] Beginning negotiation
0812 17:44:40.506506 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 17:44:40.506532 (+ 26us) server_negotiation.cc:407] Connection header received
0812 17:44:40.506614 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:44:40.506619 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:44:40.506843 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:44:40.507521 (+ 678us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:44:40.507671 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:44:40.508853 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:44:40.510963 (+ 2110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:44:40.511820 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:44:40.514287 (+ 2467us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:44:40.514487 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0812 17:44:40.514541 (+ 54us) server_negotiation.cc:299] Negotiation successful
0812 17:44:40.514651 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1679,"thread_start_us":155,"threads_started":1}
I20260812 17:44:40.518795 5154 tablet_service.cc:1467] Processing CreateTablet for tablet 4c14615b00fd43a7a4fe4230787db359 (DEFAULT_TABLE table=test-table [id=ddd8324a1ce44f84b453e13e66be9a7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:44:40.519681 5761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:44:40.504013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.3:40403 (local address 127.0.0.1:47936)
0812 17:44:40.512044 (+ 8031us) negotiation.cc:107] Waiting for socket to connect
0812 17:44:40.512058 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 17:44:40.512176 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:44:40.513218 (+ 1042us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:44:40.513221 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:44:40.513239 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:44:40.513348 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:44:40.513354 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:44:40.516475 (+ 3121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:44:40.516479 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:44:40.517782 (+ 1303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:44:40.517794 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:44:40.519236 (+ 1442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:44:40.519241 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:44:40.519348 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:44:40.519385 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 17:44:40.519458 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 17:44:40.519525 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7966,"thread_start_us":151,"threads_started":1}
I20260812 17:44:40.520133 5762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:44:40.504443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47936 (local address 127.17.255.3:40403)
0812 17:44:40.512500 (+ 8057us) server_negotiation.cc:206] Beginning negotiation
0812 17:44:40.512545 (+ 45us) server_negotiation.cc:399] Waiting for connection header
0812 17:44:40.512571 (+ 26us) server_negotiation.cc:407] Connection header received
0812 17:44:40.512652 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:44:40.512658 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:44:40.512879 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:44:40.513063 (+ 184us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:44:40.514987 (+ 1924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:44:40.516319 (+ 1332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:44:40.518036 (+ 1717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:44:40.518910 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:44:40.519019 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:44:40.519163 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0812 17:44:40.519871 (+ 708us) server_negotiation.cc:299] Negotiation successful
0812 17:44:40.519981 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7940,"thread_start_us":222,"threads_started":1}
I20260812 17:44:40.520617 5154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c14615b00fd43a7a4fe4230787db359. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:44:40.523335 5617 tablet_service.cc:1467] Processing CreateTablet for tablet 4c14615b00fd43a7a4fe4230787db359 (DEFAULT_TABLE table=test-table [id=ddd8324a1ce44f84b453e13e66be9a7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:44:40.523770 5760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:44:40.503402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:40533 (local address 127.0.0.1:49670)
0812 17:44:40.506094 (+ 2692us) negotiation.cc:107] Waiting for socket to connect
0812 17:44:40.506107 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 17:44:40.506213 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:44:40.519115 (+ 12902us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:44:40.519119 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:44:40.519137 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:44:40.519231 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:44:40.519237 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:44:40.520868 (+ 1631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:44:40.520871 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:44:40.522047 (+ 1176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:44:40.522058 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:44:40.523290 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:44:40.523294 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:44:40.523433 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:44:40.523461 (+ 28us) client_negotiation.cc:769] Sending connection context
0812 17:44:40.523516 (+ 55us) client_negotiation.cc:240] Negotiation successful
0812 17:44:40.523587 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2631,"thread_start_us":155,"threads_started":1}
I20260812 17:44:40.524236 5260 heartbeater.cc:503] Master 127.17.255.62:40393 was elected leader, sending a full tablet report...
I20260812 17:44:40.524493 5617 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c14615b00fd43a7a4fe4230787db359. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:44:40.526887 5766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:44:40.504828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49670 (local address 127.17.255.2:40533)
0812 17:44:40.518602 (+ 13774us) server_negotiation.cc:206] Beginning negotiation
0812 17:44:40.518609 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 17:44:40.518636 (+ 27us) server_negotiation.cc:407] Connection header received
0812 17:44:40.518717 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:44:40.518722 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:44:40.518929 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:44:40.519431 (+ 502us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:44:40.519600 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:44:40.520732 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:44:40.522228 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:44:40.523141 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:44:40.526270 (+ 3129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:44:40.526480 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0812 17:44:40.526536 (+ 56us) server_negotiation.cc:299] Negotiation successful
0812 17:44:40.526699 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13658,"thread_start_us":187,"threads_started":1}
I20260812 17:44:40.530181 5362 tablet_service.cc:1467] Processing CreateTablet for tablet 4c14615b00fd43a7a4fe4230787db359 (DEFAULT_TABLE table=test-table [id=ddd8324a1ce44f84b453e13e66be9a7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:44:40.531401 5362 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c14615b00fd43a7a4fe4230787db359. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:44:40.532416 5767 tablet_bootstrap.cc:492] T 4c14615b00fd43a7a4fe4230787db359 P 67be618752b842e29df9001a80264339: Bootstrap starting.
I20260812 17:44:40.535733 5767 tablet_bootstrap.cc:654] T 4c14615b00fd43a7a4fe4230787db359 P 67be618752b842e29df9001a80264339: Neither blocks nor log segments found. Creating new log.
I20260812 17:44:40.537624 5767 log.cc:824] T 4c14615b00fd43a7a4fe4230787db359 P 67be618752b842e29df9001a80264339: Log is configured to *not* fsync() on all Append() calls
I20260812 17:44:40.541114 5767 tablet_bootstrap.cc:492] T 4c14615b00fd43a7a4fe4230787db359 P 67be618752b842e29df9001a80264339: No bootstrap required, opened a new log
I20260812 17:44:40.541428 5767 ts_tablet_manager.cc:1397] T 4c14615b00fd43a7a4fe4230787db359 P 67be618752b842e29df9001a80264339: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260812 17:44:40.544581 5771 tablet_bootstrap.cc:492] T 4c14615b00fd43a7a4fe4230787db359 P 4f03df7f1ece46ed962865ea233314a0: Bootstrap starting.
I20260812 17:44:40.545612 5768 tablet_bootstrap.cc:492] T 4c14615b00fd43a7a4fe4230787db359 P 9ac07feccebe4a9595d16c3c85440684: Bootstrap starting.
I20260812 17:44:40.548234 5767 raft_consensus.cc:348] T 4c14615b00fd43a7a4fe4230787db359 P 67be618752b842e29df9001a80264339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67be618752b842e29df9001a80264339" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 37707 } } peers { permanent_uuid: "9ac07feccebe4a9595d16c3c85440684" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 40403 } } peers { permanent_uuid: "4f03df7f1ece46ed962865ea233314a0" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 40533 } }
I20260812 17:44:40.548741 5767 raft_consensus.cc:374] T 4c14615b00fd43a7a4fe4230787db359 P 67be618752b842e29df9001a80264339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:44:40.548849 5767 raft_consensus.cc:729] T 4c14615b00fd43a7a4fe4230787db359 P 67be618752b842e29df9001a80264339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67be618752b842e29df9001a80264339, State: Initialized, Role: FOLLOWER
I20260812 17:44:40.549346 5771 tablet_bootstrap.cc:654] T 4c14615b00fd43a7a4fe4230787db359 P 4f03df7f1ece46ed962865ea233314a0: Neither blocks nor log segments found. Creating new log.
I20260812 17:44:40.549346 5768 tablet_bootstrap.cc:654] T 4c14615b00fd43a7a4fe4230787db359 P 9ac07feccebe4a9595d16c3c85440684: Neither blocks nor log segments found. Creating new log.
I20260812 17:44:40.549585 5767 consensus_queue.cc:260] T 4c14615b00fd43a7a4fe4230787db359 P 67be618752b842e29df9001a80264339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67be618752b842e29df9001a80264339" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 37707 } } peers { permanent_uuid: "9ac07feccebe4a9595d16c3c85440684" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 40403 } } peers { permanent_uuid: "4f03df7f1ece46ed962865ea233314a0" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 40533 } }
I20260812 17:44:40.550983 5771 log.cc:824] T 4c14615b00fd43a7a4fe4230787db359 P 4f03df7f1ece46ed962865ea233314a0: Log is configured to *not* fsync() on all Append() calls
I20260812 17:44:40.551072 5768 log.cc:824] T 4c14615b00fd43a7a4fe4230787db359 P 9ac07feccebe4a9595d16c3c85440684: Log is configured to *not* fsync() on all Append() calls
I20260812 17:44:40.551376 5767 ts_tablet_manager.cc:1428] T 4c14615b00fd43a7a4fe4230787db359 P 67be618752b842e29df9001a80264339: Time spent starting tablet: real 0.010s user 0.003s sys 0.006s
I20260812 17:44:40.555733 5768 tablet_bootstrap.cc:492] T 4c14615b00fd43a7a4fe4230787db359 P 9ac07feccebe4a9595d16c3c85440684: No bootstrap required, opened a new log
I20260812 17:44:40.556032 5768 ts_tablet_manager.cc:1397] T 4c14615b00fd43a7a4fe4230787db359 P 9ac07feccebe4a9595d16c3c85440684: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260812 17:44:40.561829 5771 tablet_bootstrap.cc:492] T 4c14615b00fd43a7a4fe4230787db359 P 4f03df7f1ece46ed962865ea233314a0: No bootstrap required, opened a new log
I20260812 17:44:40.562089 5771 ts_tablet_manager.cc:1397] T 4c14615b00fd43a7a4fe4230787db359 P 4f03df7f1ece46ed962865ea233314a0: Time spent bootstrapping tablet: real 0.018s user 0.009s sys 0.000s
I20260812 17:44:40.562099 5768 raft_consensus.cc:348] T 4c14615b00fd43a7a4fe4230787db359 P 9ac07feccebe4a9595d16c3c85440684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67be618752b842e29df9001a80264339" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 37707 } } peers { permanent_uuid: "9ac07feccebe4a9595d16c3c85440684" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 40403 } } peers { permanent_uuid: "4f03df7f1ece46ed962865ea233314a0" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 40533 } }
I20260812 17:44:40.562491 5768 raft_consensus.cc:374] T 4c14615b00fd43a7a4fe4230787db359 P 9ac07feccebe4a9595d16c3c85440684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:44:40.562613 5768 raft_consensus.cc:729] T 4c14615b00fd43a7a4fe4230787db359 P 9ac07feccebe4a9595d16c3c85440684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ac07feccebe4a9595d16c3c85440684, State: Initialized, Role: FOLLOWER
I20260812 17:44:40.563259 5768 consensus_queue.cc:260] T 4c14615b00fd43a7a4fe4230787db359 P 9ac07feccebe4a9595d16c3c85440684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67be618752b842e29df9001a80264339" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 37707 } } peers { permanent_uuid: "9ac07feccebe4a9595d16c3c85440684" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 40403 } } peers { permanent_uuid: "4f03df7f1ece46ed962865ea233314a0" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 40533 } }
I20260812 17:44:40.564543 5736 heartbeater.cc:503] Master 127.17.255.62:40393 was elected leader, sending a full tablet report...
I20260812 17:44:40.564597 5768 ts_tablet_manager.cc:1428] T 4c14615b00fd43a7a4fe4230787db359 P 9ac07feccebe4a9595d16c3c85440684: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260812 17:44:40.570207 5771 raft_consensus.cc:348] T 4c14615b00fd43a7a4fe4230787db359 P 4f03df7f1ece46ed962865ea233314a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67be618752b842e29df9001a80264339" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 37707 } } peers { permanent_uuid: "9ac07feccebe4a9595d16c3c85440684" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 40403 } } peers { permanent_uuid: "4f03df7f1ece46ed962865ea233314a0" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 40533 } }
I20260812 17:44:40.570588 5771 raft_consensus.cc:374] T 4c14615b00fd43a7a4fe4230787db359 P 4f03df7f1ece46ed962865ea233314a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:44:40.570642 5771 raft_consensus.cc:729] T 4c14615b00fd43a7a4fe4230787db359 P 4f03df7f1ece46ed962865ea233314a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f03df7f1ece46ed962865ea233314a0, State: Initialized, Role: FOLLOWER
I20260812 17:44:40.571280 5771 consensus_queue.cc:260] T 4c14615b00fd43a7a4fe4230787db359 P 4f03df7f1ece46ed962865ea233314a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67be618752b842e29df9001a80264339" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 37707 } } peers { permanent_uuid: "9ac07feccebe4a9595d16c3c85440684" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 40403 } } peers { permanent_uuid: "4f03df7f1ece46ed962865ea233314a0" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 40533 } }
I20260812 17:44:40.572381 5503 heartbeater.cc:503] Master 127.17.255.62:40393 was elected leader, sending a full tablet report...
I20260812 17:44:40.572679 5771 ts_tablet_manager.cc:1428] T 4c14615b00fd43a7a4fe4230787db359 P 4f03df7f1ece46ed962865ea233314a0: Time spent starting tablet: real 0.011s user 0.005s sys 0.003s
I20260812 17:44:40.618615 5772 raft_consensus.cc:482] T 4c14615b00fd43a7a4fe4230787db359 P 67be618752b842e29df9001a80264339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:44:40.618924 5772 raft_consensus.cc:504] T 4c14615b00fd43a7a4fe4230787db359 P 67be618752b842e29df9001a80264339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67be618752b842e29df9001a80264339" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 37707 } } peers { permanent_uuid: "9ac07feccebe4a9595d16c3c85440684" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 40403 } } peers { permanent_uuid: "4f03df7f1ece46ed962865ea233314a0" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 40533 } }
I20260812 17:44:40.620632 5772 leader_election.cc:288] T 4c14615b00fd43a7a4fe4230787db359 P 67be618752b842e29df9001a80264339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ac07feccebe4a9595d16c3c85440684 (127.17.255.3:40403), 4f03df7f1ece46ed962865ea233314a0 (127.17.255.2:40533)
W20260812 17:44:40.626864 5505 tablet.cc:2369] T 4c14615b00fd43a7a4fe4230787db359 P 4f03df7f1ece46ed962865ea233314a0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 17:44:40.628417 5762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:44:40.621626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:50993 (local address 127.17.255.3:40403)
0812 17:44:40.621796 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0812 17:44:40.621801 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:44:40.621817 (+ 16us) server_negotiation.cc:407] Connection header received
0812 17:44:40.621874 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:44:40.621877 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:44:40.621925 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:44:40.622000 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:44:40.622520 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:44:40.623311 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:44:40.626608 (+ 3297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:44:40.627293 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:44:40.627403 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:44:40.627463 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 17:44:40.628022 (+ 559us) server_negotiation.cc:299] Negotiation successful
0812 17:44:40.628119 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 17:44:40.629165 5779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:44:40.620882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.3:40403 (local address 127.17.255.1:50993)
0812 17:44:40.621442 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0812 17:44:40.621458 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 17:44:40.621584 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:44:40.622132 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:44:40.622136 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:44:40.622156 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:44:40.622353 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:44:40.622360 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:44:40.623581 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:44:40.623584 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:44:40.626438 (+ 2854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:44:40.626453 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:44:40.627672 (+ 1219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:44:40.627677 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:44:40.627847 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:44:40.627877 (+ 30us) client_negotiation.cc:769] Sending connection context
0812 17:44:40.628633 (+ 756us) client_negotiation.cc:240] Negotiation successful
0812 17:44:40.628738 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":203,"threads_started":1}
I20260812 17:44:40.630201 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c14615b00fd43a7a4fe4230787db359" candidate_uuid: "67be618752b842e29df9001a80264339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac07feccebe4a9595d16c3c85440684" is_pre_election: true
I20260812 17:44:40.630757 5661 raft_consensus.cc:2454] T 4c14615b00fd43a7a4fe4230787db359 P 9ac07feccebe4a9595d16c3c85440684 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67be618752b842e29df9001a80264339 in term 0.
I20260812 17:44:40.631776 5070 leader_election.cc:302] T 4c14615b00fd43a7a4fe4230787db359 P 67be618752b842e29df9001a80264339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67be618752b842e29df9001a80264339, 9ac07feccebe4a9595d16c3c85440684; no voters:
I20260812 17:44:40.632117 5766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:44:40.621967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:56121 (local address 127.17.255.2:40533)
0812 17:44:40.622117 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 17:44:40.622122 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:44:40.623141 (+ 1019us) server_negotiation.cc:407] Connection header received
0812 17:44:40.623336 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:44:40.623339 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:44:40.623387 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:44:40.623433 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:44:40.626974 (+ 3541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:44:40.627730 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:44:40.630332 (+ 2602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:44:40.631140 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:44:40.631258 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:44:40.631315 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 17:44:40.631862 (+ 547us) server_negotiation.cc:299] Negotiation successful
0812 17:44:40.631976 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 17:44:40.632361 5772 raft_consensus.cc:2781] T 4c14615b00fd43a7a4fe4230787db359 P 67be618752b842e29df9001a80264339 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 17:44:40.632488 5772 raft_consensus.cc:482] T 4c14615b00fd43a7a4fe4230787db359 P 67be618752b842e29df9001a80264339 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 17:44:40.632546 5772 raft_consensus.cc:3037] T 4c14615b00fd43a7a4fe4230787db359 P 67be618752b842e29df9001a80264339 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:44:40.633191 5781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:44:40.621225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:40533 (local address 127.17.255.1:56121)
0812 17:44:40.622318 (+ 1093us) negotiation.cc:107] Waiting for socket to connect
0812 17:44:40.622332 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 17:44:40.623219 (+ 887us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:44:40.623555 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:44:40.623558 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:44:40.623572 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:44:40.626752 (+ 3180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:44:40.626769 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:44:40.628002 (+ 1233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:44:40.628005 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:44:40.630110 (+ 2105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:44:40.630126 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:44:40.631463 (+ 1337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:44:40.631467 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:44:40.631656 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:44:40.631686 (+ 30us) client_negotiation.cc:769] Sending connection context
0812 17:44:40.632556 (+ 870us) client_negotiation.cc:240] Negotiation successful
0812 17:44:40.632752 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1027,"thread_start_us":172,"threads_started":1}
I20260812 17:44:40.634192 5392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c14615b00fd43a7a4fe4230787db359" candidate_uuid: "67be618752b842e29df9001a80264339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f03df7f1ece46ed962865ea233314a0" is_pre_election: true
I20260812 17:44:40.634665 5392 raft_consensus.cc:2454] T 4c14615b00fd43a7a4fe4230787db359 P 4f03df7f1ece46ed962865ea233314a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67be618752b842e29df9001a80264339 in term 0.
I20260812 17:44:40.635026 5772 raft_consensus.cc:504] T 4c14615b00fd43a7a4fe4230787db359 P 67be618752b842e29df9001a80264339 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67be618752b842e29df9001a80264339" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 37707 } } peers { permanent_uuid: "9ac07feccebe4a9595d16c3c85440684" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 40403 } } peers { permanent_uuid: "4f03df7f1ece46ed962865ea233314a0" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 40533 } }
I20260812 17:44:40.635895 5772 leader_election.cc:288] T 4c14615b00fd43a7a4fe4230787db359 P 67be618752b842e29df9001a80264339 [CANDIDATE]: Term 1 election: Requested vote from peers 9ac07feccebe4a9595d16c3c85440684 (127.17.255.3:40403), 4f03df7f1ece46ed962865ea233314a0 (127.17.255.2:40533)
I20260812 17:44:40.635878 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c14615b00fd43a7a4fe4230787db359" candidate_uuid: "67be618752b842e29df9001a80264339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac07feccebe4a9595d16c3c85440684"
I20260812 17:44:40.636036 5661 raft_consensus.cc:3037] T 4c14615b00fd43a7a4fe4230787db359 P 9ac07feccebe4a9595d16c3c85440684 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:44:40.636464 5392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c14615b00fd43a7a4fe4230787db359" candidate_uuid: "67be618752b842e29df9001a80264339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f03df7f1ece46ed962865ea233314a0"
I20260812 17:44:40.636610 5392 raft_consensus.cc:3037] T 4c14615b00fd43a7a4fe4230787db359 P 4f03df7f1ece46ed962865ea233314a0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:44:40.638183 5661 raft_consensus.cc:2454] T 4c14615b00fd43a7a4fe4230787db359 P 9ac07feccebe4a9595d16c3c85440684 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67be618752b842e29df9001a80264339 in term 1.
I20260812 17:44:40.638634 5070 leader_election.cc:302] T 4c14615b00fd43a7a4fe4230787db359 P 67be618752b842e29df9001a80264339 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67be618752b842e29df9001a80264339, 9ac07feccebe4a9595d16c3c85440684; no voters:
I20260812 17:44:40.638361 5392 raft_consensus.cc:2454] T 4c14615b00fd43a7a4fe4230787db359 P 4f03df7f1ece46ed962865ea233314a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67be618752b842e29df9001a80264339 in term 1.
I20260812 17:44:40.638877 5772 raft_consensus.cc:2781] T 4c14615b00fd43a7a4fe4230787db359 P 67be618752b842e29df9001a80264339 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:44:40.639151 5772 raft_consensus.cc:686] T 4c14615b00fd43a7a4fe4230787db359 P 67be618752b842e29df9001a80264339 [term 1 LEADER]: Becoming Leader. State: Replica: 67be618752b842e29df9001a80264339, State: Running, Role: LEADER
I20260812 17:44:40.639585 5772 consensus_queue.cc:237] T 4c14615b00fd43a7a4fe4230787db359 P 67be618752b842e29df9001a80264339 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67be618752b842e29df9001a80264339" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 37707 } } peers { permanent_uuid: "9ac07feccebe4a9595d16c3c85440684" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 40403 } } peers { permanent_uuid: "4f03df7f1ece46ed962865ea233314a0" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 40533 } }
I20260812 17:44:40.643863 4914 catalog_manager.cc:5495] T 4c14615b00fd43a7a4fe4230787db359 P 67be618752b842e29df9001a80264339 reported cstate change: term changed from 0 to 1, leader changed from <none> to 67be618752b842e29df9001a80264339 (127.17.255.1). New cstate: current_term: 1 leader_uuid: "67be618752b842e29df9001a80264339" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67be618752b842e29df9001a80264339" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 37707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ac07feccebe4a9595d16c3c85440684" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 40403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f03df7f1ece46ed962865ea233314a0" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 40533 } health_report { overall_health: UNKNOWN } } }
I20260812 17:44:40.668860 5765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:44:40.662115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36932 (local address 127.17.255.1:37707)
0812 17:44:40.662254 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0812 17:44:40.662259 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:44:40.662335 (+ 76us) server_negotiation.cc:407] Connection header received
0812 17:44:40.662617 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:44:40.662619 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:44:40.662686 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:44:40.662821 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:44:40.663232 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:44:40.664115 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:44:40.665788 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:44:40.666160 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:44:40.666288 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:44:40.666983 (+ 695us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:44:40.667717 (+ 734us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:44:40.667865 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0812 17:44:40.668569 (+ 704us) server_negotiation.cc:299] Negotiation successful
0812 17:44:40.668664 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
W20260812 17:44:40.673599 5737 tablet.cc:2369] T 4c14615b00fd43a7a4fe4230787db359 P 9ac07feccebe4a9595d16c3c85440684: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 17:44:40.680078 5661 raft_consensus.cc:1261] T 4c14615b00fd43a7a4fe4230787db359 P 9ac07feccebe4a9595d16c3c85440684 [term 1 FOLLOWER]: Refusing update from remote peer 67be618752b842e29df9001a80264339: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:44:40.680670 5392 raft_consensus.cc:1261] T 4c14615b00fd43a7a4fe4230787db359 P 4f03df7f1ece46ed962865ea233314a0 [term 1 FOLLOWER]: Refusing update from remote peer 67be618752b842e29df9001a80264339: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:44:40.681448 5782 consensus_queue.cc:1035] T 4c14615b00fd43a7a4fe4230787db359 P 67be618752b842e29df9001a80264339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ac07feccebe4a9595d16c3c85440684" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 40403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:44:40.682359 5782 consensus_queue.cc:1035] T 4c14615b00fd43a7a4fe4230787db359 P 67be618752b842e29df9001a80264339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f03df7f1ece46ed962865ea233314a0" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 40533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:44:40.693215 5786 mvcc.cc:205] Tried to move back new op lower bound from 7317736164054339584 to 7317736163903442944. Current Snapshot: MvccSnapshot[applied={T|T < 7317736164054339584}]
I20260812 17:44:40.699087 5789 mvcc.cc:205] Tried to move back new op lower bound from 7317736164054339584 to 7317736163903442944. Current Snapshot: MvccSnapshot[applied={T|T < 7317736164054339584}]
Aug 12 17:44:40 dist-test-slave-tk9z krb5kdc[4105](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556679, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for HTTP/127.17.255.20@KRBTEST.COM
I20260812 17:44:40.714648 4915 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59374:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:44:40.714845 4915 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59374:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:44:40.718287 4915 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 95d3077da55f44c6be7c115d3719e923: Sending DeleteTablet for 3 replicas of tablet 4c14615b00fd43a7a4fe4230787db359
I20260812 17:44:40.719383 5362 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c14615b00fd43a7a4fe4230787db359 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:44:40 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:49670
I20260812 17:44:40.719501 5617 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c14615b00fd43a7a4fe4230787db359 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:44:40 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:47936
I20260812 17:44:40.720446 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 5038
I20260812 17:44:40.720450 5154 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c14615b00fd43a7a4fe4230787db359 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:44:40 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:36916
I20260812 17:44:40.740120 5790 mvcc.cc:205] Tried to move back new op lower bound from 7317736164054339584 to 7317736163903442944. Current Snapshot: MvccSnapshot[applied={T|T < 7317736164054339584}]
I20260812 17:44:40.740640 5803 tablet_replica.cc:330] T 4c14615b00fd43a7a4fe4230787db359 P 4f03df7f1ece46ed962865ea233314a0: stopping tablet replica
I20260812 17:44:40.741135 5803 raft_consensus.cc:2229] T 4c14615b00fd43a7a4fe4230787db359 P 4f03df7f1ece46ed962865ea233314a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:44:40.741511 5803 raft_consensus.cc:2258] T 4c14615b00fd43a7a4fe4230787db359 P 4f03df7f1ece46ed962865ea233314a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:44:40.742097 5804 tablet_replica.cc:330] T 4c14615b00fd43a7a4fe4230787db359 P 9ac07feccebe4a9595d16c3c85440684: stopping tablet replica
I20260812 17:44:40.742579 5804 raft_consensus.cc:2229] T 4c14615b00fd43a7a4fe4230787db359 P 9ac07feccebe4a9595d16c3c85440684 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:44:40.742986 5804 raft_consensus.cc:2258] T 4c14615b00fd43a7a4fe4230787db359 P 9ac07feccebe4a9595d16c3c85440684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:44:40.745108 5804 ts_tablet_manager.cc:1905] T 4c14615b00fd43a7a4fe4230787db359 P 9ac07feccebe4a9595d16c3c85440684: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:44:40.748687 5804 ts_tablet_manager.cc:1918] T 4c14615b00fd43a7a4fe4230787db359 P 9ac07feccebe4a9595d16c3c85440684: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 17:44:40.748819 5804 log.cc:1196] T 4c14615b00fd43a7a4fe4230787db359 P 9ac07feccebe4a9595d16c3c85440684: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786556557564181-18428-0/minicluster-data/ts-2/wal/wals/4c14615b00fd43a7a4fe4230787db359
I20260812 17:44:40.749258 5804 ts_tablet_manager.cc:1939] T 4c14615b00fd43a7a4fe4230787db359 P 9ac07feccebe4a9595d16c3c85440684: Deleting consensus metadata
I20260812 17:44:40.751554 4888 catalog_manager.cc:4841] TS 9ac07feccebe4a9595d16c3c85440684 (127.17.255.3:40403): tablet 4c14615b00fd43a7a4fe4230787db359 (table test-table [id=ddd8324a1ce44f84b453e13e66be9a7d]) successfully deleted
W20260812 17:44:40.752636 5311 connection.cc:535] server connection from 127.17.255.1:56121 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 17:44:40.753278 4888 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.255.1:37707 (error 108)
I20260812 17:44:40.753614 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 5275
I20260812 17:44:40.764586 5760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:44:40.764203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:37707 (local address 127.0.0.1:36936)
0812 17:44:40.764355 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0812 17:44:40.764461 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.1:37707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260812 17:44:40.770608 4888 catalog_manager.cc:4584] TS 67be618752b842e29df9001a80264339 (127.17.255.1:37707): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4c14615b00fd43a7a4fe4230787db359: Network error: Client connection negotiation failed: client connection to 127.17.255.1:37707: connect: Connection refused (error 111)
I20260812 17:44:40.771636 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 5509
I20260812 17:44:40.779626 5760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:44:40.771897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:40533 (local address 127.0.0.1:49674)
0812 17:44:40.779385 (+ 7488us) negotiation.cc:107] Waiting for socket to connect
0812 17:44:40.779483 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.2:40533: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":7333}
I20260812 17:44:40.823362 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 4867
I20260812 17:44:40.854239 18428 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260812 17:44:41.205744 18428 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260812 17:44:41.205879 18428 mini_ranger.cc:66] Stopping Ranger...
I20260812 17:44:41.561928 18428 mini_ranger.cc:68] Stopped Ranger
2026-08-12 17:44:41.562 UTC [4159] LOG: received smart shutdown request
2026-08-12 17:44:41.566 UTC [4159] LOG: background worker "logical replication launcher" (PID 4176) exited with exit code 1
2026-08-12 17:44:41.566 UTC [4165] LOG: shutting down
2026-08-12 17:44:41.745 UTC [4159] LOG: database system is shut down
2026-08-12T17:44:41Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (51805 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:44:41 dist-test-slave-tk9z krb5kdc[5826](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:44:41 dist-test-slave-tk9z krb5kdc[5826](info): set up 2 sockets
Aug 12 17:44:41 dist-test-slave-tk9z krb5kdc[5826](info): commencing operation
krb5kdc: starting...
W20260812 17:44:43.228478 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.313s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:44:43 dist-test-slave-tk9z krb5kdc[5826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556683, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:44:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:44:43Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.17.255.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.17.255.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.17.255.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/rangeradmin_127.17.255.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.17.255.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/rangeradmin_127.17.255.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.17.255.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.17.255.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.17.255.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/rangerlookup_127.17.255.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.17.255.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/rangerlookup_127.17.255.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.17.255.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.17.255.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.17.255.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/HTTP_127.17.255.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.17.255.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/HTTP_127.17.255.20@KRBTEST.COM.keytab.
I20260812 17:44:43.437544 18428 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskHxSJQV/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/postgres -l logfile start
2026-08-12 17:44:46.290 UTC [5884] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-12 17:44:46.290 UTC [5884] LOG: listening on IPv4 address "127.17.255.20", port 48731
2026-08-12 17:44:46.295 UTC [5884] LOG: listening on Unix socket "/tmp/.s.PGSQL.48731"
2026-08-12 17:44:46.319 UTC [5887] LOG: database system was shut down at 2026-08-12 17:44:44 UTC
2026-08-12 17:44:46.324 UTC [5884] LOG: database system is ready to accept connections
I20260812 17:44:47.605029 18428 mini_postgres.cc:96] Postgres bound to 48731
2026-08-12 17:44:47.612 UTC [5899] FATAL: database "slave" does not exist
127.17.255.20:48731 - accepting connections
I20260812 17:44:47.613427 18428 mini_ranger.cc:161] Starting Ranger...
I20260812 17:44:47.629456 18428 mini_ranger.cc:84] Created miniranger Postgres user
I20260812 17:44:48.168530 18428 mini_ranger.cc:87] Created ranger Postgres database
I20260812 17:44:48.168625 18428 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ranger-admin
2026-08-12 17:44:48,452 [I] DB FLAVOR :POSTGRES
2026-08-12 17:44:48,453 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 17:44:48,453 [I] Checking connection..
2026-08-12 17:44:48,453 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:48731/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-12 17:44:48,722 [I] Checking connection passed.
2026-08-12 17:44:48,722 [I] --------- Verifying version history table ---------
2026-08-12 17:44:48,722 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:48731/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 17:44:48,996 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 17:44:48,996 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:48731/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 17:44:49,288 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 17:44:49,288 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-12 17:44:49,288 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:48731/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-12 17:44:49.527 UTC [6014] WARNING: there is no transaction in progress
2026-08-12 17:44:49,537 [I] create_dbversion_catalog.sql file imported successfully
2026-08-12 17:44:49,537 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:48731/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 17:44:49,810 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-12 17:44:49,810 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 17:44:49,811 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:48731/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-12 17:44:50,076 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:48731/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-12 17:44:50,356 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:48731/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-tk9z.c.gcp-upstream.internal','N') ;"
2026-08-12 17:44:50,592 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:48731/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 17:44:50,855 [I] Table x_portal_user does not exist in database ranger
2026-08-12 17:44:50,856 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:48731/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 17:44:51,104 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-12 17:44:51,105 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:48731/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 17:44:51,358 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:48731/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 17:44:51,615 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-12 17:44:51,615 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:48731/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-12 17:44:52.687 UTC [6205] WARNING: there is no transaction in progress
2026-08-12 17:44:52.704 UTC [6205] WARNING: there is no transaction in progress
2026-08-12 17:44:52.720 UTC [6205] WARNING: there is no transaction in progress
2026-08-12 17:44:52.738 UTC [6205] WARNING: there is no transaction in progress
2026-08-12 17:44:52.758 UTC [6205] WARNING: there is no transaction in progress
2026-08-12 17:44:52.777 UTC [6205] WARNING: there is no transaction in progress
2026-08-12 17:44:52.837 UTC [6205] WARNING: there is no transaction in progress
2026-08-12 17:44:52.845 UTC [6205] WARNING: there is no transaction in progress
2026-08-12 17:44:52.861 UTC [6205] WARNING: there is no transaction in progress
2026-08-12 17:44:52.873 UTC [6205] WARNING: there is no transaction in progress
2026-08-12 17:44:52.885 UTC [6205] WARNING: there is no transaction in progress
2026-08-12 17:44:52.901 UTC [6205] WARNING: there is no transaction in progress
2026-08-12 17:44:52.914 UTC [6205] WARNING: there is no transaction in progress
2026-08-12 17:44:52.920 UTC [6205] WARNING: there is no transaction in progress
2026-08-12 17:44:52.927 UTC [6205] WARNING: there is no transaction in progress
2026-08-12 17:44:52.935 UTC [6205] WARNING: there is no transaction in progress
2026-08-12 17:44:53,643 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-12 17:44:53,643 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:48731/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-12 17:44:53,913 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-12 17:44:53,913 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:48731/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 17:44:54,211 [I] Table x_portal_user already exists in database 'ranger'
2026-08-12 17:44:54,212 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:48731/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 17:44:54,485 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-12 17:44:54,486 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:48731/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 17:44:54,774 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:48731/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 17:44:55,026 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:48731/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-tk9z.c.gcp-upstream.internal';"
2026-08-12 17:44:55,301 [I] CORE_DB_SCHEMA import status has been updated
2026-08-12 17:44:55,301 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:48731/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-12 17:44:55,564 [I] DB_PATCHES have already been applied
I20260812 17:44:55.570443 18428 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ranger-admin:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskHxSJQV/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260812 17:44:55.570529 18428 mini_ranger.cc:193] Using host: 127.17.255.20
I20260812 17:44:55.574927 18428 mini_ranger.cc:227] Ranger admin URL: http://127.17.255.20:37603
Aug 12, 2026 5:44:55 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 5:44:55 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 5:44:56 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ranger-admin/ews/webapp
Aug 12, 2026 5:44:56 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 12, 2026 5:44:56 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 12, 2026 5:44:56 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ranger-admin/ews/webapp].
Aug 12, 2026 5:44:56 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260812 17:44:57.005445 18428 mini_ranger.cc:160] Time spent starting Ranger: real 9.392s user 0.000s sys 0.012s
Aug 12, 2026 5:45:18 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 12, 2026 5:45:18 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 12, 2026 5:45:18 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 12, 2026 5:45:18 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 12, 2026 5:45:19 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 12, 2026 5:45:19 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 12, 2026 5:45:19 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 12, 2026 5:45:19 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 12, 2026 5:45:19 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 12, 2026 5:45:19 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 12, 2026 5:45:19 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 12, 2026 5:45:19 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 12, 2026 5:45:19 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 12, 2026 5:45:19 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 12, 2026 5:45:19 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 12, 2026 5:45:19 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 12, 2026 5:45:19 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 12, 2026 5:45:19 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260812 17:45:20.563853 18428 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.17.255.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.17.255.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.17.255.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/rangerkms_127.17.255.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.17.255.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/rangerkms_127.17.255.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.17.255.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.17.255.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.17.255.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/HTTP_127.17.255.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.17.255.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/HTTP_127.17.255.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 12 17:45:20 dist-test-slave-tk9z krb5kdc[5826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556720, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260812 17:45:20.680811 18428 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260812 17:45:20.693475 18428 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260812 17:45:21.695621 18428 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260812 17:45:21.695725 18428 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ranger-kms
I20260812 17:45:21.695747 18428 mini_ranger_kms.cc:227] Using postgres at 127.17.255.20:48731
2026-08-12 17:45:21,889 [I] DB FLAVOR :POSTGRES
2026-08-12 17:45:21,889 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 17:45:21,889 [I] Checking connection
2026-08-12 17:45:21,889 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:48731/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-12 17:45:22,144 [I] connection success
2026-08-12 17:45:22,145 [I] --------- Verifying Ranger DB tables ---------
2026-08-12 17:45:22,145 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-12 17:45:22,145 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:48731/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-12 17:45:22,470 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-12 17:45:22,470 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 17:45:22,471 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-12 17:45:22,471 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.255.20:48731/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-12 17:45:22,785 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260812 17:45:23.273325 18428 mini_ranger_kms.cc:310] Created kms service
I20260812 17:45:23.486429 18428 mini_ranger_kms.cc:326] Created kudu user
I20260812 17:45:23.536594 18428 mini_ranger_kms.cc:343] Created rangerkms user
Aug 12 17:45:23 dist-test-slave-tk9z krb5kdc[5826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556720, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.17.255.20@KRBTEST.COM
I20260812 17:45:23.968909 18428 mini_ranger_kms.cc:384] Added ranger policy
I20260812 17:45:23.969110 18428 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ranger-kms:/tmp/dist-test-taskHxSJQV/build/debug/bin/postgresql.jar:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskHxSJQV/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260812 17:45:23.969135 18428 mini_ranger_kms.cc:240] Using host: 127.17.255.20
I20260812 17:45:23.974490 18428 mini_ranger_kms.cc:276] Ranger KMS PID: 6548
I20260812 17:45:23.974592 18428 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.17.255.20:57157
Aug 12, 2026 5:45:24 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 5:45:24 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 5:45:25 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 12, 2026 5:45:25 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 12, 2026 5:45:25 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ranger-kms/ews/webapp].
Aug 12, 2026 5:45:25 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 12 17:45:26 dist-test-slave-tk9z krb5kdc[5826](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786556726, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.255.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:45:26.888449 18428 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.208s user 0.004s sys 0.172s
I20260812 17:45:26.888599 18428 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260812 17:45:26.888677 18428 mini_ranger_kms.cc:401] 127.17.255.20:57157/kms/v1/keys
Aug 12 17:45:26 dist-test-slave-tk9z krb5kdc[5826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556726, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.255.20@KRBTEST.COM for HTTP/127.17.255.20@KRBTEST.COM
Aug 12 17:45:27 dist-test-slave-tk9z krb5kdc[5826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556726, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.255.20@KRBTEST.COM for HTTP/127.17.255.20@KRBTEST.COM
Aug 12 17:45:29 dist-test-slave-tk9z krb5kdc[5826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556729, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.17.255.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
I20260812 17:45:29.742978 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:39855
--webserver_interface=127.17.255.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:37959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:39855
--ranger_config_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.255.20:57157/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:45:29.863893 6658 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:45:29.864251 6658 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:45:29.864337 6658 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:45:29.868631 6658 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:45:29.868747 6658 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:45:29.868789 6658 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:45:29.868826 6658 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:45:29.868867 6658 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:45:29.875065 6658 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:37959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/master-0/wal
--ranger_kms_url=127.17.255.20:57157/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:39855
--ranger_config_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:39855
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6658
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:45:29.876315 6658 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:45:29.877507 6658 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:45:29.887341 6668 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:45:29.887364 6666 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:45:29.887619 6673 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:45:29.887616 6658 server_base.cc:1034] running on GCE node
I20260812 17:45:29.888381 6658 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:45:29.889575 6658 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:45:29.890760 6658 hybrid_clock.cc:648] HybridClock initialized: now 1786556729890710 us; error 75 us; skew 500 ppm
Aug 12 17:45:29 dist-test-slave-tk9z krb5kdc[5826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556729, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:45:29.899159 6658 init.cc:377] Logged in from keytab as kudu/127.17.255.62@KRBTEST.COM (short username kudu)
I20260812 17:45:29.900413 6658 webserver.cc:460] Webserver started at http://127.17.255.62:42735/ using document root <none> and password file <none>
I20260812 17:45:29.901104 6658 fs_manager.cc:359] Metadata directory not provided
I20260812 17:45:29.901172 6658 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:45:29.901437 6658 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 17:45:29 dist-test-slave-tk9z krb5kdc[5826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556729, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for HTTP/127.17.255.20@KRBTEST.COM
I20260812 17:45:29.966296 6658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "2ef48902e82b4e5abcbe7f3b9dcce81a"
format_stamp: "Formatted at 2026-08-12 17:45:29 on dist-test-slave-tk9z"
server_key: "26a41d4cdaa2fadbe0025d6141866310"
server_key_iv: "c4058e552f0d2b47d3cd013e7e2ec57b"
server_key_version: "kuduclusterkey@0"
I20260812 17:45:29.967032 6658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "2ef48902e82b4e5abcbe7f3b9dcce81a"
format_stamp: "Formatted at 2026-08-12 17:45:29 on dist-test-slave-tk9z"
server_key: "26a41d4cdaa2fadbe0025d6141866310"
server_key_iv: "c4058e552f0d2b47d3cd013e7e2ec57b"
server_key_version: "kuduclusterkey@0"
I20260812 17:45:29.971066 6658 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 17:45:29.988772 6687 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:29.990607 6658 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 17:45:29.990764 6658 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "2ef48902e82b4e5abcbe7f3b9dcce81a"
format_stamp: "Formatted at 2026-08-12 17:45:29 on dist-test-slave-tk9z"
server_key: "26a41d4cdaa2fadbe0025d6141866310"
server_key_iv: "c4058e552f0d2b47d3cd013e7e2ec57b"
server_key_version: "kuduclusterkey@0"
I20260812 17:45:29.990931 6658 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:45:30.011080 6658 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:45:30.014798 6658 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:45:30.015013 6658 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:45:30.024191 6658 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:39855
I20260812 17:45:30.024195 6765 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:39855 every 8 connection(s)
I20260812 17:45:30.025388 6658 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:45:30.028687 6766 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:45:30.033231 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 6658
I20260812 17:45:30.033368 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:45:30.033689 18428 external_mini_cluster.cc:1428] Setting key 0c8e3766f088d0f1ca28774b6bac493a
I20260812 17:45:30.035377 6766 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a: Bootstrap starting.
I20260812 17:45:30.038321 6766 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a: Neither blocks nor log segments found. Creating new log.
I20260812 17:45:30.039314 6766 log.cc:824] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a: Log is configured to *not* fsync() on all Append() calls
I20260812 17:45:30.041759 6766 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a: No bootstrap required, opened a new log
Aug 12 17:45:30 dist-test-slave-tk9z krb5kdc[5826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556729, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:45:30.046365 6766 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ef48902e82b4e5abcbe7f3b9dcce81a" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 39855 } }
I20260812 17:45:30.046703 6766 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:45:30.046792 6766 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ef48902e82b4e5abcbe7f3b9dcce81a, State: Initialized, Role: FOLLOWER
I20260812 17:45:30.047353 6766 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ef48902e82b4e5abcbe7f3b9dcce81a" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 39855 } }
I20260812 17:45:30.047521 6766 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:45:30.047613 6766 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:45:30.047716 6766 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:45:30.048880 6766 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ef48902e82b4e5abcbe7f3b9dcce81a" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 39855 } }
I20260812 17:45:30.049294 6766 leader_election.cc:302] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2ef48902e82b4e5abcbe7f3b9dcce81a; no voters:
I20260812 17:45:30.049674 6766 leader_election.cc:288] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:45:30.049789 6772 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:45:30.049798 6770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:30.035597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52840 (local address 127.17.255.62:39855)
0812 17:45:30.036219 (+ 622us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:30.036239 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:30.036281 (+ 42us) server_negotiation.cc:407] Connection header received
0812 17:45:30.037175 (+ 894us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:30.037199 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:30.037634 (+ 435us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:30.038014 (+ 380us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:45:30.038956 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:30.040379 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:30.041288 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:30.041773 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:30.041964 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:30.044653 (+ 2689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:45:30.044659 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:45:30.044674 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:45:30.044703 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:45:30.046455 (+ 1752us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:30.046985 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:30.046990 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:30.046996 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:30.047144 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:30.047453 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:30.047456 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:30.047458 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:30.047997 (+ 539us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:45:30.048213 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:30.048508 (+ 295us) server_negotiation.cc:299] Negotiation successful
0812 17:45:30.048820 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":152,"threads_started":1}
I20260812 17:45:30.050083 6772 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a [term 1 LEADER]: Becoming Leader. State: Replica: 2ef48902e82b4e5abcbe7f3b9dcce81a, State: Running, Role: LEADER
I20260812 17:45:30.050524 6772 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ef48902e82b4e5abcbe7f3b9dcce81a" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 39855 } }
I20260812 17:45:30.051153 6766 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:45:30.053427 6766 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 17:45:30.054226 6775 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2ef48902e82b4e5abcbe7f3b9dcce81a. Latest consensus state: current_term: 1 leader_uuid: "2ef48902e82b4e5abcbe7f3b9dcce81a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ef48902e82b4e5abcbe7f3b9dcce81a" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 39855 } } }
I20260812 17:45:30.054412 6775 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a [sys.catalog]: This master's current role is: LEADER
I20260812 17:45:30.054909 6778 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2ef48902e82b4e5abcbe7f3b9dcce81a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ef48902e82b4e5abcbe7f3b9dcce81a" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 39855 } } }
I20260812 17:45:30.054955 6801 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:45:30.057132 6778 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a [sys.catalog]: This master's current role is: LEADER
I20260812 17:45:30.061894 6801 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:45:30.072072 6801 catalog_manager.cc:1347] Generated new cluster ID: 305e8afbb155479eaa79d223a9fb30ec
I20260812 17:45:30.072149 6801 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:45:30.104092 6801 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:45:30.106621 6801 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:45:30.129303 6801 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a: Generated new TSK 0
I20260812 17:45:30.130445 6801 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.255.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab.
Entry for principal kudu/127.17.255.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab.
I20260812 17:45:30.883508 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.255.20:57157/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.1:0
--local_ip_for_outbound_sockets=127.17.255.1
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:39855
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:37959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:45:31.024740 6862 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:45:31.025187 6862 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:45:31.025295 6862 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:45:31.031567 6862 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:45:31.031742 6862 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:45:31.031884 6862 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.1
I20260812 17:45:31.039414 6862 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:37959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.17.255.20:57157/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:39855
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6862
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.1
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:45:31.040864 6862 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:45:31.042239 6862 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:45:31.054908 6875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:45:31.054895 6872 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:45:31.054895 6881 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:45:31.055128 6862 server_base.cc:1034] running on GCE node
I20260812 17:45:31.055908 6862 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:45:31.056802 6862 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:45:31.058025 6862 hybrid_clock.cc:648] HybridClock initialized: now 1786556731057982 us; error 54 us; skew 500 ppm
Aug 12 17:45:31 dist-test-slave-tk9z krb5kdc[5826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556731, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:45:31.061723 6862 init.cc:377] Logged in from keytab as kudu/127.17.255.1@KRBTEST.COM (short username kudu)
I20260812 17:45:31.062870 6862 webserver.cc:460] Webserver started at http://127.17.255.1:42167/ using document root <none> and password file <none>
I20260812 17:45:31.063503 6862 fs_manager.cc:359] Metadata directory not provided
I20260812 17:45:31.063601 6862 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:45:31.063854 6862 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 17:45:31 dist-test-slave-tk9z krb5kdc[5826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556731, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for HTTP/127.17.255.20@KRBTEST.COM
I20260812 17:45:31.088712 6862 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-0/data/instance:
uuid: "b14eb3a1e02e4c89b0538d0fe446adbf"
format_stamp: "Formatted at 2026-08-12 17:45:31 on dist-test-slave-tk9z"
server_key: "50942658325944efda58d95c9169b60f"
server_key_iv: "881b6e8f7cbb8814f04c0dcb90882b40"
server_key_version: "kuduclusterkey@0"
I20260812 17:45:31.089507 6862 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance:
uuid: "b14eb3a1e02e4c89b0538d0fe446adbf"
format_stamp: "Formatted at 2026-08-12 17:45:31 on dist-test-slave-tk9z"
server_key: "50942658325944efda58d95c9169b60f"
server_key_iv: "881b6e8f7cbb8814f04c0dcb90882b40"
server_key_version: "kuduclusterkey@0"
I20260812 17:45:31.095489 6862 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260812 17:45:31.114079 6897 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:31.115684 6862 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 17:45:31.115854 6862 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-0/wal
uuid: "b14eb3a1e02e4c89b0538d0fe446adbf"
format_stamp: "Formatted at 2026-08-12 17:45:31 on dist-test-slave-tk9z"
server_key: "50942658325944efda58d95c9169b60f"
server_key_iv: "881b6e8f7cbb8814f04c0dcb90882b40"
server_key_version: "kuduclusterkey@0"
I20260812 17:45:31.116024 6862 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:45:31.157450 6862 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:45:31.161505 6862 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:45:31.161798 6862 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:45:31.162705 6862 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:45:31.163931 6862 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:45:31.164045 6862 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:31.164183 6862 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:45:31.164276 6862 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:31.177870 6862 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.1:43911
I20260812 17:45:31.179294 6862 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
I20260812 17:45:31.181005 7125 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.1:43911 every 8 connection(s)
I20260812 17:45:31.184535 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 6862
I20260812 17:45:31.184666 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance
I20260812 17:45:31.184985 18428 external_mini_cluster.cc:1428] Setting key 7abe0c7218736ec5f072f376bb439c25
Aug 12 17:45:31 dist-test-slave-tk9z krb5kdc[5826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556731, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:45:31.207288 7134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:31.183487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:43093 (local address 127.17.255.62:39855)
0812 17:45:31.183948 (+ 461us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:31.183955 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:31.189534 (+ 5579us) server_negotiation.cc:407] Connection header received
0812 17:45:31.190983 (+ 1449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:31.190987 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:31.191051 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:31.191120 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:45:31.194858 (+ 3738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:31.195832 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:31.198029 (+ 2197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:31.198421 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:31.198540 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:31.202160 (+ 3620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:45:31.202164 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:45:31.202168 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:45:31.202201 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:45:31.204345 (+ 2144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:31.205109 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:31.205113 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:31.205115 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:31.205219 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:31.205717 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:31.205721 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:31.205723 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:31.205986 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:45:31.206067 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:31.206926 (+ 859us) server_negotiation.cc:299] Negotiation successful
0812 17:45:31.207086 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":148,"threads_started":1}
WARNING: no policy specified for kudu/127.17.255.2@KRBTEST.COM; defaulting to no policy
I20260812 17:45:31.209412 7136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:31.185313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:39855 (local address 127.17.255.1:43093)
0812 17:45:31.189321 (+ 4008us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:31.189400 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0812 17:45:31.190680 (+ 1280us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:45:31.191615 (+ 935us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:45:31.191625 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:45:31.192045 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:45:31.192807 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:31.192830 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:31.196027 (+ 3197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:31.196031 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:31.197853 (+ 1822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:31.197869 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:31.198838 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:31.198842 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:31.199074 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:31.199879 (+ 805us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:45:31.199905 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:45:31.201918 (+ 2013us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:45:31.204527 (+ 2609us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:31.204535 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:31.204558 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:31.204971 (+ 413us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:31.205352 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:31.205355 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:31.205357 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:31.205590 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:31.206162 (+ 572us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:45:31.206169 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:45:31.206601 (+ 432us) client_negotiation.cc:769] Sending connection context
0812 17:45:31.207813 (+ 1212us) client_negotiation.cc:240] Negotiation successful
0812 17:45:31.208209 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3710,"thread_start_us":163,"threads_started":1}
I20260812 17:45:31.211362 7128 heartbeater.cc:347] Connected to a master server at 127.17.255.62:39855
I20260812 17:45:31.212021 7128 heartbeater.cc:464] Registering TS with master...
I20260812 17:45:31.212707 7128 heartbeater.cc:511] Master 127.17.255.62:39855 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.2@KRBTEST.COM" created.
I20260812 17:45:31.214828 6715 ts_manager.cc:194] Registered new tserver with Master: b14eb3a1e02e4c89b0538d0fe446adbf (127.17.255.1:43911)
I20260812 17:45:31.216473 6715 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.1@KRBTEST.COM'} at 127.17.255.1:43093
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab.
Entry for principal kudu/127.17.255.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab.
I20260812 17:45:31.241822 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.255.20:57157/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.2:0
--local_ip_for_outbound_sockets=127.17.255.2
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:39855
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:37959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 17:45:31 dist-test-slave-tk9z krb5kdc[5826](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786556731, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260812 17:45:31.417243 7142 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:45:31.417565 7142 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:45:31.417611 7142 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:45:31.423270 7142 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:45:31.423375 7142 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:45:31.423470 7142 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.2
I20260812 17:45:31.432389 7142 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:37959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.17.255.20:57157/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:39855
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7142
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.2
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:45:31.434141 7142 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:45:31.435683 7142 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:45:31.449975 7157 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:45:31.451004 7162 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:45:31.451316 7154 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:45:31.452723 7142 server_base.cc:1034] running on GCE node
I20260812 17:45:31.453344 7142 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:45:31.454291 7142 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:45:31.456909 7142 hybrid_clock.cc:648] HybridClock initialized: now 1786556731456873 us; error 54 us; skew 500 ppm
Aug 12 17:45:31 dist-test-slave-tk9z krb5kdc[5826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556731, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:45:31.461122 7142 init.cc:377] Logged in from keytab as kudu/127.17.255.2@KRBTEST.COM (short username kudu)
I20260812 17:45:31.462495 7142 webserver.cc:460] Webserver started at http://127.17.255.2:35701/ using document root <none> and password file <none>
I20260812 17:45:31.463310 7142 fs_manager.cc:359] Metadata directory not provided
I20260812 17:45:31.463470 7142 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:45:31.463776 7142 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 17:45:31 dist-test-slave-tk9z krb5kdc[5826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556731, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for HTTP/127.17.255.20@KRBTEST.COM
I20260812 17:45:31.481524 7142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-1/data/instance:
uuid: "ffab030598d24f90a352324d30d538a8"
format_stamp: "Formatted at 2026-08-12 17:45:31 on dist-test-slave-tk9z"
server_key: "b3bbdcf40d2257eb5fb7e6873e430252"
server_key_iv: "cc8d27aaa01fa2f0fee2bf8527f5586a"
server_key_version: "kuduclusterkey@0"
I20260812 17:45:31.482511 7142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance:
uuid: "ffab030598d24f90a352324d30d538a8"
format_stamp: "Formatted at 2026-08-12 17:45:31 on dist-test-slave-tk9z"
server_key: "b3bbdcf40d2257eb5fb7e6873e430252"
server_key_iv: "cc8d27aaa01fa2f0fee2bf8527f5586a"
server_key_version: "kuduclusterkey@0"
I20260812 17:45:31.490489 7142 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.005s sys 0.000s
I20260812 17:45:31.510751 7175 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:31.512513 7142 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 17:45:31.512696 7142 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-1/wal
uuid: "ffab030598d24f90a352324d30d538a8"
format_stamp: "Formatted at 2026-08-12 17:45:31 on dist-test-slave-tk9z"
server_key: "b3bbdcf40d2257eb5fb7e6873e430252"
server_key_iv: "cc8d27aaa01fa2f0fee2bf8527f5586a"
server_key_version: "kuduclusterkey@0"
I20260812 17:45:31.512877 7142 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:45:31.560586 7142 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:45:31.565277 7142 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:45:31.566115 7142 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:45:31.567137 7142 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:45:31.568502 7142 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:45:31.568647 7142 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260812 17:45:31.568769 7142 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:45:31.568862 7142 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:31.581988 7142 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.2:42287
I20260812 17:45:31.582044 7384 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.2:42287 every 8 connection(s)
I20260812 17:45:31.583578 7142 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
I20260812 17:45:31.587158 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 7142
I20260812 17:45:31.587298 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance
I20260812 17:45:31.587653 18428 external_mini_cluster.cc:1428] Setting key 9991f6de27087dc1759dccad14692878
Aug 12 17:45:31 dist-test-slave-tk9z krb5kdc[5826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556731, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.255.3@KRBTEST.COM; defaulting to no policy
I20260812 17:45:31.609114 7134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:31.586653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:40795 (local address 127.17.255.62:39855)
0812 17:45:31.586820 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:31.586825 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:31.591439 (+ 4614us) server_negotiation.cc:407] Connection header received
0812 17:45:31.593101 (+ 1662us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:31.593105 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:31.593172 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:31.593274 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:45:31.595096 (+ 1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:31.595934 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:31.598640 (+ 2706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:31.599120 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:31.599249 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:31.603773 (+ 4524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:45:31.603780 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:45:31.603784 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:45:31.603829 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:45:31.606035 (+ 2206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:31.606885 (+ 850us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:31.606889 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:31.606891 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:31.607005 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:31.607560 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:31.607564 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:31.607566 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:31.607829 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:45:31.607924 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:31.608782 (+ 858us) server_negotiation.cc:299] Negotiation successful
0812 17:45:31.608937 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 17:45:31.611238 7388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:31.586751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:39855 (local address 127.17.255.2:40795)
0812 17:45:31.591225 (+ 4474us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:31.591303 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0812 17:45:31.592785 (+ 1482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:45:31.593571 (+ 786us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:45:31.593582 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:45:31.594009 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:45:31.594853 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:31.594877 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:31.596183 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:31.596187 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:31.598295 (+ 2108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:31.598338 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:31.599667 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:31.599674 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:31.600005 (+ 331us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:31.600927 (+ 922us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:45:31.600961 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:45:31.603445 (+ 2484us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:45:31.606209 (+ 2764us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:31.606217 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:31.606240 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:31.606738 (+ 498us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:31.607141 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:31.607143 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:31.607145 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:31.607369 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:31.607992 (+ 623us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:45:31.608000 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:45:31.608452 (+ 452us) client_negotiation.cc:769] Sending connection context
0812 17:45:31.609684 (+ 1232us) client_negotiation.cc:240] Negotiation successful
0812 17:45:31.610093 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4177,"thread_start_us":180,"threads_started":1}
I20260812 17:45:31.613086 7385 heartbeater.cc:347] Connected to a master server at 127.17.255.62:39855
I20260812 17:45:31.613399 7385 heartbeater.cc:464] Registering TS with master...
I20260812 17:45:31.614125 7385 heartbeater.cc:511] Master 127.17.255.62:39855 requested a full tablet report, sending...
I20260812 17:45:31.615584 6715 ts_manager.cc:194] Registered new tserver with Master: ffab030598d24f90a352324d30d538a8 (127.17.255.2:42287)
I20260812 17:45:31.616460 6715 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.2@KRBTEST.COM'} at 127.17.255.2:40795
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab.
Entry for principal kudu/127.17.255.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab.
I20260812 17:45:31.662693 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.255.20:57157/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.3:0
--local_ip_for_outbound_sockets=127.17.255.3
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:39855
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:37959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 17:45:31 dist-test-slave-tk9z krb5kdc[5826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556731, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for HTTP/127.17.255.20@KRBTEST.COM
W20260812 17:45:31.938906 7397 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:45:31.939414 7397 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:45:31.939523 7397 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:45:31.945710 7397 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:45:31.945866 7397 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:45:31.946010 7397 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.3
I20260812 17:45:31.954282 7397 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:37959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.17.255.20:57157/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:39855
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7397
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.3
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:45:31.956374 7397 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:45:31.958060 7397 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:45:31.973759 7407 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:45:31.973762 7412 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:45:31.974763 7414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:45:31.975466 7397 server_base.cc:1034] running on GCE node
I20260812 17:45:31.976038 7397 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:45:31.976878 7397 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:45:31.978173 7397 hybrid_clock.cc:648] HybridClock initialized: now 1786556731978103 us; error 89 us; skew 500 ppm
Aug 12 17:45:31 dist-test-slave-tk9z krb5kdc[5826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556731, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:45:31.982028 7397 init.cc:377] Logged in from keytab as kudu/127.17.255.3@KRBTEST.COM (short username kudu)
I20260812 17:45:31.983362 7397 webserver.cc:460] Webserver started at http://127.17.255.3:46831/ using document root <none> and password file <none>
I20260812 17:45:31.984157 7397 fs_manager.cc:359] Metadata directory not provided
I20260812 17:45:31.984248 7397 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:45:31.984513 7397 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 17:45:31 dist-test-slave-tk9z krb5kdc[5826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556731, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for HTTP/127.17.255.20@KRBTEST.COM
I20260812 17:45:32.001960 7397 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-2/data/instance:
uuid: "03a745005d7a48c3af4f58e81ea47f49"
format_stamp: "Formatted at 2026-08-12 17:45:31 on dist-test-slave-tk9z"
server_key: "bb48cc97734de6ef55d653fb4f0593e3"
server_key_iv: "97da364e0622eef14534072a2fe4cf77"
server_key_version: "kuduclusterkey@0"
I20260812 17:45:32.003155 7397 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance:
uuid: "03a745005d7a48c3af4f58e81ea47f49"
format_stamp: "Formatted at 2026-08-12 17:45:31 on dist-test-slave-tk9z"
server_key: "bb48cc97734de6ef55d653fb4f0593e3"
server_key_iv: "97da364e0622eef14534072a2fe4cf77"
server_key_version: "kuduclusterkey@0"
I20260812 17:45:32.011437 7397 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.004s sys 0.000s
I20260812 17:45:32.041133 7429 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:32.043218 7397 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.000s
I20260812 17:45:32.043399 7397 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-2/wal
uuid: "03a745005d7a48c3af4f58e81ea47f49"
format_stamp: "Formatted at 2026-08-12 17:45:31 on dist-test-slave-tk9z"
server_key: "bb48cc97734de6ef55d653fb4f0593e3"
server_key_iv: "97da364e0622eef14534072a2fe4cf77"
server_key_version: "kuduclusterkey@0"
I20260812 17:45:32.043572 7397 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:45:32.099473 7397 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:45:32.103881 7397 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:45:32.104144 7397 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:45:32.105079 7397 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:45:32.106746 7397 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:45:32.106878 7397 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:32.106981 7397 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:45:32.107031 7397 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:32.122977 7397 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.3:42613
I20260812 17:45:32.123083 7625 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.3:42613 every 8 connection(s)
I20260812 17:45:32.124465 7397 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
I20260812 17:45:32.126832 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 7397
I20260812 17:45:32.126981 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance
I20260812 17:45:32.127290 18428 external_mini_cluster.cc:1428] Setting key 9162e6bd5967ccc57ffc79d1652fb9c9
Aug 12 17:45:32 dist-test-slave-tk9z krb5kdc[5826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556731, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:45:32.150012 7631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:32.127715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:45315 (local address 127.17.255.62:39855)
0812 17:45:32.129195 (+ 1480us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:32.129200 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:32.130403 (+ 1203us) server_negotiation.cc:407] Connection header received
0812 17:45:32.130956 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:32.130959 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:32.131020 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:32.131142 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:45:32.132435 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:32.133285 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:32.135076 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:32.135432 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:32.135548 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:32.139434 (+ 3886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:45:32.139437 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:45:32.139439 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:45:32.139471 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:45:32.146850 (+ 7379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:32.147784 (+ 934us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:32.147789 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:32.147790 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:32.147899 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:32.148429 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:32.148435 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:32.148443 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:32.148834 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:45:32.148984 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:32.149661 (+ 677us) server_negotiation.cc:299] Negotiation successful
0812 17:45:32.149822 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1381,"thread_start_us":108,"threads_started":1}
I20260812 17:45:32.151460 7630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:32.127465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:39855 (local address 127.17.255.3:45315)
0812 17:45:32.129517 (+ 2052us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:32.129585 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0812 17:45:32.130722 (+ 1137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:45:32.131336 (+ 614us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:45:32.131353 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:45:32.131667 (+ 314us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:45:32.132228 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:32.132249 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:32.133463 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:32.133467 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:32.134922 (+ 1455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:32.134937 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:32.135819 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:32.135823 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:32.135988 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:32.137035 (+ 1047us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:45:32.137054 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:45:32.139134 (+ 2080us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:45:32.147176 (+ 8042us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:32.147184 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:32.147206 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:32.147653 (+ 447us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:32.148020 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:32.148023 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:32.148027 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:32.148289 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:32.148991 (+ 702us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:45:32.149003 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:45:32.149331 (+ 328us) client_negotiation.cc:769] Sending connection context
0812 17:45:32.149581 (+ 250us) client_negotiation.cc:240] Negotiation successful
0812 17:45:32.150107 (+ 526us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1781,"thread_start_us":157,"threads_started":1}
Aug 12 17:45:32 dist-test-slave-tk9z krb5kdc[5826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556731, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for HTTP/127.17.255.20@KRBTEST.COM
I20260812 17:45:32.154047 7627 heartbeater.cc:347] Connected to a master server at 127.17.255.62:39855
I20260812 17:45:32.154345 7627 heartbeater.cc:464] Registering TS with master...
I20260812 17:45:32.154973 7627 heartbeater.cc:511] Master 127.17.255.62:39855 requested a full tablet report, sending...
I20260812 17:45:32.156051 6715 ts_manager.cc:194] Registered new tserver with Master: 03a745005d7a48c3af4f58e81ea47f49 (127.17.255.3:42613)
I20260812 17:45:32.156805 6715 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.3@KRBTEST.COM'} at 127.17.255.3:45315
I20260812 17:45:32.173420 18428 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 17:45:32.174170 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 6862
I20260812 17:45:32.196169 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 7142
I20260812 17:45:32.219713 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 7397
I20260812 17:45:32.242892 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 6658
I20260812 17:45:32.270428 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:39855
--webserver_interface=127.17.255.62
--webserver_port=42735
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:37959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:39855
--ranger_config_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.255.20:57157/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.17.255.20:57157/kms with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:45:32.430902 7636 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:45:32.431223 7636 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:45:32.431265 7636 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:45:32.435515 7636 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:45:32.435592 7636 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:45:32.435612 7636 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:45:32.435629 7636 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:45:32.435644 7636 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:45:32.441783 7636 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:37959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.17.255.20:57157/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:39855
--ranger_config_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:39855
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=42735
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7636
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:45:32.443097 7636 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:45:32.444181 7636 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:45:32.453627 7648 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:45:32.453626 7646 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:45:32.453626 7645 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:45:32.454030 7636 server_base.cc:1034] running on GCE node
I20260812 17:45:32.454820 7636 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:45:32.455999 7636 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:45:32.457245 7636 hybrid_clock.cc:648] HybridClock initialized: now 1786556732457221 us; error 31 us; skew 500 ppm
Aug 12 17:45:32 dist-test-slave-tk9z krb5kdc[5826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556732, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:45:32.460606 7636 init.cc:377] Logged in from keytab as kudu/127.17.255.62@KRBTEST.COM (short username kudu)
I20260812 17:45:32.461659 7636 webserver.cc:460] Webserver started at http://127.17.255.62:42735/ using document root <none> and password file <none>
I20260812 17:45:32.462289 7636 fs_manager.cc:359] Metadata directory not provided
I20260812 17:45:32.462452 7636 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 17:45:32 dist-test-slave-tk9z krb5kdc[5826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556732, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for HTTP/127.17.255.20@KRBTEST.COM
I20260812 17:45:32.546991 7636 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:45:32.549721 7669 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:32.551467 7636 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:45:32.551680 7636 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "2ef48902e82b4e5abcbe7f3b9dcce81a"
format_stamp: "Formatted at 2026-08-12 17:45:29 on dist-test-slave-tk9z"
server_key: "26a41d4cdaa2fadbe0025d6141866310"
server_key_iv: "c4058e552f0d2b47d3cd013e7e2ec57b"
server_key_version: "kuduclusterkey@0"
I20260812 17:45:32.552377 7636 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:45:32.577291 7636 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:45:32.580467 7636 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:45:32.580706 7636 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:45:32.588665 7636 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:39855
I20260812 17:45:32.588670 7765 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:39855 every 8 connection(s)
I20260812 17:45:32.589879 7636 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:45:32.595355 7767 sys_catalog.cc:263] Verifying existing consensus state
I20260812 17:45:32.595573 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 7636
I20260812 17:45:32.596174 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.255.20:57157/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.1:43911
--local_ip_for_outbound_sockets=127.17.255.1
--tserver_master_addrs=127.17.255.62:39855
--webserver_port=42167
--webserver_interface=127.17.255.1
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:37959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.17.255.20:57157/kms with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 17:45:32.598302 7767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a: Bootstrap starting.
I20260812 17:45:32.616460 7767 log.cc:824] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a: Log is configured to *not* fsync() on all Append() calls
I20260812 17:45:32.623914 7767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 17:45:32.624357 7767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a: Bootstrap complete.
I20260812 17:45:32.628796 7767 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ef48902e82b4e5abcbe7f3b9dcce81a" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 39855 } }
I20260812 17:45:32.629253 7767 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ef48902e82b4e5abcbe7f3b9dcce81a, State: Initialized, Role: FOLLOWER
I20260812 17:45:32.629765 7767 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ef48902e82b4e5abcbe7f3b9dcce81a" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 39855 } }
I20260812 17:45:32.629918 7767 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:45:32.630012 7767 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:45:32.630137 7767 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a [term 1 FOLLOWER]: Advancing to term 2
I20260812 17:45:32.632381 7767 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ef48902e82b4e5abcbe7f3b9dcce81a" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 39855 } }
I20260812 17:45:32.632738 7767 leader_election.cc:302] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2ef48902e82b4e5abcbe7f3b9dcce81a; no voters:
I20260812 17:45:32.633111 7767 leader_election.cc:288] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 17:45:32.633204 7774 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a [term 2 FOLLOWER]: Leader election won for term 2
I20260812 17:45:32.633409 7774 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a [term 2 LEADER]: Becoming Leader. State: Replica: 2ef48902e82b4e5abcbe7f3b9dcce81a, State: Running, Role: LEADER
I20260812 17:45:32.633729 7774 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ef48902e82b4e5abcbe7f3b9dcce81a" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 39855 } }
I20260812 17:45:32.634450 7767 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:45:32.635226 7777 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2ef48902e82b4e5abcbe7f3b9dcce81a. Latest consensus state: current_term: 2 leader_uuid: "2ef48902e82b4e5abcbe7f3b9dcce81a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ef48902e82b4e5abcbe7f3b9dcce81a" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 39855 } } }
I20260812 17:45:32.635371 7777 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a [sys.catalog]: This master's current role is: LEADER
I20260812 17:45:32.635764 7775 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "2ef48902e82b4e5abcbe7f3b9dcce81a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ef48902e82b4e5abcbe7f3b9dcce81a" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 39855 } } }
I20260812 17:45:32.635856 7775 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a [sys.catalog]: This master's current role is: LEADER
I20260812 17:45:32.636679 7785 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:45:32.636992 7767 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 17:45:32.643711 7785 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:45:32.644716 7785 catalog_manager.cc:1259] Loaded cluster ID: 305e8afbb155479eaa79d223a9fb30ec
I20260812 17:45:32.644791 7785 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:45:32.647833 7785 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:45:32.648674 7785 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a: Loaded TSK: 0
I20260812 17:45:32.650981 7785 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 17:45:32.753348 7771 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:45:32.753779 7771 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:45:32.753867 7771 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:45:32.760149 7771 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:45:32.760253 7771 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:45:32.760356 7771 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.1
I20260812 17:45:32.768882 7771 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:37959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.17.255.20:57157/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.1:43911
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.255.1
--webserver_port=42167
--tserver_master_addrs=127.17.255.62:39855
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7771
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.1
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:45:32.770449 7771 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:45:32.772104 7771 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:45:32.786230 7841 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:45:32.786821 7844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:45:32.787146 7840 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:45:32.788467 7771 server_base.cc:1034] running on GCE node
I20260812 17:45:32.789273 7771 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:45:32.790439 7771 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:45:32.791777 7771 hybrid_clock.cc:648] HybridClock initialized: now 1786556732791720 us; error 81 us; skew 500 ppm
Aug 12 17:45:32 dist-test-slave-tk9z krb5kdc[5826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556732, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:45:32.795830 7771 init.cc:377] Logged in from keytab as kudu/127.17.255.1@KRBTEST.COM (short username kudu)
I20260812 17:45:32.797188 7771 webserver.cc:460] Webserver started at http://127.17.255.1:42167/ using document root <none> and password file <none>
I20260812 17:45:32.798014 7771 fs_manager.cc:359] Metadata directory not provided
I20260812 17:45:32.798141 7771 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 17:45:32 dist-test-slave-tk9z krb5kdc[5826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556732, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for HTTP/127.17.255.20@KRBTEST.COM
I20260812 17:45:32.836221 7771 fs_manager.cc:709] Time spent opening directory manager: real 0.011s user 0.003s sys 0.000s
I20260812 17:45:32.850687 7857 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:32.856118 7771 fs_manager.cc:725] Time spent opening block manager: real 0.018s user 0.002s sys 0.000s
I20260812 17:45:32.862452 7771 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-0/wal
uuid: "b14eb3a1e02e4c89b0538d0fe446adbf"
format_stamp: "Formatted at 2026-08-12 17:45:31 on dist-test-slave-tk9z"
server_key: "50942658325944efda58d95c9169b60f"
server_key_iv: "881b6e8f7cbb8814f04c0dcb90882b40"
server_key_version: "kuduclusterkey@0"
I20260812 17:45:32.863435 7771 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:45:32.927997 7771 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:45:32.936198 7771 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:45:32.936465 7771 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:45:32.937311 7771 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:45:32.938498 7771 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:45:32.938567 7771 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:32.938640 7771 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:45:32.938673 7771 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:32.951299 7771 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.1:43911
I20260812 17:45:32.951329 8055 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.1:43911 every 8 connection(s)
I20260812 17:45:32.952526 7771 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
I20260812 17:45:32.961954 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 7771
I20260812 17:45:32.962591 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.255.20:57157/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.2:42287
--local_ip_for_outbound_sockets=127.17.255.2
--tserver_master_addrs=127.17.255.62:39855
--webserver_port=35701
--webserver_interface=127.17.255.2
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:37959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.17.255.20:57157/kms with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 17:45:32 dist-test-slave-tk9z krb5kdc[5826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556732, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:45:32.974548 8060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:32.955282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:39855 (local address 127.17.255.1:58547)
0812 17:45:32.956191 (+ 909us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:32.956250 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0812 17:45:32.957326 (+ 1076us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:45:32.958925 (+ 1599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:45:32.958931 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:45:32.959217 (+ 286us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:45:32.959733 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:32.959748 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:32.961116 (+ 1368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:32.961120 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:32.962296 (+ 1176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:32.962311 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:32.963827 (+ 1516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:32.963832 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:32.964054 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:32.964783 (+ 729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:45:32.964810 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:45:32.966790 (+ 1980us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:45:32.970112 (+ 3322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:32.970121 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:32.970138 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:32.970607 (+ 469us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:32.971104 (+ 497us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:32.971107 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:32.971109 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:32.971305 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:32.972247 (+ 942us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:45:32.972254 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:45:32.972603 (+ 349us) client_negotiation.cc:769] Sending connection context
0812 17:45:32.972863 (+ 260us) client_negotiation.cc:240] Negotiation successful
0812 17:45:32.973307 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":674,"thread_start_us":165,"threads_started":1}
I20260812 17:45:32.976720 8059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:32.955056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:58547 (local address 127.17.255.62:39855)
0812 17:45:32.955817 (+ 761us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:32.955872 (+ 55us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:32.956411 (+ 539us) server_negotiation.cc:407] Connection header received
0812 17:45:32.957896 (+ 1485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:32.957913 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:32.958395 (+ 482us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:32.958830 (+ 435us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:45:32.959942 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:32.960965 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:32.962507 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:32.963348 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:32.963549 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:32.967128 (+ 3579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:45:32.967139 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:45:32.967163 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:45:32.967206 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:45:32.969934 (+ 2728us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:32.970772 (+ 838us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:32.970780 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:32.970786 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:32.970970 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:32.971434 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:32.971437 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:32.971439 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:32.972048 (+ 609us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:45:32.972187 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:32.975231 (+ 3044us) server_negotiation.cc:299] Negotiation successful
0812 17:45:32.975624 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":544,"thread_start_us":119,"threads_started":1}
I20260812 17:45:32.980880 8056 heartbeater.cc:347] Connected to a master server at 127.17.255.62:39855
I20260812 17:45:32.981324 8056 heartbeater.cc:464] Registering TS with master...
I20260812 17:45:32.982168 8056 heartbeater.cc:511] Master 127.17.255.62:39855 requested a full tablet report, sending...
W20260812 17:45:32.985013 8056 heartbeater.cc:644] Failed to heartbeat to 127.17.255.62:39855 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 17:45:32.985286 8056 heartbeater.cc:464] Registering TS with master...
I20260812 17:45:32.985615 8056 heartbeater.cc:511] Master 127.17.255.62:39855 requested a full tablet report, sending...
I20260812 17:45:32.986711 8056 heartbeater.cc:464] Registering TS with master...
I20260812 17:45:32.986997 8056 heartbeater.cc:511] Master 127.17.255.62:39855 requested a full tablet report, sending...
W20260812 17:45:32.987929 8056 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 17:45:33.114866 8065 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:45:33.115335 8065 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:45:33.115447 8065 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:45:33.120491 8065 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:45:33.120589 8065 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:45:33.120697 8065 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.2
I20260812 17:45:33.126420 8065 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:37959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.17.255.20:57157/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.2:42287
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.255.2
--webserver_port=35701
--tserver_master_addrs=127.17.255.62:39855
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8065
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.2
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:45:33.127645 8065 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:45:33.128777 8065 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:45:33.142865 8089 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:45:33.143369 8085 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:45:33.142812 8083 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:45:33.144848 8065 server_base.cc:1034] running on GCE node
I20260812 17:45:33.145500 8065 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:45:33.146358 8065 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:45:33.147583 8065 hybrid_clock.cc:648] HybridClock initialized: now 1786556733147544 us; error 49 us; skew 500 ppm
Aug 12 17:45:33 dist-test-slave-tk9z krb5kdc[5826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556733, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:45:33.150751 8065 init.cc:377] Logged in from keytab as kudu/127.17.255.2@KRBTEST.COM (short username kudu)
I20260812 17:45:33.151930 8065 webserver.cc:460] Webserver started at http://127.17.255.2:35701/ using document root <none> and password file <none>
I20260812 17:45:33.152650 8065 fs_manager.cc:359] Metadata directory not provided
I20260812 17:45:33.152762 8065 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 17:45:33 dist-test-slave-tk9z krb5kdc[5826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556733, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for HTTP/127.17.255.20@KRBTEST.COM
I20260812 17:45:33.182606 8065 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 17:45:33.185814 8098 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:33.187589 8065 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260812 17:45:33.187736 8065 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-1/wal
uuid: "ffab030598d24f90a352324d30d538a8"
format_stamp: "Formatted at 2026-08-12 17:45:31 on dist-test-slave-tk9z"
server_key: "b3bbdcf40d2257eb5fb7e6873e430252"
server_key_iv: "cc8d27aaa01fa2f0fee2bf8527f5586a"
server_key_version: "kuduclusterkey@0"
I20260812 17:45:33.188481 8065 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:45:33.215674 8065 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:45:33.219748 8065 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:45:33.219990 8065 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:45:33.220809 8065 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:45:33.221983 8065 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:45:33.222061 8065 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:33.222136 8065 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:45:33.222167 8065 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:33.233913 8065 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.2:42287
I20260812 17:45:33.235318 8065 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
I20260812 17:45:33.237803 8322 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.2:42287 every 8 connection(s)
I20260812 17:45:33.244829 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 8065
I20260812 17:45:33.245319 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.255.20:57157/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.3:42613
--local_ip_for_outbound_sockets=127.17.255.3
--tserver_master_addrs=127.17.255.62:39855
--webserver_port=46831
--webserver_interface=127.17.255.3
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:37959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.17.255.20:57157/kms with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 17:45:33 dist-test-slave-tk9z krb5kdc[5826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556733, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:45:33.255627 8059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:33.239710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:32909 (local address 127.17.255.62:39855)
0812 17:45:33.239875 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:33.239879 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:33.241239 (+ 1360us) server_negotiation.cc:407] Connection header received
0812 17:45:33.242466 (+ 1227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:33.242470 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:33.242546 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:33.242662 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:45:33.244004 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:33.244624 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:33.246417 (+ 1793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:33.246729 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:33.246852 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:33.250302 (+ 3450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:45:33.250307 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:45:33.250310 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:45:33.250349 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:45:33.252261 (+ 1912us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:33.253080 (+ 819us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:33.253088 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:33.253091 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:33.253204 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:33.253748 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:33.253754 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:33.253757 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:33.254068 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:45:33.254159 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:33.255135 (+ 976us) server_negotiation.cc:299] Negotiation successful
0812 17:45:33.255349 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 17:45:33.257786 8326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:33.240403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:39855 (local address 127.17.255.2:32909)
0812 17:45:33.241045 (+ 642us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:33.241096 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 17:45:33.242177 (+ 1081us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:45:33.242880 (+ 703us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:45:33.242889 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:45:33.243191 (+ 302us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:45:33.243841 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:33.243859 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:33.244806 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:33.244810 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:33.246267 (+ 1457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:33.246281 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:33.247059 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:33.247064 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:33.247291 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:33.248059 (+ 768us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:45:33.248088 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:45:33.250038 (+ 1950us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:45:33.252424 (+ 2386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:33.252436 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:33.252460 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:33.252921 (+ 461us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:33.253362 (+ 441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:33.253368 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:33.253372 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:33.253609 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:33.254264 (+ 655us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:45:33.254275 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:45:33.254757 (+ 482us) client_negotiation.cc:769] Sending connection context
0812 17:45:33.255869 (+ 1112us) client_negotiation.cc:240] Negotiation successful
0812 17:45:33.256326 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":182,"threads_started":1}
I20260812 17:45:33.259351 8324 heartbeater.cc:347] Connected to a master server at 127.17.255.62:39855
I20260812 17:45:33.259626 8324 heartbeater.cc:464] Registering TS with master...
I20260812 17:45:33.260241 8324 heartbeater.cc:511] Master 127.17.255.62:39855 requested a full tablet report, sending...
W20260812 17:45:33.262169 8324 heartbeater.cc:644] Failed to heartbeat to 127.17.255.62:39855 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 17:45:33.262315 8324 heartbeater.cc:464] Registering TS with master...
I20260812 17:45:33.262527 8324 heartbeater.cc:511] Master 127.17.255.62:39855 requested a full tablet report, sending...
I20260812 17:45:33.263473 8324 heartbeater.cc:464] Registering TS with master...
I20260812 17:45:33.263676 8324 heartbeater.cc:511] Master 127.17.255.62:39855 requested a full tablet report, sending...
W20260812 17:45:33.264551 8324 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 17:45:33.403182 8328 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:45:33.403553 8328 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:45:33.403630 8328 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:45:33.408004 8328 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:45:33.408113 8328 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:45:33.408215 8328 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.3
I20260812 17:45:33.414317 8328 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:37959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.17.255.20:57157/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.3:42613
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.255.3
--webserver_port=46831
--tserver_master_addrs=127.17.255.62:39855
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8328
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.3
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:45:33.415831 8328 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:45:33.417331 8328 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:45:33.429503 8348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:45:33.429767 8346 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:45:33.429941 8344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:45:33.430455 8328 server_base.cc:1034] running on GCE node
I20260812 17:45:33.431036 8328 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:45:33.431948 8328 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:45:33.433172 8328 hybrid_clock.cc:648] HybridClock initialized: now 1786556733433146 us; error 45 us; skew 500 ppm
Aug 12 17:45:33 dist-test-slave-tk9z krb5kdc[5826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556733, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:45:33.437199 8328 init.cc:377] Logged in from keytab as kudu/127.17.255.3@KRBTEST.COM (short username kudu)
I20260812 17:45:33.438525 8328 webserver.cc:460] Webserver started at http://127.17.255.3:46831/ using document root <none> and password file <none>
I20260812 17:45:33.439344 8328 fs_manager.cc:359] Metadata directory not provided
I20260812 17:45:33.439463 8328 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 17:45:33 dist-test-slave-tk9z krb5kdc[5826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556733, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for HTTP/127.17.255.20@KRBTEST.COM
I20260812 17:45:33.458904 8328 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260812 17:45:33.462615 8374 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:33.464600 8328 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 17:45:33.464774 8328 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-2/wal
uuid: "03a745005d7a48c3af4f58e81ea47f49"
format_stamp: "Formatted at 2026-08-12 17:45:31 on dist-test-slave-tk9z"
server_key: "bb48cc97734de6ef55d653fb4f0593e3"
server_key_iv: "97da364e0622eef14534072a2fe4cf77"
server_key_version: "kuduclusterkey@0"
I20260812 17:45:33.465646 8328 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:45:33.500330 8328 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:45:33.504609 8328 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:45:33.504834 8328 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:45:33.505630 8328 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:45:33.506830 8328 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:45:33.506901 8328 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:33.506958 8328 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:45:33.506997 8328 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:33.519938 8328 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.3:42613
I20260812 17:45:33.519968 8583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.3:42613 every 8 connection(s)
I20260812 17:45:33.521122 8328 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
I20260812 17:45:33.525689 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 8328
Aug 12 17:45:33 dist-test-slave-tk9z krb5kdc[5826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556733, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:45:33.541486 8059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:33.526529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45864 (local address 127.17.255.62:39855)
0812 17:45:33.526849 (+ 320us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:33.526855 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:33.527207 (+ 352us) server_negotiation.cc:407] Connection header received
0812 17:45:33.527651 (+ 444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:33.527659 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:33.527717 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:33.527777 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:45:33.528890 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:33.529699 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:33.530976 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:33.531299 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:33.531394 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:33.533481 (+ 2087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:45:33.533486 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:45:33.533489 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:45:33.533519 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:45:33.535474 (+ 1955us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:33.536457 (+ 983us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:33.536461 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:33.536462 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:33.536571 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:33.537181 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:33.537185 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:33.537187 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:33.537377 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:45:33.537608 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:33.541153 (+ 3545us) server_negotiation.cc:299] Negotiation successful
0812 17:45:33.541301 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":239}
I20260812 17:45:33.544586 8589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:33.526609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:55621 (local address 127.17.255.62:39855)
0812 17:45:33.527381 (+ 772us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:33.527390 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:33.530141 (+ 2751us) server_negotiation.cc:407] Connection header received
0812 17:45:33.530181 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:33.530184 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:33.530233 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:33.530338 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:45:33.532433 (+ 2095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:33.533312 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:33.534984 (+ 1672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:33.535234 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:33.535359 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:33.538634 (+ 3275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:45:33.538638 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:45:33.538640 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:45:33.538666 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:45:33.540469 (+ 1803us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:33.542160 (+ 1691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:33.542164 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:33.542166 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:33.542269 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:33.543038 (+ 769us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:33.543042 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:33.543043 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:33.543278 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:45:33.543393 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:33.544264 (+ 871us) server_negotiation.cc:299] Negotiation successful
0812 17:45:33.544407 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":705,"thread_start_us":119,"threads_started":1}
I20260812 17:45:33.545962 8591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:33.527319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:39855 (local address 127.17.255.3:55621)
0812 17:45:33.528700 (+ 1381us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:33.528762 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0812 17:45:33.529846 (+ 1084us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:45:33.530663 (+ 817us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:45:33.530671 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:45:33.531059 (+ 388us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:45:33.531771 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:33.531797 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:33.533497 (+ 1700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:33.533501 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:33.534842 (+ 1341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:33.534853 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:33.535409 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:33.535413 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:33.535647 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:33.536281 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:45:33.536308 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:45:33.538424 (+ 2116us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:45:33.540614 (+ 2190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:33.540620 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:33.540641 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:33.542042 (+ 1401us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:33.542523 (+ 481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:33.542526 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:33.542529 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:33.542921 (+ 392us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:33.543545 (+ 624us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:45:33.543553 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:45:33.543930 (+ 377us) client_negotiation.cc:769] Sending connection context
0812 17:45:33.544167 (+ 237us) client_negotiation.cc:240] Negotiation successful
0812 17:45:33.544762 (+ 595us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1142,"thread_start_us":181,"threads_started":1}
I20260812 17:45:33.547298 8585 heartbeater.cc:347] Connected to a master server at 127.17.255.62:39855
I20260812 17:45:33.547591 8585 heartbeater.cc:464] Registering TS with master...
I20260812 17:45:33.548231 8585 heartbeater.cc:511] Master 127.17.255.62:39855 requested a full tablet report, sending...
I20260812 17:45:33.549944 7703 ts_manager.cc:194] Registered new tserver with Master: 03a745005d7a48c3af4f58e81ea47f49 (127.17.255.3:42613)
I20260812 17:45:33.551702 7703 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.3@KRBTEST.COM'} at 127.17.255.3:55621
Aug 12 17:45:33 dist-test-slave-tk9z krb5kdc[5826](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786556733, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:45:33.988224 8056 heartbeater.cc:464] Registering TS with master...
I20260812 17:45:33.988574 8056 heartbeater.cc:511] Master 127.17.255.62:39855 requested a full tablet report, sending...
I20260812 17:45:33.989568 7703 ts_manager.cc:194] Registered new tserver with Master: b14eb3a1e02e4c89b0538d0fe446adbf (127.17.255.1:43911)
I20260812 17:45:33.990443 7703 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.1@KRBTEST.COM'} at 127.17.255.1:58547
Aug 12 17:45:34 dist-test-slave-tk9z krb5kdc[5826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556733, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for HTTP/127.17.255.20@KRBTEST.COM
I20260812 17:45:34.264807 8324 heartbeater.cc:464] Registering TS with master...
I20260812 17:45:34.265162 8324 heartbeater.cc:511] Master 127.17.255.62:39855 requested a full tablet report, sending...
I20260812 17:45:34.266248 7703 ts_manager.cc:194] Registered new tserver with Master: ffab030598d24f90a352324d30d538a8 (127.17.255.2:42287)
I20260812 17:45:34.267274 7703 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.2@KRBTEST.COM'} at 127.17.255.2:32909
I20260812 17:45:34.272332 18428 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 17:45:34.285473 8607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:34.274229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45868 (local address 127.17.255.62:39855)
0812 17:45:34.274921 (+ 692us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:34.274926 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:34.275291 (+ 365us) server_negotiation.cc:407] Connection header received
0812 17:45:34.275356 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:34.275359 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:34.275413 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:34.275493 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:45:34.276513 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:34.277389 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:34.278676 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:34.279040 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:34.279146 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:34.281053 (+ 1907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:45:34.281057 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:45:34.281060 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:45:34.281091 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:45:34.283000 (+ 1909us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:34.283546 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:34.283550 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:34.283552 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:34.283652 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:34.283963 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:34.283967 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:34.283969 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:34.284201 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:45:34.284369 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:34.285127 (+ 758us) server_negotiation.cc:299] Negotiation successful
0812 17:45:34.285268 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":599,"thread_start_us":148,"threads_started":1}
I20260812 17:45:34.290720 7703 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45868:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 17:45:34.296808 7703 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 17:45:34.318985 8622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:34.310047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.3:42613 (local address 127.0.0.1:51668)
0812 17:45:34.310551 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:34.310612 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0812 17:45:34.310751 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:45:34.313767 (+ 3016us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:45:34.313774 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:45:34.313803 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:45:34.313977 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:34.313985 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:34.315544 (+ 1559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:34.315548 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:34.316975 (+ 1427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:34.316987 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:34.318360 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:34.318364 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:34.318508 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:34.318550 (+ 42us) client_negotiation.cc:769] Sending connection context
0812 17:45:34.318666 (+ 116us) client_negotiation.cc:240] Negotiation successful
0812 17:45:34.318805 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":140,"threads_started":1}
I20260812 17:45:34.320206 8627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:34.310650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51668 (local address 127.17.255.3:42613)
0812 17:45:34.312977 (+ 2327us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:34.312987 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:34.313017 (+ 30us) server_negotiation.cc:407] Connection header received
0812 17:45:34.313112 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:34.313119 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:34.313376 (+ 257us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:34.313557 (+ 181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:45:34.314128 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:34.315401 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:34.317122 (+ 1721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:34.318033 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:34.318135 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:34.318294 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:34.319931 (+ 1637us) server_negotiation.cc:299] Negotiation successful
0812 17:45:34.320054 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2185,"thread_start_us":103,"threads_started":1}
I20260812 17:45:34.324330 8465 tablet_service.cc:1467] Processing CreateTablet for tablet 2ad37f6e841a4361aa5b72c98c5ad4e8 (DEFAULT_TABLE table=test-table [id=d9ff2bda6d7a4f77a0fa00705ac4f5bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:45:34.326583 8465 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ad37f6e841a4361aa5b72c98c5ad4e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:45:34.326845 8622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:34.312334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:43911 (local address 127.0.0.1:51878)
0812 17:45:34.319700 (+ 7366us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:34.319715 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 17:45:34.319788 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:45:34.321741 (+ 1953us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:45:34.321744 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:45:34.321768 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:45:34.321873 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:34.321880 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:34.323493 (+ 1613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:34.323497 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:34.324711 (+ 1214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:34.324725 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:34.326213 (+ 1488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:34.326217 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:34.326346 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:34.326432 (+ 86us) client_negotiation.cc:769] Sending connection context
0812 17:45:34.326531 (+ 99us) client_negotiation.cc:240] Negotiation successful
0812 17:45:34.326640 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7303,"thread_start_us":80,"threads_started":1}
I20260812 17:45:34.326871 8633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:34.312511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51878 (local address 127.17.255.1:43911)
0812 17:45:34.320945 (+ 8434us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:34.320953 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:34.320984 (+ 31us) server_negotiation.cc:407] Connection header received
0812 17:45:34.321076 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:34.321082 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:34.321331 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:34.321762 (+ 431us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:45:34.322011 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:34.323332 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:34.324894 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:34.325850 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:34.325973 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:34.326139 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:34.326580 (+ 441us) server_negotiation.cc:299] Negotiation successful
0812 17:45:34.326716 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8291,"thread_start_us":139,"threads_started":1}
I20260812 17:45:34.331054 8632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:34.311956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:42287 (local address 127.0.0.1:55970)
0812 17:45:34.314050 (+ 2094us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:34.314066 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 17:45:34.314187 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:45:34.315292 (+ 1105us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:45:34.315296 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:45:34.315315 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:45:34.315479 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:34.315488 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:34.317842 (+ 2354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:34.317846 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:34.319095 (+ 1249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:34.319109 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:34.321471 (+ 2362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:34.321475 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:34.330570 (+ 9095us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:34.330616 (+ 46us) client_negotiation.cc:769] Sending connection context
0812 17:45:34.330718 (+ 102us) client_negotiation.cc:240] Negotiation successful
0812 17:45:34.330845 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2020,"thread_start_us":113,"threads_started":1}
I20260812 17:45:34.331103 7937 tablet_service.cc:1467] Processing CreateTablet for tablet 2ad37f6e841a4361aa5b72c98c5ad4e8 (DEFAULT_TABLE table=test-table [id=d9ff2bda6d7a4f77a0fa00705ac4f5bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:45:34.332355 8636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:34.312905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55970 (local address 127.17.255.2:42287)
0812 17:45:34.314543 (+ 1638us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:34.314551 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:34.314577 (+ 26us) server_negotiation.cc:407] Connection header received
0812 17:45:34.314657 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:34.314663 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:34.314900 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:34.315134 (+ 234us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:45:34.315618 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:34.317689 (+ 2071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:34.319265 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:34.320196 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:34.320327 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:34.331929 (+ 11602us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:34.332012 (+ 83us) server_negotiation.cc:299] Negotiation successful
0812 17:45:34.332159 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1522,"thread_start_us":128,"threads_started":1}
I20260812 17:45:34.332500 7937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ad37f6e841a4361aa5b72c98c5ad4e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:45:34.335942 8188 tablet_service.cc:1467] Processing CreateTablet for tablet 2ad37f6e841a4361aa5b72c98c5ad4e8 (DEFAULT_TABLE table=test-table [id=d9ff2bda6d7a4f77a0fa00705ac4f5bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:45:34.337363 8188 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ad37f6e841a4361aa5b72c98c5ad4e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:45:34.346622 8641 tablet_bootstrap.cc:492] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P b14eb3a1e02e4c89b0538d0fe446adbf: Bootstrap starting.
I20260812 17:45:34.349195 8640 tablet_bootstrap.cc:492] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P 03a745005d7a48c3af4f58e81ea47f49: Bootstrap starting.
I20260812 17:45:34.350733 8643 tablet_bootstrap.cc:492] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P ffab030598d24f90a352324d30d538a8: Bootstrap starting.
I20260812 17:45:34.350955 8641 tablet_bootstrap.cc:654] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P b14eb3a1e02e4c89b0538d0fe446adbf: Neither blocks nor log segments found. Creating new log.
I20260812 17:45:34.352074 8641 log.cc:824] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P b14eb3a1e02e4c89b0538d0fe446adbf: Log is configured to *not* fsync() on all Append() calls
I20260812 17:45:34.353374 8643 tablet_bootstrap.cc:654] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P ffab030598d24f90a352324d30d538a8: Neither blocks nor log segments found. Creating new log.
I20260812 17:45:34.354825 8641 tablet_bootstrap.cc:492] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P b14eb3a1e02e4c89b0538d0fe446adbf: No bootstrap required, opened a new log
I20260812 17:45:34.355064 8641 ts_tablet_manager.cc:1397] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P b14eb3a1e02e4c89b0538d0fe446adbf: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260812 17:45:34.355147 8640 tablet_bootstrap.cc:654] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P 03a745005d7a48c3af4f58e81ea47f49: Neither blocks nor log segments found. Creating new log.
I20260812 17:45:34.356184 8640 log.cc:824] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P 03a745005d7a48c3af4f58e81ea47f49: Log is configured to *not* fsync() on all Append() calls
I20260812 17:45:34.357916 8643 log.cc:824] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P ffab030598d24f90a352324d30d538a8: Log is configured to *not* fsync() on all Append() calls
I20260812 17:45:34.360502 8640 tablet_bootstrap.cc:492] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P 03a745005d7a48c3af4f58e81ea47f49: No bootstrap required, opened a new log
I20260812 17:45:34.360831 8640 ts_tablet_manager.cc:1397] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P 03a745005d7a48c3af4f58e81ea47f49: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.000s
I20260812 17:45:34.361722 8641 raft_consensus.cc:348] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P b14eb3a1e02e4c89b0538d0fe446adbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03a745005d7a48c3af4f58e81ea47f49" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 42613 } } peers { permanent_uuid: "ffab030598d24f90a352324d30d538a8" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 42287 } } peers { permanent_uuid: "b14eb3a1e02e4c89b0538d0fe446adbf" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 43911 } }
I20260812 17:45:34.362190 8641 raft_consensus.cc:374] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P b14eb3a1e02e4c89b0538d0fe446adbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:45:34.362334 8641 raft_consensus.cc:729] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P b14eb3a1e02e4c89b0538d0fe446adbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b14eb3a1e02e4c89b0538d0fe446adbf, State: Initialized, Role: FOLLOWER
I20260812 17:45:34.363018 8641 consensus_queue.cc:260] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P b14eb3a1e02e4c89b0538d0fe446adbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03a745005d7a48c3af4f58e81ea47f49" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 42613 } } peers { permanent_uuid: "ffab030598d24f90a352324d30d538a8" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 42287 } } peers { permanent_uuid: "b14eb3a1e02e4c89b0538d0fe446adbf" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 43911 } }
I20260812 17:45:34.364423 8641 ts_tablet_manager.cc:1428] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P b14eb3a1e02e4c89b0538d0fe446adbf: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260812 17:45:34.364935 8056 heartbeater.cc:503] Master 127.17.255.62:39855 was elected leader, sending a full tablet report...
I20260812 17:45:34.366027 8640 raft_consensus.cc:348] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P 03a745005d7a48c3af4f58e81ea47f49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03a745005d7a48c3af4f58e81ea47f49" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 42613 } } peers { permanent_uuid: "ffab030598d24f90a352324d30d538a8" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 42287 } } peers { permanent_uuid: "b14eb3a1e02e4c89b0538d0fe446adbf" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 43911 } }
I20260812 17:45:34.367182 8640 raft_consensus.cc:374] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P 03a745005d7a48c3af4f58e81ea47f49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:45:34.367779 8640 raft_consensus.cc:729] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P 03a745005d7a48c3af4f58e81ea47f49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03a745005d7a48c3af4f58e81ea47f49, State: Initialized, Role: FOLLOWER
I20260812 17:45:34.370321 8643 tablet_bootstrap.cc:492] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P ffab030598d24f90a352324d30d538a8: No bootstrap required, opened a new log
I20260812 17:45:34.370635 8643 ts_tablet_manager.cc:1397] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P ffab030598d24f90a352324d30d538a8: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.003s
I20260812 17:45:34.374977 8643 raft_consensus.cc:348] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P ffab030598d24f90a352324d30d538a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03a745005d7a48c3af4f58e81ea47f49" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 42613 } } peers { permanent_uuid: "ffab030598d24f90a352324d30d538a8" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 42287 } } peers { permanent_uuid: "b14eb3a1e02e4c89b0538d0fe446adbf" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 43911 } }
I20260812 17:45:34.375310 8643 raft_consensus.cc:374] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P ffab030598d24f90a352324d30d538a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:45:34.375378 8643 raft_consensus.cc:729] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P ffab030598d24f90a352324d30d538a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffab030598d24f90a352324d30d538a8, State: Initialized, Role: FOLLOWER
I20260812 17:45:34.375976 8643 consensus_queue.cc:260] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P ffab030598d24f90a352324d30d538a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03a745005d7a48c3af4f58e81ea47f49" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 42613 } } peers { permanent_uuid: "ffab030598d24f90a352324d30d538a8" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 42287 } } peers { permanent_uuid: "b14eb3a1e02e4c89b0538d0fe446adbf" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 43911 } }
I20260812 17:45:34.376822 8324 heartbeater.cc:503] Master 127.17.255.62:39855 was elected leader, sending a full tablet report...
I20260812 17:45:34.377336 8643 ts_tablet_manager.cc:1428] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P ffab030598d24f90a352324d30d538a8: Time spent starting tablet: real 0.007s user 0.000s sys 0.006s
I20260812 17:45:34.377885 8640 consensus_queue.cc:260] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P 03a745005d7a48c3af4f58e81ea47f49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03a745005d7a48c3af4f58e81ea47f49" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 42613 } } peers { permanent_uuid: "ffab030598d24f90a352324d30d538a8" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 42287 } } peers { permanent_uuid: "b14eb3a1e02e4c89b0538d0fe446adbf" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 43911 } }
I20260812 17:45:34.379299 8640 ts_tablet_manager.cc:1428] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P 03a745005d7a48c3af4f58e81ea47f49: Time spent starting tablet: real 0.018s user 0.007s sys 0.000s
I20260812 17:45:34.379693 8585 heartbeater.cc:503] Master 127.17.255.62:39855 was elected leader, sending a full tablet report...
I20260812 17:45:34.401650 8654 raft_consensus.cc:482] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P 03a745005d7a48c3af4f58e81ea47f49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:45:34.401960 8654 raft_consensus.cc:504] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P 03a745005d7a48c3af4f58e81ea47f49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03a745005d7a48c3af4f58e81ea47f49" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 42613 } } peers { permanent_uuid: "ffab030598d24f90a352324d30d538a8" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 42287 } } peers { permanent_uuid: "b14eb3a1e02e4c89b0538d0fe446adbf" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 43911 } }
I20260812 17:45:34.403412 8654 leader_election.cc:288] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P 03a745005d7a48c3af4f58e81ea47f49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ffab030598d24f90a352324d30d538a8 (127.17.255.2:42287), b14eb3a1e02e4c89b0538d0fe446adbf (127.17.255.1:43911)
I20260812 17:45:34.409618 8636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:34.403901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:55873 (local address 127.17.255.2:42287)
0812 17:45:34.404049 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:34.404057 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:34.404370 (+ 313us) server_negotiation.cc:407] Connection header received
0812 17:45:34.404638 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:34.404642 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:34.404705 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:34.404767 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:45:34.405394 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:34.406228 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:34.408219 (+ 1991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:34.408820 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:34.408920 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:34.408975 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:34.409369 (+ 394us) server_negotiation.cc:299] Negotiation successful
0812 17:45:34.409456 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 17:45:34.410326 8656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:34.403645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:42287 (local address 127.17.255.3:55873)
0812 17:45:34.404247 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:34.404264 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 17:45:34.404476 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:45:34.404954 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:45:34.404957 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:45:34.404980 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:45:34.405219 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:34.405230 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:34.406421 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:34.406424 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:34.408050 (+ 1626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:34.408062 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:34.409067 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:34.409070 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:34.409230 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:34.409252 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 17:45:34.410048 (+ 796us) client_negotiation.cc:240] Negotiation successful
0812 17:45:34.410133 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":526,"mutex_wait_us":20,"thread_start_us":234,"threads_started":1}
I20260812 17:45:34.411127 8633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:34.404652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:46803 (local address 127.17.255.1:43911)
0812 17:45:34.404791 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:34.404809 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:34.405206 (+ 397us) server_negotiation.cc:407] Connection header received
0812 17:45:34.405421 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:34.405425 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:34.405479 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:34.405531 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:45:34.405962 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:34.406770 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:34.409603 (+ 2833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:34.410189 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:34.410318 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:34.410428 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:34.410953 (+ 525us) server_negotiation.cc:299] Negotiation successful
0812 17:45:34.411035 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 17:45:34.411365 8229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ad37f6e841a4361aa5b72c98c5ad4e8" candidate_uuid: "03a745005d7a48c3af4f58e81ea47f49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffab030598d24f90a352324d30d538a8" is_pre_election: true
I20260812 17:45:34.411581 8657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:34.404242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:43911 (local address 127.17.255.3:46803)
0812 17:45:34.404970 (+ 728us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:34.404984 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 17:45:34.405282 (+ 298us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:45:34.405675 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:45:34.405677 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:45:34.405696 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:45:34.405832 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:34.405839 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:34.406933 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:34.406936 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:34.409464 (+ 2528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:34.409473 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:34.410539 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:34.410542 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:34.410805 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:34.410830 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 17:45:34.411355 (+ 525us) client_negotiation.cc:240] Negotiation successful
0812 17:45:34.411428 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":661,"mutex_wait_us":31,"thread_start_us":101,"threads_started":1}
I20260812 17:45:34.411813 8229 raft_consensus.cc:2454] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P ffab030598d24f90a352324d30d538a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03a745005d7a48c3af4f58e81ea47f49 in term 0.
I20260812 17:45:34.412410 7970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ad37f6e841a4361aa5b72c98c5ad4e8" candidate_uuid: "03a745005d7a48c3af4f58e81ea47f49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b14eb3a1e02e4c89b0538d0fe446adbf" is_pre_election: true
I20260812 17:45:34.412451 8375 leader_election.cc:302] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P 03a745005d7a48c3af4f58e81ea47f49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03a745005d7a48c3af4f58e81ea47f49, ffab030598d24f90a352324d30d538a8; no voters:
I20260812 17:45:34.412781 7970 raft_consensus.cc:2454] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P b14eb3a1e02e4c89b0538d0fe446adbf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03a745005d7a48c3af4f58e81ea47f49 in term 0.
I20260812 17:45:34.412802 8654 raft_consensus.cc:2781] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P 03a745005d7a48c3af4f58e81ea47f49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 17:45:34.412890 8654 raft_consensus.cc:482] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P 03a745005d7a48c3af4f58e81ea47f49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 17:45:34.412932 8654 raft_consensus.cc:3037] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P 03a745005d7a48c3af4f58e81ea47f49 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:45:34.414361 8654 raft_consensus.cc:504] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P 03a745005d7a48c3af4f58e81ea47f49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03a745005d7a48c3af4f58e81ea47f49" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 42613 } } peers { permanent_uuid: "ffab030598d24f90a352324d30d538a8" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 42287 } } peers { permanent_uuid: "b14eb3a1e02e4c89b0538d0fe446adbf" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 43911 } }
I20260812 17:45:34.414804 8654 leader_election.cc:288] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P 03a745005d7a48c3af4f58e81ea47f49 [CANDIDATE]: Term 1 election: Requested vote from peers ffab030598d24f90a352324d30d538a8 (127.17.255.2:42287), b14eb3a1e02e4c89b0538d0fe446adbf (127.17.255.1:43911)
I20260812 17:45:34.415244 8229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ad37f6e841a4361aa5b72c98c5ad4e8" candidate_uuid: "03a745005d7a48c3af4f58e81ea47f49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffab030598d24f90a352324d30d538a8"
I20260812 17:45:34.415305 7970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ad37f6e841a4361aa5b72c98c5ad4e8" candidate_uuid: "03a745005d7a48c3af4f58e81ea47f49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b14eb3a1e02e4c89b0538d0fe446adbf"
I20260812 17:45:34.415397 8229 raft_consensus.cc:3037] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P ffab030598d24f90a352324d30d538a8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:45:34.415449 7970 raft_consensus.cc:3037] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P b14eb3a1e02e4c89b0538d0fe446adbf [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:45:34.416757 8229 raft_consensus.cc:2454] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P ffab030598d24f90a352324d30d538a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03a745005d7a48c3af4f58e81ea47f49 in term 1.
I20260812 17:45:34.416991 7970 raft_consensus.cc:2454] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P b14eb3a1e02e4c89b0538d0fe446adbf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03a745005d7a48c3af4f58e81ea47f49 in term 1.
I20260812 17:45:34.417237 8375 leader_election.cc:302] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P 03a745005d7a48c3af4f58e81ea47f49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03a745005d7a48c3af4f58e81ea47f49, ffab030598d24f90a352324d30d538a8; no voters:
I20260812 17:45:34.417560 8654 raft_consensus.cc:2781] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P 03a745005d7a48c3af4f58e81ea47f49 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:45:34.417807 8654 raft_consensus.cc:686] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P 03a745005d7a48c3af4f58e81ea47f49 [term 1 LEADER]: Becoming Leader. State: Replica: 03a745005d7a48c3af4f58e81ea47f49, State: Running, Role: LEADER
I20260812 17:45:34.418211 8654 consensus_queue.cc:237] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P 03a745005d7a48c3af4f58e81ea47f49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03a745005d7a48c3af4f58e81ea47f49" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 42613 } } peers { permanent_uuid: "ffab030598d24f90a352324d30d538a8" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 42287 } } peers { permanent_uuid: "b14eb3a1e02e4c89b0538d0fe446adbf" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 43911 } }
I20260812 17:45:34.422191 7703 catalog_manager.cc:5495] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P 03a745005d7a48c3af4f58e81ea47f49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 03a745005d7a48c3af4f58e81ea47f49 (127.17.255.3). New cstate: current_term: 1 leader_uuid: "03a745005d7a48c3af4f58e81ea47f49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03a745005d7a48c3af4f58e81ea47f49" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 42613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ffab030598d24f90a352324d30d538a8" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 42287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b14eb3a1e02e4c89b0538d0fe446adbf" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 43911 } health_report { overall_health: UNKNOWN } } }
I20260812 17:45:34.446077 8627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:34.440488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51670 (local address 127.17.255.3:42613)
0812 17:45:34.440621 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:34.440625 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:34.440639 (+ 14us) server_negotiation.cc:407] Connection header received
0812 17:45:34.440732 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:34.440735 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:34.440807 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:34.440917 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:45:34.441412 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:34.442221 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:34.443540 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:34.443886 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:34.443986 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:34.444460 (+ 474us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:45:34.445088 (+ 628us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:45:34.445208 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:34.445846 (+ 638us) server_negotiation.cc:299] Negotiation successful
0812 17:45:34.445924 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 17:45:34.454409 8229 raft_consensus.cc:1261] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P ffab030598d24f90a352324d30d538a8 [term 1 FOLLOWER]: Refusing update from remote peer 03a745005d7a48c3af4f58e81ea47f49: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:45:34.454411 7970 raft_consensus.cc:1261] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P b14eb3a1e02e4c89b0538d0fe446adbf [term 1 FOLLOWER]: Refusing update from remote peer 03a745005d7a48c3af4f58e81ea47f49: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260812 17:45:34.454675 8057 tablet.cc:2369] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P b14eb3a1e02e4c89b0538d0fe446adbf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 17:45:34.455415 8659 consensus_queue.cc:1035] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P 03a745005d7a48c3af4f58e81ea47f49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffab030598d24f90a352324d30d538a8" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 42287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:45:34.455711 8654 consensus_queue.cc:1035] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P 03a745005d7a48c3af4f58e81ea47f49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b14eb3a1e02e4c89b0538d0fe446adbf" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 43911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:45:34.466622 8666 mvcc.cc:205] Tried to move back new op lower bound from 7317736384314822656 to 7317736384180273152. Current Snapshot: MvccSnapshot[applied={T|T < 7317736384314822656}]
I20260812 17:45:34.475144 8670 mvcc.cc:205] Tried to move back new op lower bound from 7317736384314822656 to 7317736384180273152. Current Snapshot: MvccSnapshot[applied={T|T < 7317736384314822656}]
I20260812 17:45:34.488637 7703 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45868:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:45:34.488859 7703 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45868:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:45:34.494721 7703 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2ef48902e82b4e5abcbe7f3b9dcce81a: Sending DeleteTablet for 3 replicas of tablet 2ad37f6e841a4361aa5b72c98c5ad4e8
I20260812 17:45:34.495837 7937 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ad37f6e841a4361aa5b72c98c5ad4e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:45:34 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:51878
I20260812 17:45:34.497200 8465 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ad37f6e841a4361aa5b72c98c5ad4e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:45:34 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:51668
I20260812 17:45:34.498183 8188 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ad37f6e841a4361aa5b72c98c5ad4e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:45:34 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:55970
I20260812 17:45:34.498994 7937 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ad37f6e841a4361aa5b72c98c5ad4e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:45:34 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:51878
I20260812 17:45:34.500203 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 7771
I20260812 17:45:34.526638 8691 tablet_replica.cc:330] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P 03a745005d7a48c3af4f58e81ea47f49: stopping tablet replica
I20260812 17:45:34.527014 8693 tablet_replica.cc:330] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P ffab030598d24f90a352324d30d538a8: stopping tablet replica
I20260812 17:45:34.527523 8693 raft_consensus.cc:2229] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P ffab030598d24f90a352324d30d538a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:45:34.527958 8691 raft_consensus.cc:2229] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P 03a745005d7a48c3af4f58e81ea47f49 [term 1 LEADER]: Raft consensus shutting down.
I20260812 17:45:34.535383 8693 raft_consensus.cc:2258] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P ffab030598d24f90a352324d30d538a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:45:34.534829 8691 raft_consensus.cc:2258] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P 03a745005d7a48c3af4f58e81ea47f49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:45:34.538908 8693 ts_tablet_manager.cc:1905] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P ffab030598d24f90a352324d30d538a8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:45:34.542152 8693 ts_tablet_manager.cc:1918] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P ffab030598d24f90a352324d30d538a8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 17:45:34.543159 8691 ts_tablet_manager.cc:1905] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P 03a745005d7a48c3af4f58e81ea47f49: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 17:45:34.546237 7670 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.255.1:43911 (error 108)
I20260812 17:45:34.547049 8693 log.cc:1196] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P ffab030598d24f90a352324d30d538a8: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-1/wal/wals/2ad37f6e841a4361aa5b72c98c5ad4e8
I20260812 17:45:34.547613 8693 ts_tablet_manager.cc:1939] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P ffab030598d24f90a352324d30d538a8: Deleting consensus metadata
I20260812 17:45:34.548399 8691 ts_tablet_manager.cc:1918] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P 03a745005d7a48c3af4f58e81ea47f49: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 17:45:34.550127 7670 catalog_manager.cc:4841] TS ffab030598d24f90a352324d30d538a8 (127.17.255.2:42287): tablet 2ad37f6e841a4361aa5b72c98c5ad4e8 (table test-table [id=d9ff2bda6d7a4f77a0fa00705ac4f5bc]) successfully deleted
I20260812 17:45:34.550515 8691 log.cc:1196] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P 03a745005d7a48c3af4f58e81ea47f49: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786556557564181-18428-0/minicluster-data/ts-2/wal/wals/2ad37f6e841a4361aa5b72c98c5ad4e8
I20260812 17:45:34.550652 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 8065
I20260812 17:45:34.550994 8691 ts_tablet_manager.cc:1939] T 2ad37f6e841a4361aa5b72c98c5ad4e8 P 03a745005d7a48c3af4f58e81ea47f49: Deleting consensus metadata
I20260812 17:45:34.552163 7682 catalog_manager.cc:4841] TS 03a745005d7a48c3af4f58e81ea47f49 (127.17.255.3:42613): tablet 2ad37f6e841a4361aa5b72c98c5ad4e8 (table test-table [id=d9ff2bda6d7a4f77a0fa00705ac4f5bc]) successfully deleted
I20260812 17:45:34.576628 8632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:34.556656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:43911 (local address 127.0.0.1:51884)
0812 17:45:34.576298 (+ 19642us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:34.576464 (+ 166us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.1:43911: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19463}
Aug 12 17:45:34 dist-test-slave-tk9z krb5kdc[5826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556733, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for HTTP/127.17.255.20@KRBTEST.COM
W20260812 17:45:34.581243 7670 catalog_manager.cc:4584] TS b14eb3a1e02e4c89b0538d0fe446adbf (127.17.255.1:43911): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2ad37f6e841a4361aa5b72c98c5ad4e8: Network error: Client connection negotiation failed: client connection to 127.17.255.1:43911: connect: Connection refused (error 111)
I20260812 17:45:34.602717 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 8328
I20260812 17:45:34.623987 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 7636
I20260812 17:45:34.660606 18428 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260812 17:45:35.006070 18428 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260812 17:45:35.006197 18428 mini_ranger.cc:66] Stopping Ranger...
I20260812 17:45:35.362478 18428 mini_ranger.cc:68] Stopped Ranger
2026-08-12 17:45:35.362 UTC [5884] LOG: received smart shutdown request
2026-08-12 17:45:35.367 UTC [5884] LOG: background worker "logical replication launcher" (PID 5894) exited with exit code 1
2026-08-12 17:45:35.368 UTC [5888] LOG: shutting down
2026-08-12 17:45:35.559 UTC [5884] LOG: database system is shut down
2026-08-12T17:45:35Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (53793 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:45:35 dist-test-slave-tk9z krb5kdc[8708](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:45:35 dist-test-slave-tk9z krb5kdc[8708](info): set up 2 sockets
Aug 12 17:45:35 dist-test-slave-tk9z krb5kdc[8708](info): commencing operation
krb5kdc: starting...
W20260812 17:45:37.050592 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.343s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:45:37 dist-test-slave-tk9z krb5kdc[8708](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556737, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:45:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:45:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.255.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
I20260812 17:45:37.190500 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:38239
--webserver_interface=127.17.255.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:41975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:38239,127.17.255.61:42855,127.17.255.60:37745
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:45:37.308408 8733 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:45:37.308763 8733 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:45:37.308847 8733 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:45:37.312999 8733 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:45:37.313088 8733 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:45:37.313128 8733 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:45:37.313184 8733 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:45:37.313223 8733 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:45:37.318653 8733 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:41975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:38239,127.17.255.61:42855,127.17.255.60:37745
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:38239
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8733
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:45:37.319856 8733 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:45:37.320958 8733 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:45:37.329572 8743 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:45:37.329595 8740 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:45:37.329713 8733 server_base.cc:1034] running on GCE node
W20260812 17:45:37.329599 8741 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:45:37.330542 8733 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:45:37.331640 8733 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:45:37.332820 8733 hybrid_clock.cc:648] HybridClock initialized: now 1786556737332804 us; error 32 us; skew 500 ppm
Aug 12 17:45:37 dist-test-slave-tk9z krb5kdc[8708](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556737, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:45:37.335868 8733 init.cc:377] Logged in from keytab as kudu/127.17.255.62@KRBTEST.COM (short username kudu)
I20260812 17:45:37.336858 8733 webserver.cc:460] Webserver started at http://127.17.255.62:41891/ using document root <none> and password file <none>
I20260812 17:45:37.337462 8733 fs_manager.cc:359] Metadata directory not provided
I20260812 17:45:37.337558 8733 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:45:37.337802 8733 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:45:37.340035 8733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "7b04cbc1b96848edb0696ac8f31c00fe"
format_stamp: "Formatted at 2026-08-12 17:45:37 on dist-test-slave-tk9z"
server_key: "b5351f652e5cc80a23098e3df3e9aab7"
server_key_iv: "343009dc4bd1f1686047cf5456f1f35f"
server_key_version: "encryptionkey@0"
I20260812 17:45:37.340636 8733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "7b04cbc1b96848edb0696ac8f31c00fe"
format_stamp: "Formatted at 2026-08-12 17:45:37 on dist-test-slave-tk9z"
server_key: "b5351f652e5cc80a23098e3df3e9aab7"
server_key_iv: "343009dc4bd1f1686047cf5456f1f35f"
server_key_version: "encryptionkey@0"
I20260812 17:45:37.344583 8733 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 17:45:37.347074 8757 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:37.348489 8733 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:45:37.348635 8733 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "7b04cbc1b96848edb0696ac8f31c00fe"
format_stamp: "Formatted at 2026-08-12 17:45:37 on dist-test-slave-tk9z"
server_key: "b5351f652e5cc80a23098e3df3e9aab7"
server_key_iv: "343009dc4bd1f1686047cf5456f1f35f"
server_key_version: "encryptionkey@0"
I20260812 17:45:37.348752 8733 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:45:37.394836 8733 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:45:37.398552 8733 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:45:37.398773 8733 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:45:37.406540 8733 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:38239
I20260812 17:45:37.406668 8856 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:38239 every 8 connection(s)
I20260812 17:45:37.407709 8733 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:45:37.408897 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 8733
I20260812 17:45:37.409057 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:45:37.409353 18428 external_mini_cluster.cc:1428] Setting key 9f1f354f0476e2200923a417d9c3809d
I20260812 17:45:37.411136 8859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:45:37.415344 8859 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.255.62" port: 38239 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.17.255.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.61@KRBTEST.COM" created.
Aug 12 17:45:37 dist-test-slave-tk9z krb5kdc[8708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556737, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:45:37.433275 8864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:37.417977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:38239 (local address 127.0.0.1:53592)
0812 17:45:37.418651 (+ 674us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:37.418700 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 17:45:37.419573 (+ 873us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:45:37.420439 (+ 866us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:45:37.420443 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:45:37.420774 (+ 331us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:45:37.421182 (+ 408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:37.421208 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.423049 (+ 1841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.423054 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:37.424356 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:37.424371 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.425081 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.425088 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:37.425262 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:37.425899 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:45:37.425927 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:45:37.427781 (+ 1854us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:45:37.429897 (+ 2116us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:37.429906 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:37.429917 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:37.430152 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:37.430545 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:37.430549 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:37.430551 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:37.430670 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:37.431366 (+ 696us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:45:37.431374 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:45:37.431540 (+ 166us) client_negotiation.cc:769] Sending connection context
0812 17:45:37.431746 (+ 206us) client_negotiation.cc:240] Negotiation successful
0812 17:45:37.432197 (+ 451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":480,"mutex_wait_us":130,"spinlock_wait_cycles":30592,"thread_start_us":190,"threads_started":1}
I20260812 17:45:37.433275 8862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:37.417976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53592 (local address 127.17.255.62:38239)
0812 17:45:37.418507 (+ 531us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:37.418523 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:37.418847 (+ 324us) server_negotiation.cc:407] Connection header received
0812 17:45:37.419894 (+ 1047us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:37.419899 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:37.420184 (+ 285us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:37.420393 (+ 209us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:45:37.421386 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.422872 (+ 1486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.424520 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.424905 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.425036 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:37.428058 (+ 3022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:45:37.428064 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:45:37.428076 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:45:37.428099 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:45:37.429768 (+ 1669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:37.430275 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:37.430285 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:37.430286 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:37.430451 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:37.430766 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:37.430770 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:37.430771 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:37.431251 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:45:37.431428 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:37.431814 (+ 386us) server_negotiation.cc:299] Negotiation successful
0812 17:45:37.432145 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":366,"thread_start_us":184,"threads_started":1}
I20260812 17:45:37.436065 8859 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42855 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.61.keytab.
Entry for principal kudu/127.17.255.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.61.keytab.
I20260812 17:45:37.436957 8864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:37.436599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.61:42855 (local address 127.0.0.1:36438)
0812 17:45:37.436748 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:37.436844 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.61:42855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260812 17:45:37.437189 8764 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.255.61:42855: connect: Connection refused (error 111)
I20260812 17:45:37.437739 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.61:42855
--webserver_interface=127.17.255.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.61.keytab
--principal=kudu/127.17.255.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:41975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:38239,127.17.255.61:42855,127.17.255.60:37745
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 17:45:37.438153 8864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:37.437890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.61:42855 (local address 127.0.0.1:36452)
0812 17:45:37.438055 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:37.438094 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.61:42855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
W20260812 17:45:37.438359 8859 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.255.61:42855: Network error: Client connection negotiation failed: client connection to 127.17.255.61:42855: connect: Connection refused (error 111)
I20260812 17:45:37.487725 8859 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42855 } attempt: 1
I20260812 17:45:37.488725 8864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:37.488365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.61:42855 (local address 127.0.0.1:36466)
0812 17:45:37.488551 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:37.488628 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.61:42855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260812 17:45:37.489641 8864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:37.489399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.61:42855 (local address 127.0.0.1:36482)
0812 17:45:37.489513 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:37.489569 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.61:42855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260812 17:45:37.489859 8859 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.255.61:42855: Network error: Client connection negotiation failed: client connection to 127.17.255.61:42855: connect: Connection refused (error 111)
W20260812 17:45:37.557621 8869 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:45:37.557950 8869 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:45:37.558022 8869 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260812 17:45:37.558074 8859 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42855 } attempt: 2
I20260812 17:45:37.559161 8864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:37.558771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.61:42855 (local address 127.0.0.1:36498)
0812 17:45:37.558998 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:37.559071 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.61:42855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260812 17:45:37.560050 8864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:37.559775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.61:42855 (local address 127.0.0.1:36506)
0812 17:45:37.559926 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:37.559983 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.61:42855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260812 17:45:37.560233 8859 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.255.61:42855: Network error: Client connection negotiation failed: client connection to 127.17.255.61:42855: connect: Connection refused (error 111)
W20260812 17:45:37.563050 8869 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:45:37.563119 8869 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:45:37.563141 8869 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:45:37.563159 8869 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:45:37.563206 8869 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:45:37.569360 8869 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:41975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:38239,127.17.255.61:42855,127.17.255.60:37745
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.61.keytab
--principal=kudu/127.17.255.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.61:42855
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.17.255.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8869
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:45:37.570689 8869 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:45:37.571772 8869 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:45:37.580520 8882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:45:37.580555 8881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:45:37.580536 8887 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:45:37.580788 8869 server_base.cc:1034] running on GCE node
I20260812 17:45:37.581456 8869 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:45:37.582615 8869 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:45:37.583779 8869 hybrid_clock.cc:648] HybridClock initialized: now 1786556737583767 us; error 38 us; skew 500 ppm
Aug 12 17:45:37 dist-test-slave-tk9z krb5kdc[8708](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556737, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:45:37.586823 8869 init.cc:377] Logged in from keytab as kudu/127.17.255.61@KRBTEST.COM (short username kudu)
I20260812 17:45:37.587741 8869 webserver.cc:460] Webserver started at http://127.17.255.61:41037/ using document root <none> and password file <none>
I20260812 17:45:37.588474 8869 fs_manager.cc:359] Metadata directory not provided
I20260812 17:45:37.588555 8869 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:45:37.588750 8869 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:45:37.591140 8869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-1/data/instance:
uuid: "a5aa6b18ed8745bfabc3390003a0f5a4"
format_stamp: "Formatted at 2026-08-12 17:45:37 on dist-test-slave-tk9z"
server_key: "e3058f07bbaf541b0e5a201e08530651"
server_key_iv: "ecff1f9630d97f6e18b8f2c456afafd0"
server_key_version: "encryptionkey@0"
I20260812 17:45:37.591735 8869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-1/wal/instance:
uuid: "a5aa6b18ed8745bfabc3390003a0f5a4"
format_stamp: "Formatted at 2026-08-12 17:45:37 on dist-test-slave-tk9z"
server_key: "e3058f07bbaf541b0e5a201e08530651"
server_key_iv: "ecff1f9630d97f6e18b8f2c456afafd0"
server_key_version: "encryptionkey@0"
I20260812 17:45:37.595985 8869 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 17:45:37.598927 8904 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:37.600471 8869 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:45:37.600646 8869 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-1/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-1/wal
uuid: "a5aa6b18ed8745bfabc3390003a0f5a4"
format_stamp: "Formatted at 2026-08-12 17:45:37 on dist-test-slave-tk9z"
server_key: "e3058f07bbaf541b0e5a201e08530651"
server_key_iv: "ecff1f9630d97f6e18b8f2c456afafd0"
server_key_version: "encryptionkey@0"
I20260812 17:45:37.600776 8869 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:45:37.622787 8869 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:45:37.626775 8869 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:45:37.627010 8869 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:45:37.634629 8869 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.61:42855
I20260812 17:45:37.634647 9005 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.61:42855 every 8 connection(s)
I20260812 17:45:37.635744 8869 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-1/data/info.pb
I20260812 17:45:37.636018 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 8869
I20260812 17:45:37.636183 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-1/wal/instance
I20260812 17:45:37.636566 18428 external_mini_cluster.cc:1428] Setting key c92fa52d91857e3124700a3422792c7b
I20260812 17:45:37.639477 9009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:45:37.645961 9009 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.255.62" port: 38239 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.17.255.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.60@KRBTEST.COM" created.
I20260812 17:45:37.651530 8859 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42855 } attempt: 3
Aug 12 17:45:37 dist-test-slave-tk9z krb5kdc[8708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556737, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.61@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
Aug 12 17:45:37 dist-test-slave-tk9z krb5kdc[8708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556737, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for kudu/127.17.255.61@KRBTEST.COM
I20260812 17:45:37.664989 8864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:37.652046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.61:42855 (local address 127.0.0.1:36510)
0812 17:45:37.652259 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:37.652277 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 17:45:37.652370 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:45:37.653482 (+ 1112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:45:37.653486 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:45:37.653704 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:45:37.653854 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:37.653891 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.655534 (+ 1643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.655540 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:37.656497 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:37.656513 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.657401 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.657405 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:37.657525 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:37.658050 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:45:37.658067 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:45:37.660435 (+ 2368us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:45:37.662920 (+ 2485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:37.662923 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:37.662925 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:37.663256 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:37.663670 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:37.663674 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:37.663675 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:37.663809 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:37.664431 (+ 622us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:45:37.664434 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:45:37.664545 (+ 111us) client_negotiation.cc:769] Sending connection context
0812 17:45:37.664663 (+ 118us) client_negotiation.cc:240] Negotiation successful
0812 17:45:37.664803 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118}
I20260812 17:45:37.665726 8862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:37.649023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53602 (local address 127.17.255.62:38239)
0812 17:45:37.649202 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:37.649207 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:37.650483 (+ 1276us) server_negotiation.cc:407] Connection header received
0812 17:45:37.651633 (+ 1150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:37.651637 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:37.651707 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:37.651799 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:45:37.653850 (+ 2051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.654552 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.656019 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.656276 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.656390 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:37.660003 (+ 3613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:45:37.660007 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:45:37.660009 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:45:37.660044 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:45:37.661628 (+ 1584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:37.662548 (+ 920us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:37.662553 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:37.662556 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:37.662659 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:37.663189 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:37.663217 (+ 28us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:37.663222 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:37.663542 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:45:37.663645 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:37.665384 (+ 1739us) server_negotiation.cc:299] Negotiation successful
0812 17:45:37.665588 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66,"spinlock_wait_cycles":896}
I20260812 17:45:37.665884 9018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:37.649566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:38239 (local address 127.0.0.1:53602)
0812 17:45:37.650219 (+ 653us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:37.650301 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0812 17:45:37.651393 (+ 1092us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:45:37.652081 (+ 688us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:45:37.652093 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:45:37.652754 (+ 661us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:45:37.653659 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:37.653685 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.654663 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.654667 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:37.655887 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:37.655896 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.656457 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.656461 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:37.656701 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:37.657496 (+ 795us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:45:37.657525 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:45:37.659825 (+ 2300us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:45:37.661780 (+ 1955us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:37.661793 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:37.661812 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:37.662338 (+ 526us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:37.662774 (+ 436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:37.662777 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:37.662778 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:37.663037 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:37.663679 (+ 642us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:45:37.663688 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:45:37.664103 (+ 415us) client_negotiation.cc:769] Sending connection context
0812 17:45:37.664280 (+ 177us) client_negotiation.cc:240] Negotiation successful
0812 17:45:37.664718 (+ 438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":370,"mutex_wait_us":151,"thread_start_us":160,"threads_started":1}
I20260812 17:45:37.665886 9019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:37.652152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36510 (local address 127.17.255.61:42855)
0812 17:45:37.652673 (+ 521us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:37.652688 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:37.652715 (+ 27us) server_negotiation.cc:407] Connection header received
0812 17:45:37.652770 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:37.652778 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:37.653027 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:37.653507 (+ 480us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:45:37.654035 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.655399 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.656648 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.657170 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.657774 (+ 604us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:37.660657 (+ 2883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:45:37.660667 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:45:37.660688 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:45:37.660726 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:45:37.662800 (+ 2074us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:37.663366 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:37.663373 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:37.663375 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:37.663498 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:37.663971 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:37.663974 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:37.663975 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:37.664240 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:45:37.664415 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:37.664807 (+ 392us) server_negotiation.cc:299] Negotiation successful
0812 17:45:37.665011 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"spinlock_wait_cycles":1280,"thread_start_us":198,"threads_started":1}
I20260812 17:45:37.667532 9009 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42855 } has no permanent_uuid. Determining permanent_uuid...
I20260812 17:45:37.668107 8859 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.255.60" port: 37745 } has no permanent_uuid. Determining permanent_uuid...
I20260812 17:45:37.668865 8864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:37.668539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:37745 (local address 127.0.0.1:39436)
0812 17:45:37.668677 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:37.668737 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.60:37745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260812 17:45:37.669548 8864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:37.669268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:37745 (local address 127.0.0.1:39446)
0812 17:45:37.669447 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:37.669497 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.60:37745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
W20260812 17:45:37.669727 8859 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.255.60:37745: Network error: Client connection negotiation failed: client connection to 127.17.255.60:37745: connect: Connection refused (error 111)
Aug 12 17:45:37 dist-test-slave-tk9z krb5kdc[8708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556737, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.61@KRBTEST.COM for kudu/127.17.255.61@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.60.keytab.
Entry for principal kudu/127.17.255.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.60.keytab.
I20260812 17:45:37.674018 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.60:37745
--webserver_interface=127.17.255.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.60.keytab
--principal=kudu/127.17.255.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:41975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:38239,127.17.255.61:42855,127.17.255.60:37745
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 17:45:37.676671 9019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:37.668323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36520 (local address 127.17.255.61:42855)
0812 17:45:37.668446 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:37.668450 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:37.668461 (+ 11us) server_negotiation.cc:407] Connection header received
0812 17:45:37.668495 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:37.668497 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:37.668529 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:37.668619 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:45:37.669125 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.669853 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.670729 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.670982 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.671088 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:37.673323 (+ 2235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:45:37.673327 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:45:37.673330 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:45:37.673359 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:45:37.675008 (+ 1649us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:37.675431 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:37.675436 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:37.675438 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:37.675528 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:37.675800 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:37.675804 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:37.675806 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:37.676010 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:45:37.676122 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:37.676377 (+ 255us) server_negotiation.cc:299] Negotiation successful
0812 17:45:37.676547 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":84,"server-negotiator.queue_time_us":51}
I20260812 17:45:37.676671 9018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:37.668098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.61:42855 (local address 127.0.0.1:36520)
0812 17:45:37.668255 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:37.668278 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 17:45:37.668363 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:45:37.668663 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:45:37.668667 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:45:37.668864 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:45:37.669001 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:37.669009 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.669971 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.669975 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:37.670613 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:37.670622 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.671085 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.671089 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:37.671213 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:37.671715 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:45:37.671729 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:45:37.673182 (+ 1453us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:45:37.675129 (+ 1947us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:37.675133 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:37.675135 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:37.675334 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:37.675620 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:37.675624 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:37.675626 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:37.675712 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:37.676116 (+ 404us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:45:37.676119 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:45:37.676217 (+ 98us) client_negotiation.cc:769] Sending connection context
0812 17:45:37.676319 (+ 102us) client_negotiation.cc:240] Negotiation successful
0812 17:45:37.676481 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65,"mutex_wait_us":8}
I20260812 17:45:37.677591 9009 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.255.60" port: 37745 } has no permanent_uuid. Determining permanent_uuid...
I20260812 17:45:37.678352 9018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:37.678090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:37745 (local address 127.0.0.1:39448)
0812 17:45:37.678208 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:37.678293 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.60:37745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260812 17:45:37.678643 8912 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.255.60:37745: connect: Connection refused (error 111)
I20260812 17:45:37.679527 9018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:37.679300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:37745 (local address 127.0.0.1:39450)
0812 17:45:37.679411 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:37.679460 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.60:37745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260812 17:45:37.679695 9009 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.255.60:37745: Network error: Client connection negotiation failed: client connection to 127.17.255.60:37745: connect: Connection refused (error 111)
I20260812 17:45:37.700903 8859 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.255.60" port: 37745 } attempt: 1
I20260812 17:45:37.701920 8864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:37.701556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:37745 (local address 127.0.0.1:39462)
0812 17:45:37.701733 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:37.701801 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.60:37745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260812 17:45:37.702754 8864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:37.702520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:37745 (local address 127.0.0.1:39474)
0812 17:45:37.702634 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:37.702688 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.60:37745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260812 17:45:37.702905 8859 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.255.60:37745: Network error: Client connection negotiation failed: client connection to 127.17.255.60:37745: connect: Connection refused (error 111)
I20260812 17:45:37.728971 9009 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.255.60" port: 37745 } attempt: 1
I20260812 17:45:37.730038 9018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:37.729646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:37745 (local address 127.0.0.1:39482)
0812 17:45:37.729832 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:37.729899 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.60:37745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260812 17:45:37.730863 9018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:37.730637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:37745 (local address 127.0.0.1:39496)
0812 17:45:37.730747 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:37.730801 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.60:37745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260812 17:45:37.730995 9009 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.255.60:37745: Network error: Client connection negotiation failed: client connection to 127.17.255.60:37745: connect: Connection refused (error 111)
I20260812 17:45:37.778098 8859 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.255.60" port: 37745 } attempt: 2
I20260812 17:45:37.779156 8864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:37.778823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:37745 (local address 127.0.0.1:39498)
0812 17:45:37.779003 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:37.779071 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.60:37745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260812 17:45:37.780121 8864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:37.779866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:37745 (local address 127.0.0.1:39514)
0812 17:45:37.780001 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:37.780060 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.60:37745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260812 17:45:37.780267 8859 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.255.60:37745: Network error: Client connection negotiation failed: client connection to 127.17.255.60:37745: connect: Connection refused (error 111)
I20260812 17:45:37.799180 9009 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.255.60" port: 37745 } attempt: 2
I20260812 17:45:37.800189 9018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:37.799855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:37745 (local address 127.0.0.1:39524)
0812 17:45:37.800028 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:37.800097 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.60:37745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260812 17:45:37.800969 9018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:37.800720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:37745 (local address 127.0.0.1:39536)
0812 17:45:37.800839 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:37.800904 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.60:37745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260812 17:45:37.801124 9009 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.255.60:37745: Network error: Client connection negotiation failed: client connection to 127.17.255.60:37745: connect: Connection refused (error 111)
W20260812 17:45:37.803253 9021 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:45:37.803581 9021 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:45:37.803685 9021 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:45:37.808153 9021 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:45:37.808241 9021 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:45:37.808279 9021 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:45:37.808331 9021 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:45:37.808384 9021 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:45:37.814148 9021 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:41975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:38239,127.17.255.61:42855,127.17.255.60:37745
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.60.keytab
--principal=kudu/127.17.255.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.60:37745
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.17.255.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9021
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:45:37.815408 9021 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:45:37.816574 9021 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 17:45:37.826574 9021 server_base.cc:1034] running on GCE node
W20260812 17:45:37.826527 9034 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:45:37.826527 9038 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:45:37.826531 9035 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:45:37.827527 9021 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:45:37.828790 9021 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:45:37.829998 9021 hybrid_clock.cc:648] HybridClock initialized: now 1786556737829973 us; error 38 us; skew 500 ppm
Aug 12 17:45:37 dist-test-slave-tk9z krb5kdc[8708](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556737, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:45:37.833628 9021 init.cc:377] Logged in from keytab as kudu/127.17.255.60@KRBTEST.COM (short username kudu)
I20260812 17:45:37.834805 9021 webserver.cc:460] Webserver started at http://127.17.255.60:45921/ using document root <none> and password file <none>
I20260812 17:45:37.835471 9021 fs_manager.cc:359] Metadata directory not provided
I20260812 17:45:37.835568 9021 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:45:37.835815 9021 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:45:37.838096 9021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-2/data/instance:
uuid: "f993d40455284bebabda710a534d6dea"
format_stamp: "Formatted at 2026-08-12 17:45:37 on dist-test-slave-tk9z"
server_key: "3e6ff3eacb12d53eb0684e4f9eddbea4"
server_key_iv: "e292aa874d591d0e64e9af8d95e940b9"
server_key_version: "encryptionkey@0"
I20260812 17:45:37.838975 9021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-2/wal/instance:
uuid: "f993d40455284bebabda710a534d6dea"
format_stamp: "Formatted at 2026-08-12 17:45:37 on dist-test-slave-tk9z"
server_key: "3e6ff3eacb12d53eb0684e4f9eddbea4"
server_key_iv: "e292aa874d591d0e64e9af8d95e940b9"
server_key_version: "encryptionkey@0"
I20260812 17:45:37.843357 9021 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 17:45:37.846076 9051 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:37.847512 9021 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 17:45:37.847667 9021 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-2/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-2/wal
uuid: "f993d40455284bebabda710a534d6dea"
format_stamp: "Formatted at 2026-08-12 17:45:37 on dist-test-slave-tk9z"
server_key: "3e6ff3eacb12d53eb0684e4f9eddbea4"
server_key_iv: "e292aa874d591d0e64e9af8d95e940b9"
server_key_version: "encryptionkey@0"
I20260812 17:45:37.847795 9021 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:45:37.863456 9021 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:45:37.867316 9021 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:45:37.867544 9021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:45:37.875276 9021 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.60:37745
I20260812 17:45:37.875298 9156 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.60:37745 every 8 connection(s)
I20260812 17:45:37.876374 9021 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-2/data/info.pb
I20260812 17:45:37.879571 8859 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.255.60" port: 37745 } attempt: 3
I20260812 17:45:37.880002 9157 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:45:37.882985 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 9021
I20260812 17:45:37.883160 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786556557564181-18428-0/minicluster-data/master-2/wal/instance
I20260812 17:45:37.883471 18428 external_mini_cluster.cc:1428] Setting key 1445d9c0e138ff149a426465b4f7948e
I20260812 17:45:37.885548 9157 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.255.62" port: 38239 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 17:45:37 dist-test-slave-tk9z krb5kdc[8708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556737, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for kudu/127.17.255.60@KRBTEST.COM
Aug 12 17:45:37 dist-test-slave-tk9z krb5kdc[8708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556737, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.255.60@KRBTEST.COM
I20260812 17:45:37.892493 9009 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.255.60" port: 37745 } attempt: 3
Aug 12 17:45:37 dist-test-slave-tk9z krb5kdc[8708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556737, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.60@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:45:37.895889 8864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:37.880217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:37745 (local address 127.0.0.1:39542)
0812 17:45:37.880415 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:37.880434 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 17:45:37.880539 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:45:37.883111 (+ 2572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:45:37.883116 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:45:37.883394 (+ 278us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:45:37.883546 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:37.883556 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.885753 (+ 2197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.885757 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:37.886627 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:37.886641 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.887700 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.887704 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:37.887815 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:37.888474 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:45:37.888491 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:45:37.890632 (+ 2141us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:45:37.893546 (+ 2914us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:37.893549 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:37.893551 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:37.893810 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:37.894313 (+ 503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:37.894317 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:37.894320 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:37.894461 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:37.895361 (+ 900us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:45:37.895365 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:45:37.895464 (+ 99us) client_negotiation.cc:769] Sending connection context
0812 17:45:37.895558 (+ 94us) client_negotiation.cc:240] Negotiation successful
0812 17:45:37.895700 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":86}
I20260812 17:45:37.898100 9164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:37.884142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39548 (local address 127.17.255.60:37745)
0812 17:45:37.884636 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:37.884645 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:37.884660 (+ 15us) server_negotiation.cc:407] Connection header received
0812 17:45:37.884815 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:37.884818 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:37.884862 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:37.884959 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:45:37.886004 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.886828 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.887738 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.888128 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.888223 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:37.891429 (+ 3206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:45:37.891433 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:45:37.891436 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:45:37.891464 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:45:37.894159 (+ 2695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:37.894765 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:37.894770 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:37.894774 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:37.894884 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:37.895231 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:37.895235 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:37.895237 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:37.895445 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:45:37.895646 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:37.896523 (+ 877us) server_negotiation.cc:299] Negotiation successful
0812 17:45:37.896882 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":44,"server-negotiator.queue_time_us":423,"thread_start_us":145,"threads_started":1}
I20260812 17:45:37.898113 9161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:37.881035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39542 (local address 127.17.255.60:37745)
0812 17:45:37.881512 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:37.881529 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:37.881569 (+ 40us) server_negotiation.cc:407] Connection header received
0812 17:45:37.882254 (+ 685us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:37.882273 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:37.882746 (+ 473us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:37.883157 (+ 411us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:45:37.883696 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.885614 (+ 1918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.886760 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.887549 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.887795 (+ 246us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:37.890841 (+ 3046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:45:37.890848 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:45:37.890862 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:45:37.890898 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:45:37.893437 (+ 2539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:37.893957 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:37.893966 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:37.893974 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:37.894164 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:37.894583 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:37.894589 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:37.894594 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:37.895156 (+ 562us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:45:37.895309 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:37.896566 (+ 1257us) server_negotiation.cc:299] Negotiation successful
0812 17:45:37.896987 (+ 421us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":313,"thread_start_us":166,"threads_started":1}
Aug 12 17:45:37 dist-test-slave-tk9z krb5kdc[8708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556737, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.61@KRBTEST.COM for kudu/127.17.255.60@KRBTEST.COM
I20260812 17:45:37.899616 9168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:37.887963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:38239 (local address 127.0.0.1:53606)
0812 17:45:37.888626 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:37.888692 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0812 17:45:37.888845 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:45:37.889216 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:45:37.889223 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:45:37.889702 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:45:37.889839 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:37.889846 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.890810 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.890813 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:37.891833 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:37.891844 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.892422 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.892426 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:37.892557 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:37.893133 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:45:37.893152 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:45:37.895668 (+ 2516us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:45:37.897638 (+ 1970us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:37.897649 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:37.897659 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:37.897984 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:37.898304 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:37.898307 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:37.898309 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:37.898424 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:37.899012 (+ 588us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:45:37.899018 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:45:37.899131 (+ 113us) client_negotiation.cc:769] Sending connection context
0812 17:45:37.899264 (+ 133us) client_negotiation.cc:240] Negotiation successful
0812 17:45:37.899438 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":118,"threads_started":1}
I20260812 17:45:37.900239 8862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:37.888137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53606 (local address 127.17.255.62:38239)
0812 17:45:37.888306 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:37.888312 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:37.888797 (+ 485us) server_negotiation.cc:407] Connection header received
0812 17:45:37.888950 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:37.888966 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:37.889031 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:37.889126 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:45:37.889978 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.890646 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.891989 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.892292 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.892414 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:37.895822 (+ 3408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:45:37.895825 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:45:37.895827 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:45:37.895850 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:45:37.897506 (+ 1656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:37.898101 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:37.898105 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:37.898108 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:37.898198 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:37.898547 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:37.898553 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:37.898554 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:37.898870 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:45:37.898963 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:37.899920 (+ 957us) server_negotiation.cc:299] Negotiation successful
0812 17:45:37.900055 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 17:45:37.901760 9157 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42855 } has no permanent_uuid. Determining permanent_uuid...
I20260812 17:45:37.903650 8859 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b04cbc1b96848edb0696ac8f31c00fe: Bootstrap starting.
I20260812 17:45:37.903694 9171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:37.893355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39552 (local address 127.17.255.60:37745)
0812 17:45:37.893721 (+ 366us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:37.893733 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:37.893748 (+ 15us) server_negotiation.cc:407] Connection header received
0812 17:45:37.893786 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:37.893790 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:37.893845 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:37.894593 (+ 748us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:45:37.894742 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.895583 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.896763 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.897088 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.897597 (+ 509us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:37.899672 (+ 2075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:45:37.899676 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:45:37.899679 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:45:37.899707 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:45:37.901938 (+ 2231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:37.902477 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:37.902484 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:37.902489 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:37.902589 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:37.902905 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:37.902908 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:37.902909 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:37.903084 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:45:37.903164 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:37.903462 (+ 298us) server_negotiation.cc:299] Negotiation successful
0812 17:45:37.903560 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":128,"threads_started":1}
I20260812 17:45:37.903724 9018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:37.892983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:37745 (local address 127.0.0.1:39552)
0812 17:45:37.893103 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:37.893120 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 17:45:37.893203 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:45:37.894034 (+ 831us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:45:37.894041 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:45:37.894273 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:45:37.894452 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:37.894463 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.895729 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.895733 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:37.896601 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:37.896615 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.897244 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.897264 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:37.897363 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:37.897837 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:45:37.897854 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:45:37.899525 (+ 1671us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:45:37.902055 (+ 2530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:37.902059 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:37.902061 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:37.902339 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:37.902692 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:37.902696 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:37.902697 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:37.902799 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:37.903180 (+ 381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:45:37.903183 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:45:37.903303 (+ 120us) client_negotiation.cc:769] Sending connection context
0812 17:45:37.903409 (+ 106us) client_negotiation.cc:240] Negotiation successful
0812 17:45:37.903563 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260812 17:45:37.906157 8859 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7b04cbc1b96848edb0696ac8f31c00fe: Neither blocks nor log segments found. Creating new log.
I20260812 17:45:37.907133 8859 log.cc:824] T 00000000000000000000000000000000 P 7b04cbc1b96848edb0696ac8f31c00fe: Log is configured to *not* fsync() on all Append() calls
I20260812 17:45:37.909574 8859 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b04cbc1b96848edb0696ac8f31c00fe: No bootstrap required, opened a new log
I20260812 17:45:37.910660 9009 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5aa6b18ed8745bfabc3390003a0f5a4: Bootstrap starting.
Aug 12 17:45:37 dist-test-slave-tk9z krb5kdc[8708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556737, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.60@KRBTEST.COM for kudu/127.17.255.61@KRBTEST.COM
Aug 12 17:45:37 dist-test-slave-tk9z krb5kdc[8708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556737, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:45:37.913995 8859 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7b04cbc1b96848edb0696ac8f31c00fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b04cbc1b96848edb0696ac8f31c00fe" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 38239 } } peers { permanent_uuid: "a5aa6b18ed8745bfabc3390003a0f5a4" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42855 } } peers { permanent_uuid: "f993d40455284bebabda710a534d6dea" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 37745 } }
I20260812 17:45:37.914228 8859 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7b04cbc1b96848edb0696ac8f31c00fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:45:37.914276 8859 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7b04cbc1b96848edb0696ac8f31c00fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b04cbc1b96848edb0696ac8f31c00fe, State: Initialized, Role: FOLLOWER
I20260812 17:45:37.914769 9009 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a5aa6b18ed8745bfabc3390003a0f5a4: Neither blocks nor log segments found. Creating new log.
I20260812 17:45:37.915166 8859 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7b04cbc1b96848edb0696ac8f31c00fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b04cbc1b96848edb0696ac8f31c00fe" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 38239 } } peers { permanent_uuid: "a5aa6b18ed8745bfabc3390003a0f5a4" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42855 } } peers { permanent_uuid: "f993d40455284bebabda710a534d6dea" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 37745 } }
I20260812 17:45:37.916033 9009 log.cc:824] T 00000000000000000000000000000000 P a5aa6b18ed8745bfabc3390003a0f5a4: Log is configured to *not* fsync() on all Append() calls
I20260812 17:45:37.916031 9173 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b04cbc1b96848edb0696ac8f31c00fe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b04cbc1b96848edb0696ac8f31c00fe" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 38239 } } peers { permanent_uuid: "a5aa6b18ed8745bfabc3390003a0f5a4" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42855 } } peers { permanent_uuid: "f993d40455284bebabda710a534d6dea" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 37745 } } }
I20260812 17:45:37.916311 9173 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b04cbc1b96848edb0696ac8f31c00fe [sys.catalog]: This master's current role is: FOLLOWER
I20260812 17:45:37.916872 8859 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7b04cbc1b96848edb0696ac8f31c00fe [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:45:37.917759 9019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:37.906866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36536 (local address 127.17.255.61:42855)
0812 17:45:37.907132 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:37.907137 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:37.907151 (+ 14us) server_negotiation.cc:407] Connection header received
0812 17:45:37.907194 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:37.907197 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:37.907251 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:37.907336 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:45:37.907989 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.908797 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.909939 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.910279 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.910359 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:37.912846 (+ 2487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:45:37.912853 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:45:37.912859 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:45:37.912892 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:45:37.914648 (+ 1756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:37.915135 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:37.915139 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:37.915141 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:37.915228 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:37.916692 (+ 1464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:37.916698 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:37.916703 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:37.916988 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:45:37.917074 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:37.917464 (+ 390us) server_negotiation.cc:299] Negotiation successful
0812 17:45:37.917605 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189}
I20260812 17:45:37.918593 9009 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5aa6b18ed8745bfabc3390003a0f5a4: No bootstrap required, opened a new log
I20260812 17:45:37.918601 9168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:37.902311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.61:42855 (local address 127.0.0.1:36536)
0812 17:45:37.902439 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:37.902458 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 17:45:37.902537 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:45:37.907501 (+ 4964us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:45:37.907504 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:45:37.907707 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:45:37.907834 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:37.907844 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.908958 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.908961 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:37.909806 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:37.909817 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.910569 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.910573 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:37.910664 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:37.911196 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:45:37.911216 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:45:37.912661 (+ 1445us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:45:37.914766 (+ 2105us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:37.914770 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:37.914772 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:37.915042 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:37.915628 (+ 586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:37.915632 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:37.915635 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:37.915742 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:37.917155 (+ 1413us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:45:37.917158 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:45:37.917262 (+ 104us) client_negotiation.cc:769] Sending connection context
0812 17:45:37.918187 (+ 925us) client_negotiation.cc:240] Negotiation successful
0812 17:45:37.918344 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260812 17:45:37.919070 8862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:37.907336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53614 (local address 127.17.255.62:38239)
0812 17:45:37.907468 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:37.907473 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:37.907906 (+ 433us) server_negotiation.cc:407] Connection header received
0812 17:45:37.907957 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:37.907961 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:37.908022 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:37.908093 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:45:37.908975 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.909729 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.910854 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.911160 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.911270 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:37.914780 (+ 3510us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:45:37.914783 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:45:37.914786 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:45:37.914815 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:45:37.916523 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:37.917035 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:37.917039 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:37.917040 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:37.917135 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:37.917494 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:37.917497 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:37.917499 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:37.917771 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:45:37.918689 (+ 918us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:37.918780 (+ 91us) server_negotiation.cc:299] Negotiation successful
0812 17:45:37.918910 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":54}
I20260812 17:45:37.919317 9157 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.255.60" port: 37745 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 17:45:37 dist-test-slave-tk9z krb5kdc[8708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556737, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.60@KRBTEST.COM for kudu/127.17.255.60@KRBTEST.COM
I20260812 17:45:37.925545 9009 raft_consensus.cc:348] T 00000000000000000000000000000000 P a5aa6b18ed8745bfabc3390003a0f5a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b04cbc1b96848edb0696ac8f31c00fe" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 38239 } } peers { permanent_uuid: "a5aa6b18ed8745bfabc3390003a0f5a4" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42855 } } peers { permanent_uuid: "f993d40455284bebabda710a534d6dea" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 37745 } }
I20260812 17:45:37.922262 8733 master_runner.cc:186] Error getting master registration for 127.17.255.61:42855: OK, instance_id { permanent_uuid: "a5aa6b18ed8745bfabc3390003a0f5a4" instance_seqno: 1786556737632293 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
Aug 12 17:45:37 dist-test-slave-tk9z krb5kdc[8708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556737, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.255.61@KRBTEST.COM
I20260812 17:45:37.926846 8733 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 17:45:37.929361 9171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:37.919934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39558 (local address 127.17.255.60:37745)
0812 17:45:37.920054 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:37.920058 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:37.920281 (+ 223us) server_negotiation.cc:407] Connection header received
0812 17:45:37.920307 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:37.920309 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:37.920343 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:37.920404 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:45:37.920882 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.921644 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.922728 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.923058 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.923129 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:37.925554 (+ 2425us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:45:37.925561 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:45:37.925565 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:45:37.925595 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:45:37.927544 (+ 1949us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:37.928025 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:37.928031 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:37.928036 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:37.928129 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:37.928446 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:37.928449 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:37.928451 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:37.928669 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:45:37.928746 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:37.929080 (+ 334us) server_negotiation.cc:299] Negotiation successful
0812 17:45:37.929203 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 17:45:37.929814 9168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:37.919838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:37745 (local address 127.0.0.1:39558)
0812 17:45:37.920118 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:37.920133 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 17:45:37.920212 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:45:37.920515 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:45:37.920518 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:45:37.920687 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:45:37.920770 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:37.920776 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.921768 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.921774 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:37.922617 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:37.922628 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.923259 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.923262 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:37.923349 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:37.923818 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:45:37.923834 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:45:37.925404 (+ 1570us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:45:37.927644 (+ 2240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:37.927649 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:37.927652 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:37.927930 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:37.928237 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:37.928243 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:37.928245 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:37.928346 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:37.928831 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:45:37.928836 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:45:37.928923 (+ 87us) client_negotiation.cc:769] Sending connection context
0812 17:45:37.929508 (+ 585us) client_negotiation.cc:240] Negotiation successful
0812 17:45:37.929637 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":96,"threads_started":1}
W20260812 17:45:37.929956 9191 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7b04cbc1b96848edb0696ac8f31c00fe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 17:45:37.930066 9191 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 17:45:37.930186 9009 raft_consensus.cc:374] T 00000000000000000000000000000000 P a5aa6b18ed8745bfabc3390003a0f5a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:45:37.930281 9009 raft_consensus.cc:729] T 00000000000000000000000000000000 P a5aa6b18ed8745bfabc3390003a0f5a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5aa6b18ed8745bfabc3390003a0f5a4, State: Initialized, Role: FOLLOWER
I20260812 17:45:37.930958 9009 consensus_queue.cc:260] T 00000000000000000000000000000000 P a5aa6b18ed8745bfabc3390003a0f5a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b04cbc1b96848edb0696ac8f31c00fe" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 38239 } } peers { permanent_uuid: "a5aa6b18ed8745bfabc3390003a0f5a4" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42855 } } peers { permanent_uuid: "f993d40455284bebabda710a534d6dea" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 37745 } }
I20260812 17:45:37.931560 9200 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5aa6b18ed8745bfabc3390003a0f5a4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b04cbc1b96848edb0696ac8f31c00fe" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 38239 } } peers { permanent_uuid: "a5aa6b18ed8745bfabc3390003a0f5a4" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42855 } } peers { permanent_uuid: "f993d40455284bebabda710a534d6dea" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 37745 } } }
I20260812 17:45:37.931798 9200 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5aa6b18ed8745bfabc3390003a0f5a4 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 17:45:37.932543 9009 sys_catalog.cc:564] T 00000000000000000000000000000000 P a5aa6b18ed8745bfabc3390003a0f5a4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:45:37.933353 9157 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f993d40455284bebabda710a534d6dea: Bootstrap starting.
I20260812 17:45:37.936540 9157 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f993d40455284bebabda710a534d6dea: Neither blocks nor log segments found. Creating new log.
I20260812 17:45:37.937484 9157 log.cc:824] T 00000000000000000000000000000000 P f993d40455284bebabda710a534d6dea: Log is configured to *not* fsync() on all Append() calls
I20260812 17:45:37.940433 9157 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f993d40455284bebabda710a534d6dea: No bootstrap required, opened a new log
I20260812 17:45:37.941696 9019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:37.920877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36552 (local address 127.17.255.61:42855)
0812 17:45:37.920987 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:37.920991 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:37.921265 (+ 274us) server_negotiation.cc:407] Connection header received
0812 17:45:37.921307 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:37.921309 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:37.921370 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:37.921439 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:45:37.922252 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.922997 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.924023 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.924346 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.924455 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:37.927475 (+ 3020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:45:37.927479 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:45:37.927482 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:45:37.927518 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:45:37.929385 (+ 1867us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:37.934512 (+ 5127us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:37.934517 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:37.934519 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:37.934637 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:37.938358 (+ 3721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:37.938363 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:37.938413 (+ 50us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:37.938695 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:45:37.938856 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:37.941378 (+ 2522us) server_negotiation.cc:299] Negotiation successful
0812 17:45:37.941518 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 17:45:37.945274 18428 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 17:45:37.941463 8869 master_runner.cc:186] Error getting master registration for 127.17.255.60:37745: OK, instance_id { permanent_uuid: "f993d40455284bebabda710a534d6dea" instance_seqno: 1786556737873101 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 17:45:37.945461 8869 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 17:45:37.946748 9157 raft_consensus.cc:348] T 00000000000000000000000000000000 P f993d40455284bebabda710a534d6dea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b04cbc1b96848edb0696ac8f31c00fe" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 38239 } } peers { permanent_uuid: "a5aa6b18ed8745bfabc3390003a0f5a4" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42855 } } peers { permanent_uuid: "f993d40455284bebabda710a534d6dea" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 37745 } }
I20260812 17:45:37.947032 9157 raft_consensus.cc:374] T 00000000000000000000000000000000 P f993d40455284bebabda710a534d6dea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:45:37.947093 9157 raft_consensus.cc:729] T 00000000000000000000000000000000 P f993d40455284bebabda710a534d6dea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f993d40455284bebabda710a534d6dea, State: Initialized, Role: FOLLOWER
I20260812 17:45:37.947671 9157 consensus_queue.cc:260] T 00000000000000000000000000000000 P f993d40455284bebabda710a534d6dea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b04cbc1b96848edb0696ac8f31c00fe" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 38239 } } peers { permanent_uuid: "a5aa6b18ed8745bfabc3390003a0f5a4" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42855 } } peers { permanent_uuid: "f993d40455284bebabda710a534d6dea" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 37745 } }
I20260812 17:45:37.949251 9157 sys_catalog.cc:564] T 00000000000000000000000000000000 P f993d40455284bebabda710a534d6dea [sys.catalog]: configured and running, proceeding with master startup.
W20260812 17:45:37.949654 9220 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a5aa6b18ed8745bfabc3390003a0f5a4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 17:45:37.949735 9220 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 17:45:37.950477 9229 sys_catalog.cc:455] T 00000000000000000000000000000000 P f993d40455284bebabda710a534d6dea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b04cbc1b96848edb0696ac8f31c00fe" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 38239 } } peers { permanent_uuid: "a5aa6b18ed8745bfabc3390003a0f5a4" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42855 } } peers { permanent_uuid: "f993d40455284bebabda710a534d6dea" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 37745 } } }
I20260812 17:45:37.950699 9229 sys_catalog.cc:458] T 00000000000000000000000000000000 P f993d40455284bebabda710a534d6dea [sys.catalog]: This master's current role is: FOLLOWER
W20260812 17:45:37.955626 9257 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f993d40455284bebabda710a534d6dea: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 17:45:37.955809 9257 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 17:45:37.959349 9021 master_runner.cc:263] No leader master found from master f993d40455284bebabda710a534d6dea
I20260812 17:45:37.959431 9021 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 17:45:37.959753 9019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:37.947956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36562 (local address 127.17.255.61:42855)
0812 17:45:37.948132 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:37.948137 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:37.950004 (+ 1867us) server_negotiation.cc:407] Connection header received
0812 17:45:37.950261 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:37.950265 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:37.950318 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:37.950441 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:45:37.951473 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.952270 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.953543 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.953885 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.953965 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:37.955940 (+ 1975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:45:37.955944 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:45:37.955946 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:45:37.955972 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:45:37.957763 (+ 1791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:37.958294 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:37.958298 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:37.958300 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:37.958425 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:37.958737 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:37.958741 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:37.958743 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:37.958973 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:45:37.959087 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:37.959439 (+ 352us) server_negotiation.cc:299] Negotiation successful
0812 17:45:37.959574 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260812 17:45:37.960850 9173 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7b04cbc1b96848edb0696ac8f31c00fe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:45:37.961045 9173 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7b04cbc1b96848edb0696ac8f31c00fe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b04cbc1b96848edb0696ac8f31c00fe" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 38239 } } peers { permanent_uuid: "a5aa6b18ed8745bfabc3390003a0f5a4" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42855 } } peers { permanent_uuid: "f993d40455284bebabda710a534d6dea" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 37745 } }
I20260812 17:45:37.962195 9173 leader_election.cc:288] T 00000000000000000000000000000000 P 7b04cbc1b96848edb0696ac8f31c00fe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5aa6b18ed8745bfabc3390003a0f5a4 (127.17.255.61:42855), f993d40455284bebabda710a534d6dea (127.17.255.60:37745)
I20260812 17:45:37.962913 8957 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7b04cbc1b96848edb0696ac8f31c00fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5aa6b18ed8745bfabc3390003a0f5a4" is_pre_election: true
I20260812 17:45:37.963224 8957 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a5aa6b18ed8745bfabc3390003a0f5a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b04cbc1b96848edb0696ac8f31c00fe in term 0.
I20260812 17:45:37.964069 8764 leader_election.cc:302] T 00000000000000000000000000000000 P 7b04cbc1b96848edb0696ac8f31c00fe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b04cbc1b96848edb0696ac8f31c00fe, a5aa6b18ed8745bfabc3390003a0f5a4; no voters:
I20260812 17:45:37.964818 9173 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7b04cbc1b96848edb0696ac8f31c00fe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 17:45:37.964924 9173 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7b04cbc1b96848edb0696ac8f31c00fe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 17:45:37.964821 9097 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7b04cbc1b96848edb0696ac8f31c00fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f993d40455284bebabda710a534d6dea" is_pre_election: true
I20260812 17:45:37.964980 9173 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7b04cbc1b96848edb0696ac8f31c00fe [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:45:37.965143 9097 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f993d40455284bebabda710a534d6dea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b04cbc1b96848edb0696ac8f31c00fe in term 0.
I20260812 17:45:37.966464 9173 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7b04cbc1b96848edb0696ac8f31c00fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b04cbc1b96848edb0696ac8f31c00fe" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 38239 } } peers { permanent_uuid: "a5aa6b18ed8745bfabc3390003a0f5a4" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42855 } } peers { permanent_uuid: "f993d40455284bebabda710a534d6dea" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 37745 } }
I20260812 17:45:37.966851 9171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:37.948727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39560 (local address 127.17.255.60:37745)
0812 17:45:37.948839 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:37.948844 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:37.952098 (+ 3254us) server_negotiation.cc:407] Connection header received
0812 17:45:37.952300 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:37.952304 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:37.952355 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:37.952411 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:45:37.953742 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.954488 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.958760 (+ 4272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.959092 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.959179 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:37.961820 (+ 2641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:45:37.961825 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:45:37.961828 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:45:37.961871 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:45:37.963526 (+ 1655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:37.964459 (+ 933us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:37.964463 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:37.964465 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:37.964562 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:37.965332 (+ 770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:37.965336 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:37.965338 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:37.965571 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:45:37.965679 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:37.966536 (+ 857us) server_negotiation.cc:299] Negotiation successful
0812 17:45:37.966678 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 17:45:37.967161 8957 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7b04cbc1b96848edb0696ac8f31c00fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5aa6b18ed8745bfabc3390003a0f5a4"
I20260812 17:45:37.967294 8957 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a5aa6b18ed8745bfabc3390003a0f5a4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:45:37.968698 8957 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a5aa6b18ed8745bfabc3390003a0f5a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b04cbc1b96848edb0696ac8f31c00fe in term 1.
I20260812 17:45:37.969038 8764 leader_election.cc:302] T 00000000000000000000000000000000 P 7b04cbc1b96848edb0696ac8f31c00fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b04cbc1b96848edb0696ac8f31c00fe, a5aa6b18ed8745bfabc3390003a0f5a4; no voters:
I20260812 17:45:37.969455 9173 leader_election.cc:288] T 00000000000000000000000000000000 P 7b04cbc1b96848edb0696ac8f31c00fe [CANDIDATE]: Term 1 election: Requested vote from peers a5aa6b18ed8745bfabc3390003a0f5a4 (127.17.255.61:42855), f993d40455284bebabda710a534d6dea (127.17.255.60:37745)
I20260812 17:45:37.969555 9173 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7b04cbc1b96848edb0696ac8f31c00fe [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:45:37.969637 9173 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7b04cbc1b96848edb0696ac8f31c00fe [term 1 LEADER]: Becoming Leader. State: Replica: 7b04cbc1b96848edb0696ac8f31c00fe, State: Running, Role: LEADER
I20260812 17:45:37.969805 9097 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7b04cbc1b96848edb0696ac8f31c00fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f993d40455284bebabda710a534d6dea"
I20260812 17:45:37.969916 9097 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f993d40455284bebabda710a534d6dea [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:45:37.970012 9173 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7b04cbc1b96848edb0696ac8f31c00fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b04cbc1b96848edb0696ac8f31c00fe" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 38239 } } peers { permanent_uuid: "a5aa6b18ed8745bfabc3390003a0f5a4" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42855 } } peers { permanent_uuid: "f993d40455284bebabda710a534d6dea" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 37745 } }
I20260812 17:45:37.970417 8862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:37.949457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53618 (local address 127.17.255.62:38239)
0812 17:45:37.949573 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:37.949578 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:37.953657 (+ 4079us) server_negotiation.cc:407] Connection header received
0812 17:45:37.955700 (+ 2043us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:37.955705 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:37.955768 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:37.955823 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:45:37.956878 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.957636 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.959813 (+ 2177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:37.960171 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:37.960255 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:37.966083 (+ 5828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:45:37.966087 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:45:37.966090 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:45:37.966121 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:45:37.968286 (+ 2165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:37.968920 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:37.968925 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:37.968927 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:37.969025 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:37.969354 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:37.969357 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:37.969359 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:37.969585 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:45:37.969706 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:37.970093 (+ 387us) server_negotiation.cc:299] Negotiation successful
0812 17:45:37.970222 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 17:45:37.971685 9097 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f993d40455284bebabda710a534d6dea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b04cbc1b96848edb0696ac8f31c00fe in term 1.
I20260812 17:45:37.971956 9173 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b04cbc1b96848edb0696ac8f31c00fe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b04cbc1b96848edb0696ac8f31c00fe. Latest consensus state: current_term: 1 leader_uuid: "7b04cbc1b96848edb0696ac8f31c00fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b04cbc1b96848edb0696ac8f31c00fe" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 38239 } } peers { permanent_uuid: "a5aa6b18ed8745bfabc3390003a0f5a4" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42855 } } peers { permanent_uuid: "f993d40455284bebabda710a534d6dea" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 37745 } } }
I20260812 17:45:37.972074 9173 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b04cbc1b96848edb0696ac8f31c00fe [sys.catalog]: This master's current role is: LEADER
I20260812 17:45:37.972519 9263 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:45:37.973592 9263 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:45:37.979270 9097 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f993d40455284bebabda710a534d6dea [term 1 FOLLOWER]: Refusing update from remote peer 7b04cbc1b96848edb0696ac8f31c00fe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:45:37.979395 8957 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a5aa6b18ed8745bfabc3390003a0f5a4 [term 1 FOLLOWER]: Refusing update from remote peer 7b04cbc1b96848edb0696ac8f31c00fe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:45:37.979976 9260 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7b04cbc1b96848edb0696ac8f31c00fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f993d40455284bebabda710a534d6dea" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 37745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:45:37.980136 9173 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7b04cbc1b96848edb0696ac8f31c00fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5aa6b18ed8745bfabc3390003a0f5a4" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:45:37.985157 9200 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5aa6b18ed8745bfabc3390003a0f5a4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b04cbc1b96848edb0696ac8f31c00fe. Latest consensus state: current_term: 1 leader_uuid: "7b04cbc1b96848edb0696ac8f31c00fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b04cbc1b96848edb0696ac8f31c00fe" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 38239 } } peers { permanent_uuid: "a5aa6b18ed8745bfabc3390003a0f5a4" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42855 } } peers { permanent_uuid: "f993d40455284bebabda710a534d6dea" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 37745 } } }
I20260812 17:45:37.985174 9229 sys_catalog.cc:455] T 00000000000000000000000000000000 P f993d40455284bebabda710a534d6dea [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b04cbc1b96848edb0696ac8f31c00fe. Latest consensus state: current_term: 1 leader_uuid: "7b04cbc1b96848edb0696ac8f31c00fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b04cbc1b96848edb0696ac8f31c00fe" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 38239 } } peers { permanent_uuid: "a5aa6b18ed8745bfabc3390003a0f5a4" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42855 } } peers { permanent_uuid: "f993d40455284bebabda710a534d6dea" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 37745 } } }
I20260812 17:45:37.985296 9200 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5aa6b18ed8745bfabc3390003a0f5a4 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 17:45:37.985308 9229 sys_catalog.cc:458] T 00000000000000000000000000000000 P f993d40455284bebabda710a534d6dea [sys.catalog]: This master's current role is: FOLLOWER
I20260812 17:45:37.988394 9173 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b04cbc1b96848edb0696ac8f31c00fe [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7b04cbc1b96848edb0696ac8f31c00fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b04cbc1b96848edb0696ac8f31c00fe" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 38239 } } peers { permanent_uuid: "a5aa6b18ed8745bfabc3390003a0f5a4" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42855 } } peers { permanent_uuid: "f993d40455284bebabda710a534d6dea" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 37745 } } }
I20260812 17:45:37.988513 9173 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b04cbc1b96848edb0696ac8f31c00fe [sys.catalog]: This master's current role is: LEADER
I20260812 17:45:37.988613 9229 sys_catalog.cc:455] T 00000000000000000000000000000000 P f993d40455284bebabda710a534d6dea [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7b04cbc1b96848edb0696ac8f31c00fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b04cbc1b96848edb0696ac8f31c00fe" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 38239 } } peers { permanent_uuid: "a5aa6b18ed8745bfabc3390003a0f5a4" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42855 } } peers { permanent_uuid: "f993d40455284bebabda710a534d6dea" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 37745 } } }
I20260812 17:45:37.988725 9229 sys_catalog.cc:458] T 00000000000000000000000000000000 P f993d40455284bebabda710a534d6dea [sys.catalog]: This master's current role is: FOLLOWER
I20260812 17:45:37.988945 9264 mvcc.cc:205] Tried to move back new op lower bound from 7317736398755532800 to 7317736398728761344. Current Snapshot: MvccSnapshot[applied={T|T < 7317736398755532800}]
I20260812 17:45:37.995661 9263 catalog_manager.cc:1347] Generated new cluster ID: 3719da005eab45a085df77e83bbf067d
I20260812 17:45:37.995739 9263 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:45:37.996549 9269 mvcc.cc:205] Tried to move back new op lower bound from 7317736398755532800 to 7317736398728761344. Current Snapshot: MvccSnapshot[applied={T|T < 7317736398755532800}]
I20260812 17:45:38.006487 9260 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b04cbc1b96848edb0696ac8f31c00fe [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7b04cbc1b96848edb0696ac8f31c00fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b04cbc1b96848edb0696ac8f31c00fe" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 38239 } } peers { permanent_uuid: "a5aa6b18ed8745bfabc3390003a0f5a4" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42855 } } peers { permanent_uuid: "f993d40455284bebabda710a534d6dea" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 37745 } } }
I20260812 17:45:38.006659 9260 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b04cbc1b96848edb0696ac8f31c00fe [sys.catalog]: This master's current role is: LEADER
I20260812 17:45:38.008299 9200 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5aa6b18ed8745bfabc3390003a0f5a4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7b04cbc1b96848edb0696ac8f31c00fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b04cbc1b96848edb0696ac8f31c00fe" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 38239 } } peers { permanent_uuid: "a5aa6b18ed8745bfabc3390003a0f5a4" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 42855 } } peers { permanent_uuid: "f993d40455284bebabda710a534d6dea" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 37745 } } }
I20260812 17:45:38.008450 9200 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5aa6b18ed8745bfabc3390003a0f5a4 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 17:45:38.009213 9265 mvcc.cc:205] Tried to move back new op lower bound from 7317736398755532800 to 7317736398728761344. Current Snapshot: MvccSnapshot[applied={T|T < 7317736398755532800}]
I20260812 17:45:38.023939 9263 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:45:38.025529 9263 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:45:38.040035 9263 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7b04cbc1b96848edb0696ac8f31c00fe: Generated new TSK 0
I20260812 17:45:38.041256 9263 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 17:45:38.951421 9220 catalog_manager.cc:1259] Loaded cluster ID: 3719da005eab45a085df77e83bbf067d
I20260812 17:45:38.951529 9220 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a5aa6b18ed8745bfabc3390003a0f5a4: loading cluster ID for follower catalog manager: success
I20260812 17:45:38.953656 9220 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a5aa6b18ed8745bfabc3390003a0f5a4: acquiring CA information for follower catalog manager: success
I20260812 17:45:38.954937 9220 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a5aa6b18ed8745bfabc3390003a0f5a4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 17:45:38.957129 9257 catalog_manager.cc:1259] Loaded cluster ID: 3719da005eab45a085df77e83bbf067d
I20260812 17:45:38.957231 9257 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f993d40455284bebabda710a534d6dea: loading cluster ID for follower catalog manager: success
I20260812 17:45:38.958976 9257 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f993d40455284bebabda710a534d6dea: acquiring CA information for follower catalog manager: success
I20260812 17:45:38.960249 9257 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f993d40455284bebabda710a534d6dea: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 17:45:39.116619 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 8733
I20260812 17:45:39.133025 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 8869
I20260812 17:45:39.152516 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 9021
2026-08-12T17:45:39Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3476 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:45:39 dist-test-slave-tk9z krb5kdc[9291](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:45:39 dist-test-slave-tk9z krb5kdc[9291](info): set up 2 sockets
Aug 12 17:45:39 dist-test-slave-tk9z krb5kdc[9291](info): commencing operation
krb5kdc: starting...
W20260812 17:45:40.478582 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.294s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:45:40 dist-test-slave-tk9z krb5kdc[9291](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556740, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:45:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:45:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.255.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
I20260812 17:45:40.610638 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:44305
--webserver_interface=127.17.255.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:45663
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:44305
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:45:40.733953 9316 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:45:40.734359 9316 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:45:40.734513 9316 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:45:40.738799 9316 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:45:40.738894 9316 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:45:40.738935 9316 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:45:40.738970 9316 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:45:40.739006 9316 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:45:40.744426 9316 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:45663
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:44305
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:44305
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9316
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:45:40.745512 9316 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:45:40.746590 9316 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:45:40.755738 9330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:45:40.755776 9331 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:45:40.755756 9333 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:45:40.756184 9316 server_base.cc:1034] running on GCE node
I20260812 17:45:40.756824 9316 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:45:40.758010 9316 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:45:40.759209 9316 hybrid_clock.cc:648] HybridClock initialized: now 1786556740759191 us; error 32 us; skew 500 ppm
Aug 12 17:45:40 dist-test-slave-tk9z krb5kdc[9291](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556740, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:45:40.766745 9316 init.cc:377] Logged in from keytab as kudu/127.17.255.62@KRBTEST.COM (short username kudu)
I20260812 17:45:40.767771 9316 webserver.cc:460] Webserver started at http://127.17.255.62:35041/ using document root <none> and password file <none>
I20260812 17:45:40.768361 9316 fs_manager.cc:359] Metadata directory not provided
I20260812 17:45:40.768460 9316 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:45:40.768703 9316 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:45:40.770864 9316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "f93c5176923b4f5b8ae4310ca4619284"
format_stamp: "Formatted at 2026-08-12 17:45:40 on dist-test-slave-tk9z"
server_key: "44fd7ef753c1c8dbea056b6b698d85f8"
server_key_iv: "81828fe2b235e764aefa604e7641ca0c"
server_key_version: "encryptionkey@0"
I20260812 17:45:40.771453 9316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "f93c5176923b4f5b8ae4310ca4619284"
format_stamp: "Formatted at 2026-08-12 17:45:40 on dist-test-slave-tk9z"
server_key: "44fd7ef753c1c8dbea056b6b698d85f8"
server_key_iv: "81828fe2b235e764aefa604e7641ca0c"
server_key_version: "encryptionkey@0"
I20260812 17:45:40.775271 9316 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 17:45:40.777842 9343 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:40.779146 9316 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 17:45:40.779301 9316 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "f93c5176923b4f5b8ae4310ca4619284"
format_stamp: "Formatted at 2026-08-12 17:45:40 on dist-test-slave-tk9z"
server_key: "44fd7ef753c1c8dbea056b6b698d85f8"
server_key_iv: "81828fe2b235e764aefa604e7641ca0c"
server_key_version: "encryptionkey@0"
I20260812 17:45:40.779430 9316 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:45:40.843393 9316 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:45:40.847432 9316 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:45:40.847685 9316 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:45:40.855832 9316 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:44305
I20260812 17:45:40.855861 9449 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:44305 every 8 connection(s)
I20260812 17:45:40.856994 9316 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:45:40.859462 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 9316
I20260812 17:45:40.859630 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:45:40.859959 18428 external_mini_cluster.cc:1428] Setting key 6ed754dd79ebe2f1c02f414143a7afd2
I20260812 17:45:40.860144 9451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:45:40.866662 9451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f93c5176923b4f5b8ae4310ca4619284: Bootstrap starting.
I20260812 17:45:40.869186 9451 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f93c5176923b4f5b8ae4310ca4619284: Neither blocks nor log segments found. Creating new log.
Aug 12 17:45:40 dist-test-slave-tk9z krb5kdc[9291](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556740, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:45:40.870155 9451 log.cc:824] T 00000000000000000000000000000000 P f93c5176923b4f5b8ae4310ca4619284: Log is configured to *not* fsync() on all Append() calls
I20260812 17:45:40.872571 9451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f93c5176923b4f5b8ae4310ca4619284: No bootstrap required, opened a new log
I20260812 17:45:40.875129 9455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:40.861463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33090 (local address 127.17.255.62:44305)
0812 17:45:40.861974 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:40.861990 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:40.862029 (+ 39us) server_negotiation.cc:407] Connection header received
0812 17:45:40.863034 (+ 1005us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:40.863057 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:40.863390 (+ 333us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:40.863756 (+ 366us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:45:40.864600 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:40.865640 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:40.866551 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:40.867071 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:40.867237 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:40.870100 (+ 2863us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:45:40.870105 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:45:40.870119 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:45:40.870148 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:45:40.872068 (+ 1920us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:40.872650 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:40.872656 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:40.872664 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:40.872789 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:40.873126 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:40.873128 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:40.873130 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:40.873551 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:45:40.873704 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:40.874041 (+ 337us) server_negotiation.cc:299] Negotiation successful
0812 17:45:40.874356 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":356,"thread_start_us":166,"threads_started":1}
I20260812 17:45:40.876957 9451 raft_consensus.cc:348] T 00000000000000000000000000000000 P f93c5176923b4f5b8ae4310ca4619284 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f93c5176923b4f5b8ae4310ca4619284" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 44305 } }
I20260812 17:45:40.877238 9451 raft_consensus.cc:374] T 00000000000000000000000000000000 P f93c5176923b4f5b8ae4310ca4619284 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:45:40.877315 9451 raft_consensus.cc:729] T 00000000000000000000000000000000 P f93c5176923b4f5b8ae4310ca4619284 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f93c5176923b4f5b8ae4310ca4619284, State: Initialized, Role: FOLLOWER
I20260812 17:45:40.877817 9451 consensus_queue.cc:260] T 00000000000000000000000000000000 P f93c5176923b4f5b8ae4310ca4619284 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f93c5176923b4f5b8ae4310ca4619284" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 44305 } }
I20260812 17:45:40.877972 9451 raft_consensus.cc:388] T 00000000000000000000000000000000 P f93c5176923b4f5b8ae4310ca4619284 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:45:40.878054 9451 raft_consensus.cc:482] T 00000000000000000000000000000000 P f93c5176923b4f5b8ae4310ca4619284 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:45:40.878157 9451 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f93c5176923b4f5b8ae4310ca4619284 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:45:40.878331 18428 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 17:45:40.879470 9451 raft_consensus.cc:504] T 00000000000000000000000000000000 P f93c5176923b4f5b8ae4310ca4619284 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f93c5176923b4f5b8ae4310ca4619284" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 44305 } }
I20260812 17:45:40.879839 9451 leader_election.cc:302] T 00000000000000000000000000000000 P f93c5176923b4f5b8ae4310ca4619284 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f93c5176923b4f5b8ae4310ca4619284; no voters:
I20260812 17:45:40.880213 9451 leader_election.cc:288] T 00000000000000000000000000000000 P f93c5176923b4f5b8ae4310ca4619284 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:45:40.880297 9458 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f93c5176923b4f5b8ae4310ca4619284 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:45:40.880558 9458 raft_consensus.cc:686] T 00000000000000000000000000000000 P f93c5176923b4f5b8ae4310ca4619284 [term 1 LEADER]: Becoming Leader. State: Replica: f93c5176923b4f5b8ae4310ca4619284, State: Running, Role: LEADER
I20260812 17:45:40.880918 9458 consensus_queue.cc:237] T 00000000000000000000000000000000 P f93c5176923b4f5b8ae4310ca4619284 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f93c5176923b4f5b8ae4310ca4619284" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 44305 } }
I20260812 17:45:40.881551 9451 sys_catalog.cc:564] T 00000000000000000000000000000000 P f93c5176923b4f5b8ae4310ca4619284 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:45:40.882707 9464 sys_catalog.cc:455] T 00000000000000000000000000000000 P f93c5176923b4f5b8ae4310ca4619284 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f93c5176923b4f5b8ae4310ca4619284. Latest consensus state: current_term: 1 leader_uuid: "f93c5176923b4f5b8ae4310ca4619284" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f93c5176923b4f5b8ae4310ca4619284" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 44305 } } }
I20260812 17:45:40.882881 9464 sys_catalog.cc:458] T 00000000000000000000000000000000 P f93c5176923b4f5b8ae4310ca4619284 [sys.catalog]: This master's current role is: LEADER
I20260812 17:45:40.883261 9463 sys_catalog.cc:455] T 00000000000000000000000000000000 P f93c5176923b4f5b8ae4310ca4619284 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f93c5176923b4f5b8ae4310ca4619284" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f93c5176923b4f5b8ae4310ca4619284" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 44305 } } }
I20260812 17:45:40.883356 9476 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:45:40.883437 9463 sys_catalog.cc:458] T 00000000000000000000000000000000 P f93c5176923b4f5b8ae4310ca4619284 [sys.catalog]: This master's current role is: LEADER
I20260812 17:45:40.886247 9476 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:45:40.892449 9476 catalog_manager.cc:1347] Generated new cluster ID: 68e1e034b1a848a0a21c9468681f1419
I20260812 17:45:40.892535 9476 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:45:40.900565 9476 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:45:40.901589 9476 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:45:40.920348 9476 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f93c5176923b4f5b8ae4310ca4619284: Generated new TSK 0
I20260812 17:45:40.921212 9476 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 17:45:40.934993 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 9316
2026-08-12T17:45:40Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1785 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:45:41 dist-test-slave-tk9z krb5kdc[9501](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:45:41 dist-test-slave-tk9z krb5kdc[9501](info): set up 2 sockets
Aug 12 17:45:41 dist-test-slave-tk9z krb5kdc[9501](info): commencing operation
krb5kdc: starting...
W20260812 17:45:42.251907 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.283s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:45:42 dist-test-slave-tk9z krb5kdc[9501](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556742, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:45:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:45:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.255.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
I20260812 17:45:42.389441 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:35925
--webserver_interface=127.17.255.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:38991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:35925
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:45:42.530153 9524 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:45:42.530510 9524 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:45:42.530555 9524 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:45:42.534622 9524 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:45:42.534691 9524 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:45:42.534710 9524 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:45:42.534729 9524 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:45:42.534744 9524 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:45:42.540325 9524 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:38991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:35925
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:35925
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9524
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:45:42.541530 9524 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:45:42.542598 9524 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:45:42.551594 9529 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:45:42.551597 9532 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:45:42.551635 9536 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:45:42.551872 9524 server_base.cc:1034] running on GCE node
I20260812 17:45:42.552492 9524 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:45:42.553635 9524 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:45:42.554802 9524 hybrid_clock.cc:648] HybridClock initialized: now 1786556742554767 us; error 47 us; skew 500 ppm
Aug 12 17:45:42 dist-test-slave-tk9z krb5kdc[9501](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556742, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:45:42.557816 9524 init.cc:377] Logged in from keytab as kudu/127.17.255.62@KRBTEST.COM (short username kudu)
I20260812 17:45:42.559058 9524 webserver.cc:460] Webserver started at http://127.17.255.62:40023/ using document root <none> and password file <none>
I20260812 17:45:42.559659 9524 fs_manager.cc:359] Metadata directory not provided
I20260812 17:45:42.559765 9524 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:45:42.560017 9524 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:45:42.562244 9524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "3fedf30da66b4795aa5ccab7b46ee0b0"
format_stamp: "Formatted at 2026-08-12 17:45:42 on dist-test-slave-tk9z"
server_key: "c4ee715cc8b78617a14e5d1258c860bf"
server_key_iv: "c7dd9c463d8f02f201bc36a06207861d"
server_key_version: "encryptionkey@0"
I20260812 17:45:42.562955 9524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "3fedf30da66b4795aa5ccab7b46ee0b0"
format_stamp: "Formatted at 2026-08-12 17:45:42 on dist-test-slave-tk9z"
server_key: "c4ee715cc8b78617a14e5d1258c860bf"
server_key_iv: "c7dd9c463d8f02f201bc36a06207861d"
server_key_version: "encryptionkey@0"
I20260812 17:45:42.567168 9524 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 17:45:42.569945 9554 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:42.571415 9524 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 17:45:42.571583 9524 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "3fedf30da66b4795aa5ccab7b46ee0b0"
format_stamp: "Formatted at 2026-08-12 17:45:42 on dist-test-slave-tk9z"
server_key: "c4ee715cc8b78617a14e5d1258c860bf"
server_key_iv: "c7dd9c463d8f02f201bc36a06207861d"
server_key_version: "encryptionkey@0"
I20260812 17:45:42.571708 9524 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:45:42.595548 9524 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:45:42.598898 9524 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:45:42.599162 9524 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:45:42.606755 9524 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:35925
I20260812 17:45:42.607077 9663 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:35925 every 8 connection(s)
I20260812 17:45:42.607797 9524 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:45:42.609453 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 9524
I20260812 17:45:42.609615 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:45:42.609920 18428 external_mini_cluster.cc:1428] Setting key eec45b76e29dac3d8b64773872e24a95
I20260812 17:45:42.611088 9667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:45:42.618125 9667 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0: Bootstrap starting.
Aug 12 17:45:42 dist-test-slave-tk9z krb5kdc[9501](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556742, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:45:42.620910 9667 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0: Neither blocks nor log segments found. Creating new log.
I20260812 17:45:42.621666 9667 log.cc:824] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0: Log is configured to *not* fsync() on all Append() calls
I20260812 17:45:42.624117 9667 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0: No bootstrap required, opened a new log
I20260812 17:45:42.625334 9671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:42.611381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48346 (local address 127.17.255.62:35925)
0812 17:45:42.611827 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:42.611849 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:42.611893 (+ 44us) server_negotiation.cc:407] Connection header received
0812 17:45:42.612790 (+ 897us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:42.612814 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:42.613234 (+ 420us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:42.613630 (+ 396us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:45:42.614307 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:42.615860 (+ 1553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:42.616688 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:42.617414 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:42.617577 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:42.620397 (+ 2820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:45:42.620402 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:45:42.620416 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:45:42.620444 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:45:42.622437 (+ 1993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:42.622933 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:42.622937 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:42.622942 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:42.623062 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:42.623390 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:42.623392 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:42.623393 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:42.623792 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:45:42.623932 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:42.624301 (+ 369us) server_negotiation.cc:299] Negotiation successful
0812 17:45:42.624616 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297,"thread_start_us":112,"threads_started":1}
I20260812 17:45:42.628206 9667 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fedf30da66b4795aa5ccab7b46ee0b0" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 35925 } }
I20260812 17:45:42.628456 9667 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:45:42.628516 9667 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fedf30da66b4795aa5ccab7b46ee0b0, State: Initialized, Role: FOLLOWER
I20260812 17:45:42.628979 9667 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fedf30da66b4795aa5ccab7b46ee0b0" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 35925 } }
I20260812 17:45:42.629132 9667 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:45:42.629216 9667 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:45:42.629333 9667 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:45:42.630321 9667 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fedf30da66b4795aa5ccab7b46ee0b0" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 35925 } }
I20260812 17:45:42.630734 9667 leader_election.cc:302] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3fedf30da66b4795aa5ccab7b46ee0b0; no voters:
I20260812 17:45:42.631078 9667 leader_election.cc:288] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:45:42.631229 9673 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:45:42.631507 9673 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [term 1 LEADER]: Becoming Leader. State: Replica: 3fedf30da66b4795aa5ccab7b46ee0b0, State: Running, Role: LEADER
I20260812 17:45:42.631882 9673 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fedf30da66b4795aa5ccab7b46ee0b0" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 35925 } }
I20260812 17:45:42.632457 9667 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:45:42.633737 9679 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3fedf30da66b4795aa5ccab7b46ee0b0. Latest consensus state: current_term: 1 leader_uuid: "3fedf30da66b4795aa5ccab7b46ee0b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fedf30da66b4795aa5ccab7b46ee0b0" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 35925 } } }
I20260812 17:45:42.633884 9679 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [sys.catalog]: This master's current role is: LEADER
I20260812 17:45:42.634159 9675 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3fedf30da66b4795aa5ccab7b46ee0b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fedf30da66b4795aa5ccab7b46ee0b0" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 35925 } } }
I20260812 17:45:42.634259 9675 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [sys.catalog]: This master's current role is: LEADER
I20260812 17:45:42.634282 9700 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:45:42.637140 9700 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:45:42.642776 9700 catalog_manager.cc:1347] Generated new cluster ID: 3a8795c3560d40b69e74691da8fefd56
I20260812 17:45:42.642863 9700 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:45:42.658488 9700 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:45:42.660322 9700 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:45:42.677606 9700 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0: Generated new TSK 0
I20260812 17:45:42.678685 9700 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.255.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab.
Entry for principal kudu/127.17.255.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab.
I20260812 17:45:42.709687 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.1:0
--local_ip_for_outbound_sockets=127.17.255.1
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:35925
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:38991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:45:42.837651 9722 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:45:42.837936 9722 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:45:42.838007 9722 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:45:42.842285 9722 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:45:42.842437 9722 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:45:42.842552 9722 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.1
I20260812 17:45:42.848273 9722 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:38991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:35925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9722
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.1
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:45:42.849449 9722 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:45:42.850592 9722 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:45:42.860690 9735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:45:42.860704 9730 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:45:42.860980 9722 server_base.cc:1034] running on GCE node
W20260812 17:45:42.860684 9738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:45:42.861462 9722 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:45:42.862248 9722 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:45:42.863471 9722 hybrid_clock.cc:648] HybridClock initialized: now 1786556742863444 us; error 35 us; skew 500 ppm
Aug 12 17:45:42 dist-test-slave-tk9z krb5kdc[9501](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556742, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:45:42.866562 9722 init.cc:377] Logged in from keytab as kudu/127.17.255.1@KRBTEST.COM (short username kudu)
I20260812 17:45:42.867571 9722 webserver.cc:460] Webserver started at http://127.17.255.1:45161/ using document root <none> and password file <none>
I20260812 17:45:42.868166 9722 fs_manager.cc:359] Metadata directory not provided
I20260812 17:45:42.868256 9722 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:45:42.868516 9722 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:45:42.871088 9722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/data/instance:
uuid: "5adc202b3d744c37a24e0aa492506ed4"
format_stamp: "Formatted at 2026-08-12 17:45:42 on dist-test-slave-tk9z"
server_key: "6c490ea9ec14c47f131004164d390559"
server_key_iv: "65ae582cbc754536e0a24cddb74b9d63"
server_key_version: "encryptionkey@0"
I20260812 17:45:42.871739 9722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance:
uuid: "5adc202b3d744c37a24e0aa492506ed4"
format_stamp: "Formatted at 2026-08-12 17:45:42 on dist-test-slave-tk9z"
server_key: "6c490ea9ec14c47f131004164d390559"
server_key_iv: "65ae582cbc754536e0a24cddb74b9d63"
server_key_version: "encryptionkey@0"
I20260812 17:45:42.876128 9722 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 17:45:42.879071 9752 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:42.880404 9722 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 17:45:42.880578 9722 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/wal
uuid: "5adc202b3d744c37a24e0aa492506ed4"
format_stamp: "Formatted at 2026-08-12 17:45:42 on dist-test-slave-tk9z"
server_key: "6c490ea9ec14c47f131004164d390559"
server_key_iv: "65ae582cbc754536e0a24cddb74b9d63"
server_key_version: "encryptionkey@0"
I20260812 17:45:42.880709 9722 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:45:42.899698 9722 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:45:42.903265 9722 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:45:42.903502 9722 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:45:42.904211 9722 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:45:42.905138 9722 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:45:42.905211 9722 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:42.905287 9722 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:45:42.905328 9722 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:42.917569 9722 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.1:38933
I20260812 17:45:42.917635 9960 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.1:38933 every 8 connection(s)
I20260812 17:45:42.918745 9722 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
I20260812 17:45:42.927969 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 9722
I20260812 17:45:42.928138 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance
I20260812 17:45:42.928545 18428 external_mini_cluster.cc:1428] Setting key 46632483c63eee55393a2e3c67132f73
Aug 12 17:45:42 dist-test-slave-tk9z krb5kdc[9501](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556742, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:45:42.936180 9671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:42.920894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:60047 (local address 127.17.255.62:35925)
0812 17:45:42.921063 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:42.921068 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:42.922100 (+ 1032us) server_negotiation.cc:407] Connection header received
0812 17:45:42.923760 (+ 1660us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:42.923763 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:42.923819 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:42.923899 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:45:42.925326 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:42.925901 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:42.927368 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:42.927638 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:42.927743 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:42.931260 (+ 3517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:45:42.931264 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:45:42.931266 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:45:42.931293 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:45:42.933352 (+ 2059us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:42.933970 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:42.933976 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:42.933981 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:42.934091 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:42.934707 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:42.934714 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:42.934718 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:42.935013 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:45:42.935124 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:42.935742 (+ 618us) server_negotiation.cc:299] Negotiation successful
0812 17:45:42.935923 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 17:45:42.937067 9966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:42.921371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.1:60047)
0812 17:45:42.921924 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:42.921975 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 17:45:42.923510 (+ 1535us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:45:42.924136 (+ 626us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:45:42.924145 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:45:42.924574 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:45:42.925151 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:42.925167 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:42.926050 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:42.926053 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:42.927189 (+ 1136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:42.927201 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:42.927870 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:42.927876 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:42.928120 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:42.928971 (+ 851us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:45:42.928999 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:45:42.931070 (+ 2071us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:45:42.933498 (+ 2428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:42.933504 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:42.933521 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:42.933842 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:42.934310 (+ 468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:42.934315 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:42.934319 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:42.934578 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:42.935138 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:45:42.935145 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:45:42.935450 (+ 305us) client_negotiation.cc:769] Sending connection context
0812 17:45:42.935633 (+ 183us) client_negotiation.cc:240] Negotiation successful
0812 17:45:42.936054 (+ 421us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":133,"threads_started":1}
I20260812 17:45:42.938623 9963 heartbeater.cc:347] Connected to a master server at 127.17.255.62:35925
I20260812 17:45:42.938952 9963 heartbeater.cc:464] Registering TS with master...
I20260812 17:45:42.939627 9963 heartbeater.cc:511] Master 127.17.255.62:35925 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.17.255.2@KRBTEST.COM; defaulting to no policy
I20260812 17:45:42.941474 9590 ts_manager.cc:194] Registered new tserver with Master: 5adc202b3d744c37a24e0aa492506ed4 (127.17.255.1:38933)
I20260812 17:45:42.942847 9590 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.1@KRBTEST.COM'} at 127.17.255.1:60047
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab.
Entry for principal kudu/127.17.255.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab.
I20260812 17:45:42.962611 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.2:0
--local_ip_for_outbound_sockets=127.17.255.2
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:35925
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:38991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:45:43.082860 9969 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:45:43.083168 9969 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:45:43.083214 9969 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:45:43.087714 9969 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:45:43.087798 9969 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:45:43.087863 9969 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.2
I20260812 17:45:43.093587 9969 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:38991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:35925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9969
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.2
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:45:43.094825 9969 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:45:43.095916 9969 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 17:45:43.106009 9969 server_base.cc:1034] running on GCE node
W20260812 17:45:43.105993 9981 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:45:43.105986 9979 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:45:43.106030 9978 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:45:43.106722 9969 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:45:43.107381 9969 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:45:43.108605 9969 hybrid_clock.cc:648] HybridClock initialized: now 1786556743108568 us; error 47 us; skew 500 ppm
Aug 12 17:45:43 dist-test-slave-tk9z krb5kdc[9501](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556743, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:45:43.112094 9969 init.cc:377] Logged in from keytab as kudu/127.17.255.2@KRBTEST.COM (short username kudu)
I20260812 17:45:43.113265 9969 webserver.cc:460] Webserver started at http://127.17.255.2:39573/ using document root <none> and password file <none>
I20260812 17:45:43.113916 9969 fs_manager.cc:359] Metadata directory not provided
I20260812 17:45:43.113988 9969 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:45:43.114181 9969 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:45:43.116585 9969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/data/instance:
uuid: "cc53fa9679cb4e2ba9c5e0d3b9dac0ad"
format_stamp: "Formatted at 2026-08-12 17:45:43 on dist-test-slave-tk9z"
server_key: "849a17ff1381dd62113e2918b7284441"
server_key_iv: "1a9ad396965de95a0ce6ed3f27fdace4"
server_key_version: "encryptionkey@0"
I20260812 17:45:43.117170 9969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance:
uuid: "cc53fa9679cb4e2ba9c5e0d3b9dac0ad"
format_stamp: "Formatted at 2026-08-12 17:45:43 on dist-test-slave-tk9z"
server_key: "849a17ff1381dd62113e2918b7284441"
server_key_iv: "1a9ad396965de95a0ce6ed3f27fdace4"
server_key_version: "encryptionkey@0"
I20260812 17:45:43.121219 9969 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260812 17:45:43.123946 9992 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:43.125439 9969 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 17:45:43.125542 9969 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/wal
uuid: "cc53fa9679cb4e2ba9c5e0d3b9dac0ad"
format_stamp: "Formatted at 2026-08-12 17:45:43 on dist-test-slave-tk9z"
server_key: "849a17ff1381dd62113e2918b7284441"
server_key_iv: "1a9ad396965de95a0ce6ed3f27fdace4"
server_key_version: "encryptionkey@0"
I20260812 17:45:43.125633 9969 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:45:43.138706 9969 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:45:43.142046 9969 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:45:43.142213 9969 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:45:43.142911 9969 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:45:43.143764 9969 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:45:43.143812 9969 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:43.143853 9969 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:45:43.143874 9969 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:43.153091 9969 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.2:37663
I20260812 17:45:43.153111 10189 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.2:37663 every 8 connection(s)
I20260812 17:45:43.154062 9969 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
I20260812 17:45:43.161134 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 9969
I20260812 17:45:43.161283 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance
I20260812 17:45:43.161572 18428 external_mini_cluster.cc:1428] Setting key aeb03dd539abf7483b1403329d026e6b
Aug 12 17:45:43 dist-test-slave-tk9z krb5kdc[9501](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556743, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:45:43.170177 9671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:43.156094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:60017 (local address 127.17.255.62:35925)
0812 17:45:43.156279 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:43.156284 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:43.157258 (+ 974us) server_negotiation.cc:407] Connection header received
0812 17:45:43.158726 (+ 1468us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:43.158730 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:43.158790 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:43.158893 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:45:43.160168 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:43.160725 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:43.161999 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:43.162288 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:43.162457 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:43.165639 (+ 3182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:45:43.165642 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:45:43.165645 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:45:43.165673 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:45:43.167427 (+ 1754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:43.168160 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:43.168163 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:43.168164 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:43.168266 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:43.168791 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:43.168794 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:43.168795 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:43.169005 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:45:43.169100 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:43.169928 (+ 828us) server_negotiation.cc:299] Negotiation successful
0812 17:45:43.170049 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 17:45:43.171540 10194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:43.156581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.2:60017)
0812 17:45:43.157097 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:43.157143 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 17:45:43.158499 (+ 1356us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:45:43.159071 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:45:43.159077 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:45:43.159460 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:45:43.160003 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:43.160017 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:43.160859 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:43.160861 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:43.161868 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:43.161878 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:43.162513 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:43.162518 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:43.162723 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:43.163497 (+ 774us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:45:43.163515 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:45:43.165421 (+ 1906us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:45:43.167560 (+ 2139us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:43.167571 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:43.167592 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:43.168022 (+ 430us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:43.168432 (+ 410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:43.168438 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:43.168440 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:43.168665 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:43.169132 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:45:43.169142 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:45:43.169568 (+ 426us) client_negotiation.cc:769] Sending connection context
0812 17:45:43.169831 (+ 263us) client_negotiation.cc:240] Negotiation successful
0812 17:45:43.170290 (+ 459us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":131,"threads_started":1}
I20260812 17:45:43.172889 10191 heartbeater.cc:347] Connected to a master server at 127.17.255.62:35925
WARNING: no policy specified for kudu/127.17.255.3@KRBTEST.COM; defaulting to no policy
I20260812 17:45:43.173195 10191 heartbeater.cc:464] Registering TS with master...
I20260812 17:45:43.173799 10191 heartbeater.cc:511] Master 127.17.255.62:35925 requested a full tablet report, sending...
I20260812 17:45:43.175177 9590 ts_manager.cc:194] Registered new tserver with Master: cc53fa9679cb4e2ba9c5e0d3b9dac0ad (127.17.255.2:37663)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.3@KRBTEST.COM" created.
I20260812 17:45:43.175953 9590 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.2@KRBTEST.COM'} at 127.17.255.2:60017
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab.
Entry for principal kudu/127.17.255.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab.
I20260812 17:45:43.193166 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.3:0
--local_ip_for_outbound_sockets=127.17.255.3
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:35925
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:38991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:45:43.312758 10199 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:45:43.313055 10199 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:45:43.313126 10199 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:45:43.317250 10199 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:45:43.317317 10199 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:45:43.317409 10199 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.3
I20260812 17:45:43.322974 10199 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:38991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:35925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10199
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.3
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:45:43.324182 10199 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:45:43.325335 10199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:45:43.336330 10220 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:45:43.336328 10216 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:45:43.336352 10208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:45:43.336615 10199 server_base.cc:1034] running on GCE node
I20260812 17:45:43.337143 10199 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:45:43.337885 10199 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:45:43.339085 10199 hybrid_clock.cc:648] HybridClock initialized: now 1786556743339065 us; error 33 us; skew 500 ppm
Aug 12 17:45:43 dist-test-slave-tk9z krb5kdc[9501](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556743, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:45:43.342216 10199 init.cc:377] Logged in from keytab as kudu/127.17.255.3@KRBTEST.COM (short username kudu)
I20260812 17:45:43.343317 10199 webserver.cc:460] Webserver started at http://127.17.255.3:35499/ using document root <none> and password file <none>
I20260812 17:45:43.343957 10199 fs_manager.cc:359] Metadata directory not provided
I20260812 17:45:43.344048 10199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:45:43.344295 10199 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:45:43.347018 10199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/data/instance:
uuid: "8c3fa5f61fb145fa997bb4d6f5ee2923"
format_stamp: "Formatted at 2026-08-12 17:45:43 on dist-test-slave-tk9z"
server_key: "4ffd3c251240672856c3823a91dcdc72"
server_key_iv: "993e4cc8ba7a34df7b7f957dfc64f50b"
server_key_version: "encryptionkey@0"
I20260812 17:45:43.347667 10199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance:
uuid: "8c3fa5f61fb145fa997bb4d6f5ee2923"
format_stamp: "Formatted at 2026-08-12 17:45:43 on dist-test-slave-tk9z"
server_key: "4ffd3c251240672856c3823a91dcdc72"
server_key_iv: "993e4cc8ba7a34df7b7f957dfc64f50b"
server_key_version: "encryptionkey@0"
I20260812 17:45:43.351902 10199 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 17:45:43.354557 10232 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:43.355933 10199 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:45:43.356067 10199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/wal
uuid: "8c3fa5f61fb145fa997bb4d6f5ee2923"
format_stamp: "Formatted at 2026-08-12 17:45:43 on dist-test-slave-tk9z"
server_key: "4ffd3c251240672856c3823a91dcdc72"
server_key_iv: "993e4cc8ba7a34df7b7f957dfc64f50b"
server_key_version: "encryptionkey@0"
I20260812 17:45:43.356190 10199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:45:43.385519 10199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:45:43.389097 10199 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:45:43.389317 10199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:45:43.389991 10199 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:45:43.391037 10199 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:45:43.391093 10199 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:43.391161 10199 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:45:43.391199 10199 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:43.400585 10199 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.3:36643
I20260812 17:45:43.400606 10443 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.3:36643 every 8 connection(s)
I20260812 17:45:43.401675 10199 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
I20260812 17:45:43.411339 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 10199
I20260812 17:45:43.411506 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance
I20260812 17:45:43.411903 18428 external_mini_cluster.cc:1428] Setting key 65d7160f386a4d027ce9a810bbf6f658
Aug 12 17:45:43 dist-test-slave-tk9z krb5kdc[9501](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556743, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:45:43.417475 9671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:43.403698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:56157 (local address 127.17.255.62:35925)
0812 17:45:43.403884 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:43.403889 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:43.404823 (+ 934us) server_negotiation.cc:407] Connection header received
0812 17:45:43.406560 (+ 1737us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:43.406564 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:43.406626 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:43.406723 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:45:43.408525 (+ 1802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:43.409197 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:43.410412 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:43.410687 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:43.410785 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:43.413870 (+ 3085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:45:43.413874 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:45:43.413876 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:45:43.413910 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:45:43.415391 (+ 1481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:43.415935 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:43.415938 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:43.415940 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:43.416033 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:43.416391 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:43.416394 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:43.416395 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:43.416614 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:45:43.416702 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:43.417199 (+ 497us) server_negotiation.cc:299] Negotiation successful
0812 17:45:43.417353 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260812 17:45:43.418445 10447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:43.404152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.3:56157)
0812 17:45:43.404655 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:43.404700 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 17:45:43.406257 (+ 1557us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:45:43.406966 (+ 709us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:45:43.406979 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:45:43.407600 (+ 621us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:45:43.408348 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:43.408374 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:43.409325 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:43.409327 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:43.410221 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:43.410230 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:43.410835 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:43.410838 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:43.410986 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:43.411664 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:45:43.411689 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:45:43.413667 (+ 1978us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:45:43.415524 (+ 1857us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:43.415529 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:43.415544 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:43.415822 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:43.416121 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:43.416123 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:43.416124 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:43.416268 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:43.416709 (+ 441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:45:43.416715 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:45:43.416975 (+ 260us) client_negotiation.cc:769] Sending connection context
0812 17:45:43.417141 (+ 166us) client_negotiation.cc:240] Negotiation successful
0812 17:45:43.417414 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":156,"threads_started":1}
I20260812 17:45:43.419872 10444 heartbeater.cc:347] Connected to a master server at 127.17.255.62:35925
I20260812 17:45:43.420181 10444 heartbeater.cc:464] Registering TS with master...
I20260812 17:45:43.420755 10444 heartbeater.cc:511] Master 127.17.255.62:35925 requested a full tablet report, sending...
I20260812 17:45:43.421885 9590 ts_manager.cc:194] Registered new tserver with Master: 8c3fa5f61fb145fa997bb4d6f5ee2923 (127.17.255.3:36643)
I20260812 17:45:43.422533 9590 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.3@KRBTEST.COM'} at 127.17.255.3:56157
I20260812 17:45:43.426162 18428 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 17:45:43.437451 9671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:43.428480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48356 (local address 127.17.255.62:35925)
0812 17:45:43.428622 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:43.428629 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:43.428897 (+ 268us) server_negotiation.cc:407] Connection header received
0812 17:45:43.429090 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:43.429093 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:43.429151 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:43.429243 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:45:43.430109 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:43.430799 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:43.431763 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:43.432018 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:43.432138 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:43.433894 (+ 1756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:45:43.433898 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:45:43.433901 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:45:43.433938 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:45:43.435530 (+ 1592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:43.436009 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:43.436013 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:43.436016 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:43.436107 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:43.436405 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:43.436409 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:43.436411 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:43.436662 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:45:43.436816 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:43.437084 (+ 268us) server_negotiation.cc:299] Negotiation successful
0812 17:45:43.437218 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 17:45:43.440941 9590 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48356:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 17:45:43.444267 9590 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 17:45:43.460383 10470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:43.453933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60924 (local address 127.17.255.2:37663)
0812 17:45:43.454885 (+ 952us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:43.454899 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:43.454925 (+ 26us) server_negotiation.cc:407] Connection header received
0812 17:45:43.455096 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:43.455106 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:43.455350 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:43.455518 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:45:43.455843 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:43.457074 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:43.458860 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:43.459553 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:43.459673 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:43.459840 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:43.460124 (+ 284us) server_negotiation.cc:299] Negotiation successful
0812 17:45:43.460226 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":729,"thread_start_us":155,"threads_started":1}
I20260812 17:45:43.460430 10473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:43.454583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:38933 (local address 127.0.0.1:57524)
0812 17:45:43.455074 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:43.455086 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 17:45:43.455156 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:45:43.455958 (+ 802us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:45:43.455961 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:45:43.455975 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:45:43.456063 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:43.456069 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:43.457113 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:43.457119 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:43.458699 (+ 1580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:43.458712 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:43.459766 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:43.459770 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:43.460031 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:43.460062 (+ 31us) client_negotiation.cc:769] Sending connection context
0812 17:45:43.460130 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 17:45:43.460230 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":433,"mutex_wait_us":188,"thread_start_us":94,"threads_started":1}
I20260812 17:45:43.460639 10476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:43.455194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57524 (local address 127.17.255.1:38933)
0812 17:45:43.455499 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:43.455506 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:43.455528 (+ 22us) server_negotiation.cc:407] Connection header received
0812 17:45:43.455604 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:43.455609 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:43.455816 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:43.456187 (+ 371us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:45:43.456292 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:43.457000 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:43.458824 (+ 1824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:43.459625 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:43.459822 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:43.459980 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:43.460366 (+ 386us) server_negotiation.cc:299] Negotiation successful
0812 17:45:43.460486 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":79,"threads_started":1}
I20260812 17:45:43.460976 10474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:43.453772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:37663 (local address 127.0.0.1:60924)
0812 17:45:43.454826 (+ 1054us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:43.454847 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 17:45:43.454935 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:45:43.455517 (+ 582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:45:43.455523 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:45:43.455549 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:45:43.455699 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:43.455710 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:43.457204 (+ 1494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:43.457208 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:43.458732 (+ 1524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:43.458741 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:43.459674 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:43.459678 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:43.459965 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:43.459990 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 17:45:43.460072 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 17:45:43.460231 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":981,"mutex_wait_us":1022,"thread_start_us":129,"threads_started":1}
I20260812 17:45:43.461279 10469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:43.453772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.3:36643 (local address 127.0.0.1:38880)
0812 17:45:43.454259 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:43.454314 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 17:45:43.454479 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:45:43.455809 (+ 1330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:45:43.455812 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:45:43.455836 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:45:43.455968 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:43.455975 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:43.457632 (+ 1657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:43.457635 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:43.458654 (+ 1019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:43.458664 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:43.459766 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:43.459770 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:43.459874 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:43.459921 (+ 47us) client_negotiation.cc:769] Sending connection context
0812 17:45:43.460025 (+ 104us) client_negotiation.cc:240] Negotiation successful
0812 17:45:43.460209 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"mutex_wait_us":5,"thread_start_us":92,"threads_started":1}
I20260812 17:45:43.461856 10471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:43.454068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38880 (local address 127.17.255.3:36643)
0812 17:45:43.455325 (+ 1257us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:43.455345 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:43.455369 (+ 24us) server_negotiation.cc:407] Connection header received
0812 17:45:43.455447 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:43.455451 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:43.455648 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:43.455808 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:45:43.456232 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:43.457480 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:43.458768 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:43.459614 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:43.461451 (+ 1837us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:43.461617 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:43.461674 (+ 57us) server_negotiation.cc:299] Negotiation successful
0812 17:45:43.461748 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1140,"thread_start_us":148,"threads_started":1}
I20260812 17:45:43.464054 10080 tablet_service.cc:1467] Processing CreateTablet for tablet c979becb6c144b3981ee2a0e588d921d (DEFAULT_TABLE table=test-table [id=7229b3451edf4c60bd91b606e4e64e4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:45:43.464053 9840 tablet_service.cc:1467] Processing CreateTablet for tablet c979becb6c144b3981ee2a0e588d921d (DEFAULT_TABLE table=test-table [id=7229b3451edf4c60bd91b606e4e64e4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:45:43.464293 10317 tablet_service.cc:1467] Processing CreateTablet for tablet c979becb6c144b3981ee2a0e588d921d (DEFAULT_TABLE table=test-table [id=7229b3451edf4c60bd91b606e4e64e4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:45:43.465245 10080 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c979becb6c144b3981ee2a0e588d921d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:45:43.465245 9840 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c979becb6c144b3981ee2a0e588d921d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:45:43.465313 10317 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c979becb6c144b3981ee2a0e588d921d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:45:43.471771 10477 tablet_bootstrap.cc:492] T c979becb6c144b3981ee2a0e588d921d P 8c3fa5f61fb145fa997bb4d6f5ee2923: Bootstrap starting.
I20260812 17:45:43.473064 10478 tablet_bootstrap.cc:492] T c979becb6c144b3981ee2a0e588d921d P 5adc202b3d744c37a24e0aa492506ed4: Bootstrap starting.
I20260812 17:45:43.474732 10480 tablet_bootstrap.cc:492] T c979becb6c144b3981ee2a0e588d921d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad: Bootstrap starting.
I20260812 17:45:43.475232 10477 tablet_bootstrap.cc:654] T c979becb6c144b3981ee2a0e588d921d P 8c3fa5f61fb145fa997bb4d6f5ee2923: Neither blocks nor log segments found. Creating new log.
I20260812 17:45:43.475358 10478 tablet_bootstrap.cc:654] T c979becb6c144b3981ee2a0e588d921d P 5adc202b3d744c37a24e0aa492506ed4: Neither blocks nor log segments found. Creating new log.
I20260812 17:45:43.476432 10478 log.cc:824] T c979becb6c144b3981ee2a0e588d921d P 5adc202b3d744c37a24e0aa492506ed4: Log is configured to *not* fsync() on all Append() calls
I20260812 17:45:43.476665 10477 log.cc:824] T c979becb6c144b3981ee2a0e588d921d P 8c3fa5f61fb145fa997bb4d6f5ee2923: Log is configured to *not* fsync() on all Append() calls
I20260812 17:45:43.478624 10478 tablet_bootstrap.cc:492] T c979becb6c144b3981ee2a0e588d921d P 5adc202b3d744c37a24e0aa492506ed4: No bootstrap required, opened a new log
I20260812 17:45:43.478739 10480 tablet_bootstrap.cc:654] T c979becb6c144b3981ee2a0e588d921d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad: Neither blocks nor log segments found. Creating new log.
I20260812 17:45:43.478883 10478 ts_tablet_manager.cc:1397] T c979becb6c144b3981ee2a0e588d921d P 5adc202b3d744c37a24e0aa492506ed4: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260812 17:45:43.478943 10477 tablet_bootstrap.cc:492] T c979becb6c144b3981ee2a0e588d921d P 8c3fa5f61fb145fa997bb4d6f5ee2923: No bootstrap required, opened a new log
I20260812 17:45:43.479144 10477 ts_tablet_manager.cc:1397] T c979becb6c144b3981ee2a0e588d921d P 8c3fa5f61fb145fa997bb4d6f5ee2923: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260812 17:45:43.479632 10480 log.cc:824] T c979becb6c144b3981ee2a0e588d921d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad: Log is configured to *not* fsync() on all Append() calls
I20260812 17:45:43.481760 10480 tablet_bootstrap.cc:492] T c979becb6c144b3981ee2a0e588d921d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad: No bootstrap required, opened a new log
I20260812 17:45:43.481969 10480 ts_tablet_manager.cc:1397] T c979becb6c144b3981ee2a0e588d921d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.003s
I20260812 17:45:43.482910 10478 raft_consensus.cc:348] T c979becb6c144b3981ee2a0e588d921d P 5adc202b3d744c37a24e0aa492506ed4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc53fa9679cb4e2ba9c5e0d3b9dac0ad" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 37663 } } peers { permanent_uuid: "8c3fa5f61fb145fa997bb4d6f5ee2923" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36643 } } peers { permanent_uuid: "5adc202b3d744c37a24e0aa492506ed4" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 38933 } }
I20260812 17:45:43.483224 10478 raft_consensus.cc:374] T c979becb6c144b3981ee2a0e588d921d P 5adc202b3d744c37a24e0aa492506ed4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:45:43.483055 10477 raft_consensus.cc:348] T c979becb6c144b3981ee2a0e588d921d P 8c3fa5f61fb145fa997bb4d6f5ee2923 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc53fa9679cb4e2ba9c5e0d3b9dac0ad" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 37663 } } peers { permanent_uuid: "8c3fa5f61fb145fa997bb4d6f5ee2923" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36643 } } peers { permanent_uuid: "5adc202b3d744c37a24e0aa492506ed4" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 38933 } }
I20260812 17:45:43.483285 10478 raft_consensus.cc:729] T c979becb6c144b3981ee2a0e588d921d P 5adc202b3d744c37a24e0aa492506ed4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5adc202b3d744c37a24e0aa492506ed4, State: Initialized, Role: FOLLOWER
I20260812 17:45:43.483335 10477 raft_consensus.cc:374] T c979becb6c144b3981ee2a0e588d921d P 8c3fa5f61fb145fa997bb4d6f5ee2923 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:45:43.483392 10477 raft_consensus.cc:729] T c979becb6c144b3981ee2a0e588d921d P 8c3fa5f61fb145fa997bb4d6f5ee2923 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3fa5f61fb145fa997bb4d6f5ee2923, State: Initialized, Role: FOLLOWER
I20260812 17:45:43.483807 10478 consensus_queue.cc:260] T c979becb6c144b3981ee2a0e588d921d P 5adc202b3d744c37a24e0aa492506ed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc53fa9679cb4e2ba9c5e0d3b9dac0ad" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 37663 } } peers { permanent_uuid: "8c3fa5f61fb145fa997bb4d6f5ee2923" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36643 } } peers { permanent_uuid: "5adc202b3d744c37a24e0aa492506ed4" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 38933 } }
I20260812 17:45:43.483889 10477 consensus_queue.cc:260] T c979becb6c144b3981ee2a0e588d921d P 8c3fa5f61fb145fa997bb4d6f5ee2923 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc53fa9679cb4e2ba9c5e0d3b9dac0ad" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 37663 } } peers { permanent_uuid: "8c3fa5f61fb145fa997bb4d6f5ee2923" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36643 } } peers { permanent_uuid: "5adc202b3d744c37a24e0aa492506ed4" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 38933 } }
I20260812 17:45:43.484537 9963 heartbeater.cc:503] Master 127.17.255.62:35925 was elected leader, sending a full tablet report...
I20260812 17:45:43.484858 10478 ts_tablet_manager.cc:1428] T c979becb6c144b3981ee2a0e588d921d P 5adc202b3d744c37a24e0aa492506ed4: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260812 17:45:43.484912 10477 ts_tablet_manager.cc:1428] T c979becb6c144b3981ee2a0e588d921d P 8c3fa5f61fb145fa997bb4d6f5ee2923: Time spent starting tablet: real 0.006s user 0.002s sys 0.004s
I20260812 17:45:43.485261 10444 heartbeater.cc:503] Master 127.17.255.62:35925 was elected leader, sending a full tablet report...
I20260812 17:45:43.485879 10480 raft_consensus.cc:348] T c979becb6c144b3981ee2a0e588d921d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc53fa9679cb4e2ba9c5e0d3b9dac0ad" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 37663 } } peers { permanent_uuid: "8c3fa5f61fb145fa997bb4d6f5ee2923" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36643 } } peers { permanent_uuid: "5adc202b3d744c37a24e0aa492506ed4" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 38933 } }
I20260812 17:45:43.486167 10480 raft_consensus.cc:374] T c979becb6c144b3981ee2a0e588d921d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:45:43.486227 10480 raft_consensus.cc:729] T c979becb6c144b3981ee2a0e588d921d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc53fa9679cb4e2ba9c5e0d3b9dac0ad, State: Initialized, Role: FOLLOWER
I20260812 17:45:43.486685 10480 consensus_queue.cc:260] T c979becb6c144b3981ee2a0e588d921d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc53fa9679cb4e2ba9c5e0d3b9dac0ad" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 37663 } } peers { permanent_uuid: "8c3fa5f61fb145fa997bb4d6f5ee2923" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36643 } } peers { permanent_uuid: "5adc202b3d744c37a24e0aa492506ed4" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 38933 } }
I20260812 17:45:43.487408 10191 heartbeater.cc:503] Master 127.17.255.62:35925 was elected leader, sending a full tablet report...
I20260812 17:45:43.487973 10480 ts_tablet_manager.cc:1428] T c979becb6c144b3981ee2a0e588d921d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20260812 17:45:43.597510 10492 raft_consensus.cc:482] T c979becb6c144b3981ee2a0e588d921d P 8c3fa5f61fb145fa997bb4d6f5ee2923 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:45:43.597785 10492 raft_consensus.cc:504] T c979becb6c144b3981ee2a0e588d921d P 8c3fa5f61fb145fa997bb4d6f5ee2923 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc53fa9679cb4e2ba9c5e0d3b9dac0ad" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 37663 } } peers { permanent_uuid: "8c3fa5f61fb145fa997bb4d6f5ee2923" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36643 } } peers { permanent_uuid: "5adc202b3d744c37a24e0aa492506ed4" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 38933 } }
I20260812 17:45:43.599167 10492 leader_election.cc:288] T c979becb6c144b3981ee2a0e588d921d P 8c3fa5f61fb145fa997bb4d6f5ee2923 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc53fa9679cb4e2ba9c5e0d3b9dac0ad (127.17.255.2:37663), 5adc202b3d744c37a24e0aa492506ed4 (127.17.255.1:38933)
I20260812 17:45:43.600121 10490 raft_consensus.cc:482] T c979becb6c144b3981ee2a0e588d921d P 5adc202b3d744c37a24e0aa492506ed4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:45:43.600339 10490 raft_consensus.cc:504] T c979becb6c144b3981ee2a0e588d921d P 5adc202b3d744c37a24e0aa492506ed4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc53fa9679cb4e2ba9c5e0d3b9dac0ad" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 37663 } } peers { permanent_uuid: "8c3fa5f61fb145fa997bb4d6f5ee2923" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36643 } } peers { permanent_uuid: "5adc202b3d744c37a24e0aa492506ed4" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 38933 } }
I20260812 17:45:43.602556 10490 leader_election.cc:288] T c979becb6c144b3981ee2a0e588d921d P 5adc202b3d744c37a24e0aa492506ed4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc53fa9679cb4e2ba9c5e0d3b9dac0ad (127.17.255.2:37663), 8c3fa5f61fb145fa997bb4d6f5ee2923 (127.17.255.3:36643)
I20260812 17:45:43.603874 10447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:43.599412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:37663 (local address 127.17.255.3:51719)
0812 17:45:43.599619 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:43.599634 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 17:45:43.599739 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:45:43.600101 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:45:43.600106 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:45:43.600126 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:45:43.600262 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:43.600269 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:43.601131 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:43.601136 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:43.602389 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:43.602402 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:43.603406 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:43.603410 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:43.603518 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:43.603542 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 17:45:43.603610 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 17:45:43.603682 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"mutex_wait_us":7}
I20260812 17:45:43.604434 10470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:43.599525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:51719 (local address 127.17.255.2:37663)
0812 17:45:43.599663 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:43.599669 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:43.599688 (+ 19us) server_negotiation.cc:407] Connection header received
0812 17:45:43.599922 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:43.599927 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:43.599986 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:43.600068 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:45:43.600409 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:43.601009 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:43.602539 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:43.603179 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:43.603285 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:43.603344 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:43.604144 (+ 800us) server_negotiation.cc:299] Negotiation successful
0812 17:45:43.604236 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 17:45:43.604904 10476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:43.599620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:56095 (local address 127.17.255.1:38933)
0812 17:45:43.599758 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:43.599769 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:43.600009 (+ 240us) server_negotiation.cc:407] Connection header received
0812 17:45:43.600163 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:43.600167 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:43.600220 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:43.600268 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:45:43.600645 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:43.601324 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:43.603130 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:43.603737 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:43.603819 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:43.603863 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:43.604623 (+ 760us) server_negotiation.cc:299] Negotiation successful
0812 17:45:43.604740 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":51}
I20260812 17:45:43.605311 10494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:43.599456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:38933 (local address 127.17.255.3:56095)
0812 17:45:43.599906 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:43.599917 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 17:45:43.600034 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:45:43.600413 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:45:43.600416 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:45:43.600433 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:45:43.600537 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:43.600542 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:43.601452 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:43.601455 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:43.602969 (+ 1514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:43.602980 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:43.604232 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:43.604235 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:43.604433 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:43.604473 (+ 40us) client_negotiation.cc:769] Sending connection context
0812 17:45:43.605086 (+ 613us) client_negotiation.cc:240] Negotiation successful
0812 17:45:43.605172 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":389,"mutex_wait_us":351,"thread_start_us":134,"threads_started":1}
I20260812 17:45:43.605865 10121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c979becb6c144b3981ee2a0e588d921d" candidate_uuid: "8c3fa5f61fb145fa997bb4d6f5ee2923" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc53fa9679cb4e2ba9c5e0d3b9dac0ad" is_pre_election: true
I20260812 17:45:43.606168 9874 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c979becb6c144b3981ee2a0e588d921d" candidate_uuid: "8c3fa5f61fb145fa997bb4d6f5ee2923" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5adc202b3d744c37a24e0aa492506ed4" is_pre_election: true
I20260812 17:45:43.606237 10121 raft_consensus.cc:2454] T c979becb6c144b3981ee2a0e588d921d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3fa5f61fb145fa997bb4d6f5ee2923 in term 0.
I20260812 17:45:43.606320 9874 raft_consensus.cc:2454] T c979becb6c144b3981ee2a0e588d921d P 5adc202b3d744c37a24e0aa492506ed4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3fa5f61fb145fa997bb4d6f5ee2923 in term 0.
I20260812 17:45:43.606747 10236 leader_election.cc:302] T c979becb6c144b3981ee2a0e588d921d P 8c3fa5f61fb145fa997bb4d6f5ee2923 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3fa5f61fb145fa997bb4d6f5ee2923, cc53fa9679cb4e2ba9c5e0d3b9dac0ad; no voters:
I20260812 17:45:43.607292 10497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:43.601672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:37663 (local address 127.17.255.1:48023)
0812 17:45:43.602069 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:43.602084 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 17:45:43.602169 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:45:43.602945 (+ 776us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:45:43.602951 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:45:43.602969 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:45:43.603113 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:43.603121 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:43.604458 (+ 1337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:43.604463 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:43.605917 (+ 1454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:43.605929 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:43.606878 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:43.606882 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:43.606980 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:43.607009 (+ 29us) client_negotiation.cc:769] Sending connection context
0812 17:45:43.607062 (+ 53us) client_negotiation.cc:240] Negotiation successful
0812 17:45:43.607128 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"mutex_wait_us":67,"thread_start_us":112,"threads_started":1}
I20260812 17:45:43.607256 10492 raft_consensus.cc:2781] T c979becb6c144b3981ee2a0e588d921d P 8c3fa5f61fb145fa997bb4d6f5ee2923 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 17:45:43.607347 10492 raft_consensus.cc:482] T c979becb6c144b3981ee2a0e588d921d P 8c3fa5f61fb145fa997bb4d6f5ee2923 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 17:45:43.607396 10492 raft_consensus.cc:3037] T c979becb6c144b3981ee2a0e588d921d P 8c3fa5f61fb145fa997bb4d6f5ee2923 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:45:43.607802 10499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:43.601747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:48023 (local address 127.17.255.2:37663)
0812 17:45:43.602632 (+ 885us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:43.602710 (+ 78us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:43.602725 (+ 15us) server_negotiation.cc:407] Connection header received
0812 17:45:43.602769 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:43.602772 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:43.602824 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:43.603222 (+ 398us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:45:43.603345 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:43.604342 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:43.606053 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:43.606714 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:43.607488 (+ 774us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:43.607537 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:43.607575 (+ 38us) server_negotiation.cc:299] Negotiation successful
0812 17:45:43.607662 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":816,"thread_start_us":108,"threads_started":1}
I20260812 17:45:43.608657 10492 raft_consensus.cc:504] T c979becb6c144b3981ee2a0e588d921d P 8c3fa5f61fb145fa997bb4d6f5ee2923 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc53fa9679cb4e2ba9c5e0d3b9dac0ad" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 37663 } } peers { permanent_uuid: "8c3fa5f61fb145fa997bb4d6f5ee2923" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36643 } } peers { permanent_uuid: "5adc202b3d744c37a24e0aa492506ed4" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 38933 } }
I20260812 17:45:43.608963 10121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c979becb6c144b3981ee2a0e588d921d" candidate_uuid: "5adc202b3d744c37a24e0aa492506ed4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc53fa9679cb4e2ba9c5e0d3b9dac0ad" is_pre_election: true
I20260812 17:45:43.609068 10492 leader_election.cc:288] T c979becb6c144b3981ee2a0e588d921d P 8c3fa5f61fb145fa997bb4d6f5ee2923 [CANDIDATE]: Term 1 election: Requested vote from peers cc53fa9679cb4e2ba9c5e0d3b9dac0ad (127.17.255.2:37663), 5adc202b3d744c37a24e0aa492506ed4 (127.17.255.1:38933)
I20260812 17:45:43.609092 10121 raft_consensus.cc:2454] T c979becb6c144b3981ee2a0e588d921d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5adc202b3d744c37a24e0aa492506ed4 in term 0.
I20260812 17:45:43.609450 9874 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c979becb6c144b3981ee2a0e588d921d" candidate_uuid: "8c3fa5f61fb145fa997bb4d6f5ee2923" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5adc202b3d744c37a24e0aa492506ed4"
I20260812 17:45:43.609506 9760 leader_election.cc:302] T c979becb6c144b3981ee2a0e588d921d P 5adc202b3d744c37a24e0aa492506ed4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5adc202b3d744c37a24e0aa492506ed4, cc53fa9679cb4e2ba9c5e0d3b9dac0ad; no voters:
I20260812 17:45:43.609566 9874 raft_consensus.cc:3037] T c979becb6c144b3981ee2a0e588d921d P 5adc202b3d744c37a24e0aa492506ed4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:45:43.609647 10471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:43.602401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:38093 (local address 127.17.255.3:36643)
0812 17:45:43.602520 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:43.602525 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:43.602862 (+ 337us) server_negotiation.cc:407] Connection header received
0812 17:45:43.603054 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:43.603057 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:43.603104 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:43.603150 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:45:43.603538 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:43.604269 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:43.607767 (+ 3498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:43.608371 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:43.608451 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:43.608492 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:43.608974 (+ 482us) server_negotiation.cc:299] Negotiation successful
0812 17:45:43.609047 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 17:45:43.609887 10121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c979becb6c144b3981ee2a0e588d921d" candidate_uuid: "8c3fa5f61fb145fa997bb4d6f5ee2923" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc53fa9679cb4e2ba9c5e0d3b9dac0ad"
I20260812 17:45:43.610002 10121 raft_consensus.cc:3037] T c979becb6c144b3981ee2a0e588d921d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:45:43.610502 10501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:43.602206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.3:36643 (local address 127.17.255.1:38093)
0812 17:45:43.602782 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:43.602795 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 17:45:43.602929 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:45:43.603291 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:45:43.603294 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:45:43.603311 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:45:43.603417 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:43.603423 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:43.604410 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:43.604415 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:43.607319 (+ 2904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:43.607649 (+ 330us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:43.608655 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:43.608659 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:43.608759 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:43.608856 (+ 97us) client_negotiation.cc:769] Sending connection context
0812 17:45:43.609126 (+ 270us) client_negotiation.cc:240] Negotiation successful
0812 17:45:43.609239 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":519,"mutex_wait_us":229,"thread_start_us":99,"threads_started":1}
I20260812 17:45:43.611014 9874 raft_consensus.cc:2454] T c979becb6c144b3981ee2a0e588d921d P 5adc202b3d744c37a24e0aa492506ed4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3fa5f61fb145fa997bb4d6f5ee2923 in term 1.
I20260812 17:45:43.611164 10356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c979becb6c144b3981ee2a0e588d921d" candidate_uuid: "5adc202b3d744c37a24e0aa492506ed4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3fa5f61fb145fa997bb4d6f5ee2923" is_pre_election: true
I20260812 17:45:43.611423 10356 raft_consensus.cc:2379] T c979becb6c144b3981ee2a0e588d921d P 8c3fa5f61fb145fa997bb4d6f5ee2923 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5adc202b3d744c37a24e0aa492506ed4 in current term 1: Already voted for candidate 8c3fa5f61fb145fa997bb4d6f5ee2923 in this term.
I20260812 17:45:43.611485 10121 raft_consensus.cc:2454] T c979becb6c144b3981ee2a0e588d921d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3fa5f61fb145fa997bb4d6f5ee2923 in term 1.
I20260812 17:45:43.611496 10233 leader_election.cc:302] T c979becb6c144b3981ee2a0e588d921d P 8c3fa5f61fb145fa997bb4d6f5ee2923 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5adc202b3d744c37a24e0aa492506ed4, 8c3fa5f61fb145fa997bb4d6f5ee2923; no voters:
I20260812 17:45:43.611644 10490 raft_consensus.cc:2741] T c979becb6c144b3981ee2a0e588d921d P 5adc202b3d744c37a24e0aa492506ed4 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260812 17:45:43.611948 10492 raft_consensus.cc:2781] T c979becb6c144b3981ee2a0e588d921d P 8c3fa5f61fb145fa997bb4d6f5ee2923 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:45:43.612186 10492 raft_consensus.cc:686] T c979becb6c144b3981ee2a0e588d921d P 8c3fa5f61fb145fa997bb4d6f5ee2923 [term 1 LEADER]: Becoming Leader. State: Replica: 8c3fa5f61fb145fa997bb4d6f5ee2923, State: Running, Role: LEADER
I20260812 17:45:43.612553 10492 consensus_queue.cc:237] T c979becb6c144b3981ee2a0e588d921d P 8c3fa5f61fb145fa997bb4d6f5ee2923 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc53fa9679cb4e2ba9c5e0d3b9dac0ad" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 37663 } } peers { permanent_uuid: "8c3fa5f61fb145fa997bb4d6f5ee2923" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36643 } } peers { permanent_uuid: "5adc202b3d744c37a24e0aa492506ed4" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 38933 } }
I20260812 17:45:43.615797 9580 catalog_manager.cc:5495] T c979becb6c144b3981ee2a0e588d921d P 8c3fa5f61fb145fa997bb4d6f5ee2923 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c3fa5f61fb145fa997bb4d6f5ee2923 (127.17.255.3). New cstate: current_term: 1 leader_uuid: "8c3fa5f61fb145fa997bb4d6f5ee2923" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc53fa9679cb4e2ba9c5e0d3b9dac0ad" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 37663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3fa5f61fb145fa997bb4d6f5ee2923" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5adc202b3d744c37a24e0aa492506ed4" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 38933 } health_report { overall_health: UNKNOWN } } }
I20260812 17:45:43.651007 10471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:43.647458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38888 (local address 127.17.255.3:36643)
0812 17:45:43.647598 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:43.647603 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:43.647617 (+ 14us) server_negotiation.cc:407] Connection header received
0812 17:45:43.647784 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:43.647787 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:43.647876 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:43.647978 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:45:43.648203 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:43.648702 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:43.649506 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:43.649722 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:43.649800 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:43.650107 (+ 307us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:45:43.650618 (+ 511us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:45:43.650718 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:43.650783 (+ 65us) server_negotiation.cc:299] Negotiation successful
0812 17:45:43.650830 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
W20260812 17:45:43.652674 10445 tablet.cc:2369] T c979becb6c144b3981ee2a0e588d921d P 8c3fa5f61fb145fa997bb4d6f5ee2923: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 17:45:43.655349 10193 tablet.cc:2369] T c979becb6c144b3981ee2a0e588d921d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 17:45:43.657752 9874 raft_consensus.cc:1261] T c979becb6c144b3981ee2a0e588d921d P 5adc202b3d744c37a24e0aa492506ed4 [term 1 FOLLOWER]: Refusing update from remote peer 8c3fa5f61fb145fa997bb4d6f5ee2923: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:45:43.657764 10121 raft_consensus.cc:1261] T c979becb6c144b3981ee2a0e588d921d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad [term 1 FOLLOWER]: Refusing update from remote peer 8c3fa5f61fb145fa997bb4d6f5ee2923: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:45:43.658504 10502 consensus_queue.cc:1035] T c979becb6c144b3981ee2a0e588d921d P 8c3fa5f61fb145fa997bb4d6f5ee2923 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc53fa9679cb4e2ba9c5e0d3b9dac0ad" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 37663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:45:43.658700 10492 consensus_queue.cc:1035] T c979becb6c144b3981ee2a0e588d921d P 8c3fa5f61fb145fa997bb4d6f5ee2923 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5adc202b3d744c37a24e0aa492506ed4" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 38933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:45:43.665897 10506 mvcc.cc:205] Tried to move back new op lower bound from 7317736422014500864 to 7317736421840257024. Current Snapshot: MvccSnapshot[applied={T|T < 7317736422014500864}]
I20260812 17:45:43.666769 10507 mvcc.cc:205] Tried to move back new op lower bound from 7317736422014500864 to 7317736421840257024. Current Snapshot: MvccSnapshot[applied={T|T < 7317736422014500864}]
I20260812 17:45:43.676635 9590 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48356:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:45:43.676860 9590 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48356:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:45:43.679715 9590 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0: Sending DeleteTablet for 3 replicas of tablet c979becb6c144b3981ee2a0e588d921d
I20260812 17:45:43.680593 10080 tablet_service.cc:1514] Processing DeleteTablet for tablet c979becb6c144b3981ee2a0e588d921d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:45:43 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:60924
I20260812 17:45:43.680692 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 9722
I20260812 17:45:43.680655 10317 tablet_service.cc:1514] Processing DeleteTablet for tablet c979becb6c144b3981ee2a0e588d921d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:45:43 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:38880
I20260812 17:45:43.680837 9840 tablet_service.cc:1514] Processing DeleteTablet for tablet c979becb6c144b3981ee2a0e588d921d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:45:43 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:57524
I20260812 17:45:43.687965 10527 tablet_replica.cc:330] T c979becb6c144b3981ee2a0e588d921d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad: stopping tablet replica
I20260812 17:45:43.688594 10527 raft_consensus.cc:2229] T c979becb6c144b3981ee2a0e588d921d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:45:43.689131 10527 raft_consensus.cc:2258] T c979becb6c144b3981ee2a0e588d921d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:45:43.689724 10529 tablet_replica.cc:330] T c979becb6c144b3981ee2a0e588d921d P 8c3fa5f61fb145fa997bb4d6f5ee2923: stopping tablet replica
I20260812 17:45:43.690090 10529 raft_consensus.cc:2229] T c979becb6c144b3981ee2a0e588d921d P 8c3fa5f61fb145fa997bb4d6f5ee2923 [term 1 LEADER]: Raft consensus shutting down.
I20260812 17:45:43.690645 10529 raft_consensus.cc:2258] T c979becb6c144b3981ee2a0e588d921d P 8c3fa5f61fb145fa997bb4d6f5ee2923 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:45:43.691797 10527 ts_tablet_manager.cc:1905] T c979becb6c144b3981ee2a0e588d921d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:45:43.692482 10529 ts_tablet_manager.cc:1905] T c979becb6c144b3981ee2a0e588d921d P 8c3fa5f61fb145fa997bb4d6f5ee2923: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:45:43.694856 10527 ts_tablet_manager.cc:1918] T c979becb6c144b3981ee2a0e588d921d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 17:45:43.694970 10527 log.cc:1196] T c979becb6c144b3981ee2a0e588d921d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/wal/wals/c979becb6c144b3981ee2a0e588d921d
I20260812 17:45:43.695324 10527 ts_tablet_manager.cc:1939] T c979becb6c144b3981ee2a0e588d921d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad: Deleting consensus metadata
I20260812 17:45:43.696645 10529 ts_tablet_manager.cc:1918] T c979becb6c144b3981ee2a0e588d921d P 8c3fa5f61fb145fa997bb4d6f5ee2923: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 17:45:43.696774 9559 catalog_manager.cc:4841] TS cc53fa9679cb4e2ba9c5e0d3b9dac0ad (127.17.255.2:37663): tablet c979becb6c144b3981ee2a0e588d921d (table test-table [id=7229b3451edf4c60bd91b606e4e64e4b]) successfully deleted
I20260812 17:45:43.696835 10529 log.cc:1196] T c979becb6c144b3981ee2a0e588d921d P 8c3fa5f61fb145fa997bb4d6f5ee2923: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/wal/wals/c979becb6c144b3981ee2a0e588d921d
I20260812 17:45:43.697317 10529 ts_tablet_manager.cc:1939] T c979becb6c144b3981ee2a0e588d921d P 8c3fa5f61fb145fa997bb4d6f5ee2923: Deleting consensus metadata
W20260812 17:45:43.697818 9556 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.255.1:38933 (error 108)
I20260812 17:45:43.698091 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 9969
I20260812 17:45:43.715353 9556 catalog_manager.cc:4841] TS 8c3fa5f61fb145fa997bb4d6f5ee2923 (127.17.255.3:36643): tablet c979becb6c144b3981ee2a0e588d921d (table test-table [id=7229b3451edf4c60bd91b606e4e64e4b]) successfully deleted
I20260812 17:45:43.722184 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 10199
I20260812 17:45:43.738324 10474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:43.737944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:38933 (local address 127.0.0.1:57528)
0812 17:45:43.738131 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:43.738224 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.1:38933: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
W20260812 17:45:43.738725 9556 catalog_manager.cc:4584] TS 5adc202b3d744c37a24e0aa492506ed4 (127.17.255.1:38933): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c979becb6c144b3981ee2a0e588d921d: Network error: Client connection negotiation failed: client connection to 127.17.255.1:38933: connect: Connection refused (error 111)
I20260812 17:45:43.744946 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 9524
I20260812 17:45:43.765425 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:35925
--webserver_interface=127.17.255.62
--webserver_port=40023
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:38991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:35925
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:45:43.887163 10539 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:45:43.887548 10539 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:45:43.887645 10539 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:45:43.891942 10539 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:45:43.892066 10539 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:45:43.892107 10539 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:45:43.892143 10539 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:45:43.892181 10539 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:45:43.897779 10539 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:38991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:35925
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:35925
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=40023
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10539
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:45:43.899075 10539 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:45:43.900208 10539 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:45:43.914880 10552 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:45:43.914881 10547 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:45:43.915060 10539 server_base.cc:1034] running on GCE node
W20260812 17:45:43.915004 10546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:45:43.915980 10539 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:45:43.917176 10539 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:45:43.918352 10539 hybrid_clock.cc:648] HybridClock initialized: now 1786556743918331 us; error 33 us; skew 500 ppm
Aug 12 17:45:43 dist-test-slave-tk9z krb5kdc[9501](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556743, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:45:43.921397 10539 init.cc:377] Logged in from keytab as kudu/127.17.255.62@KRBTEST.COM (short username kudu)
I20260812 17:45:43.922358 10539 webserver.cc:460] Webserver started at http://127.17.255.62:40023/ using document root <none> and password file <none>
I20260812 17:45:43.923062 10539 fs_manager.cc:359] Metadata directory not provided
I20260812 17:45:43.923141 10539 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:45:43.927456 10539 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20260812 17:45:43.929924 10562 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:43.931388 10539 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 17:45:43.931571 10539 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "3fedf30da66b4795aa5ccab7b46ee0b0"
format_stamp: "Formatted at 2026-08-12 17:45:42 on dist-test-slave-tk9z"
server_key: "c4ee715cc8b78617a14e5d1258c860bf"
server_key_iv: "c7dd9c463d8f02f201bc36a06207861d"
server_key_version: "encryptionkey@0"
I20260812 17:45:43.932226 10539 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:45:43.960637 10539 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:45:43.964362 10539 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:45:43.964625 10539 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:45:43.972303 10539 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:35925
I20260812 17:45:43.972609 10662 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:35925 every 8 connection(s)
I20260812 17:45:43.973539 10539 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:45:43.978034 10663 sys_catalog.cc:263] Verifying existing consensus state
I20260812 17:45:43.979809 10663 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0: Bootstrap starting.
I20260812 17:45:43.983810 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 10539
I20260812 17:45:43.984369 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.1:38933
--local_ip_for_outbound_sockets=127.17.255.1
--tserver_master_addrs=127.17.255.62:35925
--webserver_port=45161
--webserver_interface=127.17.255.1
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:38991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 17:45:43.998904 10663 log.cc:824] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0: Log is configured to *not* fsync() on all Append() calls
I20260812 17:45:44.008908 10663 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 17:45:44.009362 10663 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0: Bootstrap complete.
I20260812 17:45:44.013787 10663 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fedf30da66b4795aa5ccab7b46ee0b0" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 35925 } }
I20260812 17:45:44.014220 10663 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fedf30da66b4795aa5ccab7b46ee0b0, State: Initialized, Role: FOLLOWER
I20260812 17:45:44.014832 10663 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fedf30da66b4795aa5ccab7b46ee0b0" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 35925 } }
I20260812 17:45:44.014961 10663 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:45:44.015069 10663 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:45:44.015199 10663 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [term 1 FOLLOWER]: Advancing to term 2
I20260812 17:45:44.017264 10663 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fedf30da66b4795aa5ccab7b46ee0b0" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 35925 } }
I20260812 17:45:44.017689 10663 leader_election.cc:302] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3fedf30da66b4795aa5ccab7b46ee0b0; no voters:
I20260812 17:45:44.018117 10663 leader_election.cc:288] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 17:45:44.018213 10671 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 17:45:44.018448 10671 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [term 2 LEADER]: Becoming Leader. State: Replica: 3fedf30da66b4795aa5ccab7b46ee0b0, State: Running, Role: LEADER
I20260812 17:45:44.018771 10671 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fedf30da66b4795aa5ccab7b46ee0b0" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 35925 } }
I20260812 17:45:44.019503 10663 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:45:44.019767 10671 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3fedf30da66b4795aa5ccab7b46ee0b0. Latest consensus state: current_term: 2 leader_uuid: "3fedf30da66b4795aa5ccab7b46ee0b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fedf30da66b4795aa5ccab7b46ee0b0" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 35925 } } }
I20260812 17:45:44.019883 10671 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [sys.catalog]: This master's current role is: LEADER
I20260812 17:45:44.020387 10673 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "3fedf30da66b4795aa5ccab7b46ee0b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fedf30da66b4795aa5ccab7b46ee0b0" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 35925 } } }
I20260812 17:45:44.020565 10673 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [sys.catalog]: This master's current role is: LEADER
I20260812 17:45:44.021802 10678 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:45:44.027304 10678 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:45:44.028025 10678 catalog_manager.cc:1259] Loaded cluster ID: 3a8795c3560d40b69e74691da8fefd56
I20260812 17:45:44.028098 10678 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:45:44.029577 10678 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260812 17:45:44.034060 10678 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260812 17:45:44.040491 10678 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:45:44.041425 10678 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0: Loaded TSK: 0
I20260812 17:45:44.042796 10678 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 17:45:44.120267 10665 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:45:44.120831 10665 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:45:44.120970 10665 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:45:44.128451 10665 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:45:44.128540 10665 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:45:44.128647 10665 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.1
I20260812 17:45:44.135069 10665 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:38991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.1:38933
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.255.1
--webserver_port=45161
--tserver_master_addrs=127.17.255.62:35925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10665
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.1
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:45:44.136303 10665 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:45:44.137432 10665 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:45:44.147989 10714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:45:44.148257 10665 server_base.cc:1034] running on GCE node
W20260812 17:45:44.147989 10720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:45:44.148027 10711 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:45:44.148962 10665 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:45:44.149672 10665 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:45:44.150876 10665 hybrid_clock.cc:648] HybridClock initialized: now 1786556744150830 us; error 65 us; skew 500 ppm
Aug 12 17:45:44 dist-test-slave-tk9z krb5kdc[9501](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556744, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:45:44.154008 10665 init.cc:377] Logged in from keytab as kudu/127.17.255.1@KRBTEST.COM (short username kudu)
I20260812 17:45:44.155189 10665 webserver.cc:460] Webserver started at http://127.17.255.1:45161/ using document root <none> and password file <none>
I20260812 17:45:44.155827 10665 fs_manager.cc:359] Metadata directory not provided
I20260812 17:45:44.155932 10665 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:45:44.160393 10665 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20260812 17:45:44.162979 10728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:44.164521 10665 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260812 17:45:44.164664 10665 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/wal
uuid: "5adc202b3d744c37a24e0aa492506ed4"
format_stamp: "Formatted at 2026-08-12 17:45:42 on dist-test-slave-tk9z"
server_key: "6c490ea9ec14c47f131004164d390559"
server_key_iv: "65ae582cbc754536e0a24cddb74b9d63"
server_key_version: "encryptionkey@0"
I20260812 17:45:44.165280 10665 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:45:44.178694 10665 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:45:44.181725 10665 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:45:44.181957 10665 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:45:44.182654 10665 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:45:44.183845 10738 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 17:45:44.188541 10665 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 17:45:44.188623 10665 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.001s
I20260812 17:45:44.188680 10665 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 17:45:44.190629 10665 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 17:45:44.190681 10665 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.002s
I20260812 17:45:44.190994 10738 tablet_bootstrap.cc:492] T c979becb6c144b3981ee2a0e588d921d P 5adc202b3d744c37a24e0aa492506ed4: Bootstrap starting.
I20260812 17:45:44.202171 10665 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.1:38933
I20260812 17:45:44.202248 10927 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.1:38933 every 8 connection(s)
I20260812 17:45:44.203338 10665 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
I20260812 17:45:44.205186 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 10665
I20260812 17:45:44.205689 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.2:37663
--local_ip_for_outbound_sockets=127.17.255.2
--tserver_master_addrs=127.17.255.62:35925
--webserver_port=39573
--webserver_interface=127.17.255.2
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:38991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 17:45:44.210774 10738 log.cc:824] T c979becb6c144b3981ee2a0e588d921d P 5adc202b3d744c37a24e0aa492506ed4: Log is configured to *not* fsync() on all Append() calls
Aug 12 17:45:44 dist-test-slave-tk9z krb5kdc[9501](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556744, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:45:44.219312 10738 tablet_bootstrap.cc:492] T c979becb6c144b3981ee2a0e588d921d P 5adc202b3d744c37a24e0aa492506ed4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 17:45:44.219827 10738 tablet_bootstrap.cc:492] T c979becb6c144b3981ee2a0e588d921d P 5adc202b3d744c37a24e0aa492506ed4: Bootstrap complete.
I20260812 17:45:44.221446 10738 ts_tablet_manager.cc:1397] T c979becb6c144b3981ee2a0e588d921d P 5adc202b3d744c37a24e0aa492506ed4: Time spent bootstrapping tablet: real 0.031s user 0.010s sys 0.017s
I20260812 17:45:44.224658 10738 raft_consensus.cc:348] T c979becb6c144b3981ee2a0e588d921d P 5adc202b3d744c37a24e0aa492506ed4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc53fa9679cb4e2ba9c5e0d3b9dac0ad" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 37663 } } peers { permanent_uuid: "8c3fa5f61fb145fa997bb4d6f5ee2923" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36643 } } peers { permanent_uuid: "5adc202b3d744c37a24e0aa492506ed4" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 38933 } }
I20260812 17:45:44.225244 10738 raft_consensus.cc:729] T c979becb6c144b3981ee2a0e588d921d P 5adc202b3d744c37a24e0aa492506ed4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5adc202b3d744c37a24e0aa492506ed4, State: Initialized, Role: FOLLOWER
I20260812 17:45:44.225889 10738 consensus_queue.cc:260] T c979becb6c144b3981ee2a0e588d921d P 5adc202b3d744c37a24e0aa492506ed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc53fa9679cb4e2ba9c5e0d3b9dac0ad" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 37663 } } peers { permanent_uuid: "8c3fa5f61fb145fa997bb4d6f5ee2923" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36643 } } peers { permanent_uuid: "5adc202b3d744c37a24e0aa492506ed4" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 38933 } }
I20260812 17:45:44.226468 10932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:44.205722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:51831 (local address 127.17.255.62:35925)
0812 17:45:44.206283 (+ 561us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:44.206305 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:44.207241 (+ 936us) server_negotiation.cc:407] Connection header received
0812 17:45:44.208950 (+ 1709us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:44.208965 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:44.209305 (+ 340us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:44.209605 (+ 300us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:45:44.211258 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:44.213045 (+ 1787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:44.214775 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:44.215649 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:44.215871 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:44.219467 (+ 3596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:45:44.219477 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:45:44.219497 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:45:44.219543 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:45:44.222150 (+ 2607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:44.222929 (+ 779us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:44.222937 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:44.222943 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:44.223128 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:44.223587 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:44.223592 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:44.223594 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:44.224131 (+ 537us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:45:44.224279 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:44.225021 (+ 742us) server_negotiation.cc:299] Negotiation successful
0812 17:45:44.225368 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":130,"threads_started":1}
I20260812 17:45:44.226475 10933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:44.205683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.1:51831)
0812 17:45:44.207004 (+ 1321us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:44.207073 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0812 17:45:44.208362 (+ 1289us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:45:44.209744 (+ 1382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:45:44.209754 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:45:44.210316 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:45:44.211032 (+ 716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:44.211055 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:44.213264 (+ 2209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:44.213271 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:44.214621 (+ 1350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:44.214633 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:44.215828 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:44.215834 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:44.216073 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:44.216789 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:45:44.216810 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:45:44.219161 (+ 2351us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:45:44.222320 (+ 3159us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:44.222328 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:44.222346 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:44.222766 (+ 420us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:44.223241 (+ 475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:44.223244 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:44.223246 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:44.223454 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:44.224266 (+ 812us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:45:44.224273 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:45:44.224613 (+ 340us) client_negotiation.cc:769] Sending connection context
0812 17:45:44.224815 (+ 202us) client_negotiation.cc:240] Negotiation successful
0812 17:45:44.225187 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1005,"thread_start_us":153,"threads_started":1}
I20260812 17:45:44.227077 10738 ts_tablet_manager.cc:1428] T c979becb6c144b3981ee2a0e588d921d P 5adc202b3d744c37a24e0aa492506ed4: Time spent starting tablet: real 0.006s user 0.007s sys 0.001s
I20260812 17:45:44.229691 10928 heartbeater.cc:347] Connected to a master server at 127.17.255.62:35925
I20260812 17:45:44.230014 10928 heartbeater.cc:464] Registering TS with master...
I20260812 17:45:44.230712 10928 heartbeater.cc:511] Master 127.17.255.62:35925 requested a full tablet report, sending...
I20260812 17:45:44.233623 10587 ts_manager.cc:194] Registered new tserver with Master: 5adc202b3d744c37a24e0aa492506ed4 (127.17.255.1:38933)
I20260812 17:45:44.237828 10587 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.1@KRBTEST.COM'} at 127.17.255.1:51831
I20260812 17:45:44.240809 10928 heartbeater.cc:503] Master 127.17.255.62:35925 was elected leader, sending a full tablet report...
Aug 12 17:45:44 dist-test-slave-tk9z krb5kdc[9501](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556743, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for kudu/127.17.255.1@KRBTEST.COM
I20260812 17:45:44.249617 10943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:44.237401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57544 (local address 127.17.255.1:38933)
0812 17:45:44.237889 (+ 488us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:44.237904 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:44.238471 (+ 567us) server_negotiation.cc:407] Connection header received
0812 17:45:44.238697 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:44.238704 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:44.238934 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:44.239096 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:45:44.239937 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:44.241061 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:44.242153 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:44.242688 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:44.242797 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:44.245614 (+ 2817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:45:44.245624 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:45:44.245635 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:45:44.245659 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:45:44.247379 (+ 1720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:44.248036 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:44.248042 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:44.248043 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:44.248129 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:44.248450 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:44.248455 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:44.248456 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:44.248737 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:45:44.248900 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:44.249266 (+ 366us) server_negotiation.cc:299] Negotiation successful
0812 17:45:44.249444 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":146,"threads_started":1}
I20260812 17:45:44.249617 10942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:44.237270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:38933 (local address 127.0.0.1:57544)
0812 17:45:44.238249 (+ 979us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:44.238298 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 17:45:44.238513 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:45:44.239119 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:45:44.239126 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:45:44.239637 (+ 511us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:45:44.239785 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:44.239795 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:44.241205 (+ 1410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:44.241209 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:44.241988 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:44.242001 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:44.243002 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:44.243006 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:44.243128 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:44.243750 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:45:44.243763 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:45:44.245447 (+ 1684us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:45:44.247605 (+ 2158us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:44.247616 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:44.247623 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:44.247879 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:44.248241 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:44.248244 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:44.248246 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:44.248343 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:44.248870 (+ 527us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:45:44.248877 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:45:44.249022 (+ 145us) client_negotiation.cc:769] Sending connection context
0812 17:45:44.249176 (+ 154us) client_negotiation.cc:240] Negotiation successful
0812 17:45:44.249407 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":788,"thread_start_us":173,"threads_started":1}
I20260812 17:45:44.251075 10814 tablet_service.cc:1514] Processing DeleteTablet for tablet c979becb6c144b3981ee2a0e588d921d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:45:43 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:57544
I20260812 17:45:44.252161 10944 tablet_replica.cc:330] stopping tablet replica
I20260812 17:45:44.252552 10944 raft_consensus.cc:2229] T c979becb6c144b3981ee2a0e588d921d P 5adc202b3d744c37a24e0aa492506ed4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:45:44.252842 10944 raft_consensus.cc:2258] T c979becb6c144b3981ee2a0e588d921d P 5adc202b3d744c37a24e0aa492506ed4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:45:44.253917 10944 ts_tablet_manager.cc:1905] T c979becb6c144b3981ee2a0e588d921d P 5adc202b3d744c37a24e0aa492506ed4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:45:44.257972 10944 ts_tablet_manager.cc:1918] T c979becb6c144b3981ee2a0e588d921d P 5adc202b3d744c37a24e0aa492506ed4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 17:45:44.258102 10944 log.cc:1196] T c979becb6c144b3981ee2a0e588d921d P 5adc202b3d744c37a24e0aa492506ed4: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/wal/wals/c979becb6c144b3981ee2a0e588d921d
I20260812 17:45:44.258453 10944 ts_tablet_manager.cc:1939] T c979becb6c144b3981ee2a0e588d921d P 5adc202b3d744c37a24e0aa492506ed4: Deleting consensus metadata
I20260812 17:45:44.260326 10563 catalog_manager.cc:4841] TS 5adc202b3d744c37a24e0aa492506ed4 (127.17.255.1:38933): tablet c979becb6c144b3981ee2a0e588d921d (table test-table [id=7229b3451edf4c60bd91b606e4e64e4b]) successfully deleted
W20260812 17:45:44.338516 10934 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:45:44.338810 10934 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:45:44.338858 10934 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:45:44.342969 10934 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:45:44.343039 10934 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:45:44.343098 10934 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.2
I20260812 17:45:44.348610 10934 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:38991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.2:37663
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.255.2
--webserver_port=39573
--tserver_master_addrs=127.17.255.62:35925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10934
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.2
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:45:44.349794 10934 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:45:44.351006 10934 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:45:44.361544 10949 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:45:44.361544 10957 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:45:44.361545 10950 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:45:44.361887 10934 server_base.cc:1034] running on GCE node
I20260812 17:45:44.362571 10934 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:45:44.363394 10934 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:45:44.364594 10934 hybrid_clock.cc:648] HybridClock initialized: now 1786556744364577 us; error 38 us; skew 500 ppm
Aug 12 17:45:44 dist-test-slave-tk9z krb5kdc[9501](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556744, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:45:44.367756 10934 init.cc:377] Logged in from keytab as kudu/127.17.255.2@KRBTEST.COM (short username kudu)
I20260812 17:45:44.368712 10934 webserver.cc:460] Webserver started at http://127.17.255.2:39573/ using document root <none> and password file <none>
I20260812 17:45:44.369387 10934 fs_manager.cc:359] Metadata directory not provided
I20260812 17:45:44.369509 10934 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:45:44.373739 10934 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260812 17:45:44.376189 10970 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:44.377604 10934 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 17:45:44.377774 10934 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/wal
uuid: "cc53fa9679cb4e2ba9c5e0d3b9dac0ad"
format_stamp: "Formatted at 2026-08-12 17:45:43 on dist-test-slave-tk9z"
server_key: "849a17ff1381dd62113e2918b7284441"
server_key_iv: "1a9ad396965de95a0ce6ed3f27fdace4"
server_key_version: "encryptionkey@0"
I20260812 17:45:44.378428 10934 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:45:44.400243 10934 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:45:44.404191 10934 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:45:44.404476 10934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:45:44.405230 10934 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:45:44.406270 10934 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:45:44.406358 10934 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:44.406466 10934 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:45:44.406525 10934 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:44.417796 10934 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.2:37663
I20260812 17:45:44.417845 11166 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.2:37663 every 8 connection(s)
I20260812 17:45:44.419094 10934 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
I20260812 17:45:44.426059 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 10934
I20260812 17:45:44.426704 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.3:36643
--local_ip_for_outbound_sockets=127.17.255.3
--tserver_master_addrs=127.17.255.62:35925
--webserver_port=35499
--webserver_interface=127.17.255.3
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:38991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 17:45:44 dist-test-slave-tk9z krb5kdc[9501](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556744, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:45:44.435566 10932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:44.421499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:41685 (local address 127.17.255.62:35925)
0812 17:45:44.421677 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:44.421682 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:44.422737 (+ 1055us) server_negotiation.cc:407] Connection header received
0812 17:45:44.424251 (+ 1514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:44.424255 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:44.424317 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:44.424440 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:45:44.425700 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:44.426305 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:44.427808 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:44.428182 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:44.428264 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:44.431534 (+ 3270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:45:44.431537 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:45:44.431539 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:45:44.431566 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:45:44.433119 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:44.433709 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:44.433713 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:44.433715 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:44.433805 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:44.434195 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:44.434199 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:44.434200 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:44.434471 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:45:44.434593 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:44.435240 (+ 647us) server_negotiation.cc:299] Negotiation successful
0812 17:45:44.435389 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 17:45:44.436606 11174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:44.421958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.2:41685)
0812 17:45:44.422576 (+ 618us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:44.422623 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 17:45:44.424015 (+ 1392us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:45:44.424633 (+ 618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:45:44.424640 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:45:44.425032 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:45:44.425539 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:44.425553 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:44.426487 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:44.426510 (+ 23us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:44.427667 (+ 1157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:44.427682 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:44.428527 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:44.428533 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:44.428737 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:44.429412 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:45:44.429430 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:45:44.431328 (+ 1898us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:45:44.433268 (+ 1940us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:44.433275 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:44.433294 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:44.433593 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:44.433916 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:44.433919 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:44.433922 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:44.434086 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:44.434592 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:45:44.434602 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:45:44.434970 (+ 368us) client_negotiation.cc:769] Sending connection context
0812 17:45:44.435186 (+ 216us) client_negotiation.cc:240] Negotiation successful
0812 17:45:44.435598 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":139,"threads_started":1}
I20260812 17:45:44.438267 11169 heartbeater.cc:347] Connected to a master server at 127.17.255.62:35925
I20260812 17:45:44.438653 11169 heartbeater.cc:464] Registering TS with master...
I20260812 17:45:44.439292 11169 heartbeater.cc:511] Master 127.17.255.62:35925 requested a full tablet report, sending...
I20260812 17:45:44.440763 10587 ts_manager.cc:194] Registered new tserver with Master: cc53fa9679cb4e2ba9c5e0d3b9dac0ad (127.17.255.2:37663)
I20260812 17:45:44.441711 10587 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.2@KRBTEST.COM'} at 127.17.255.2:41685
W20260812 17:45:44.553646 11176 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:45:44.553936 11176 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:45:44.553982 11176 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:45:44.558225 11176 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:45:44.558296 11176 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:45:44.558413 11176 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.3
I20260812 17:45:44.563830 11176 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:38991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.3:36643
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.255.3
--webserver_port=35499
--tserver_master_addrs=127.17.255.62:35925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11176
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.3
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:45:44.564898 11176 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:45:44.565951 11176 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:45:44.576444 11183 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:45:44.576469 11192 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:45:44.576463 11182 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:45:44.576683 11176 server_base.cc:1034] running on GCE node
I20260812 17:45:44.577276 11176 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:45:44.577996 11176 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:45:44.579226 11176 hybrid_clock.cc:648] HybridClock initialized: now 1786556744579204 us; error 29 us; skew 500 ppm
Aug 12 17:45:44 dist-test-slave-tk9z krb5kdc[9501](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556744, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:45:44.582468 11176 init.cc:377] Logged in from keytab as kudu/127.17.255.3@KRBTEST.COM (short username kudu)
I20260812 17:45:44.583642 11176 webserver.cc:460] Webserver started at http://127.17.255.3:35499/ using document root <none> and password file <none>
I20260812 17:45:44.584316 11176 fs_manager.cc:359] Metadata directory not provided
I20260812 17:45:44.584445 11176 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:45:44.589100 11176 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 17:45:44.591670 11206 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:44.593175 11176 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:45:44.593357 11176 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/wal
uuid: "8c3fa5f61fb145fa997bb4d6f5ee2923"
format_stamp: "Formatted at 2026-08-12 17:45:43 on dist-test-slave-tk9z"
server_key: "4ffd3c251240672856c3823a91dcdc72"
server_key_iv: "993e4cc8ba7a34df7b7f957dfc64f50b"
server_key_version: "encryptionkey@0"
I20260812 17:45:44.594002 11176 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:45:44.624532 11176 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:45:44.628479 11176 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:45:44.628705 11176 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:45:44.629356 11176 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:45:44.630287 11176 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:45:44.630336 11176 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:44.630438 11176 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:45:44.630477 11176 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:44.640095 11176 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.3:36643
I20260812 17:45:44.640184 11411 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.3:36643 every 8 connection(s)
I20260812 17:45:44.641242 11176 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
I20260812 17:45:44.646005 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 11176
Aug 12 17:45:44 dist-test-slave-tk9z krb5kdc[9501](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556744, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:45:44.655932 11417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:44.646853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48368 (local address 127.17.255.62:35925)
0812 17:45:44.647127 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:44.647133 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:44.647191 (+ 58us) server_negotiation.cc:407] Connection header received
0812 17:45:44.647326 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:44.647331 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:44.647393 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:44.647504 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:45:44.648338 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:44.648960 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:44.649875 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:44.650212 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:44.650330 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:44.651954 (+ 1624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:45:44.651959 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:45:44.651962 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:45:44.652000 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:45:44.653780 (+ 1780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:44.654302 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:44.654306 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:44.654308 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:44.654436 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:44.654893 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:44.654898 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:44.654900 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:44.655183 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:45:44.655415 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:44.655637 (+ 222us) server_negotiation.cc:299] Negotiation successful
0812 17:45:44.655749 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":81,"threads_started":1}
I20260812 17:45:44.658155 10932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:44.643413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:38609 (local address 127.17.255.62:35925)
0812 17:45:44.643586 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:44.643591 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:44.644607 (+ 1016us) server_negotiation.cc:407] Connection header received
0812 17:45:44.646137 (+ 1530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:44.646142 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:44.646211 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:44.646312 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:45:44.648188 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:44.648739 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:44.650126 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:44.650419 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:44.650521 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:44.653485 (+ 2964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:45:44.653489 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:45:44.653494 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:45:44.653542 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:45:44.655392 (+ 1850us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:44.656218 (+ 826us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:44.656222 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:44.656223 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:44.656313 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:44.656803 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:44.656808 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:44.656810 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:44.657049 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:45:44.657144 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:44.657845 (+ 701us) server_negotiation.cc:299] Negotiation successful
0812 17:45:44.657977 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 17:45:44.659255 11415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:44.643863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.3:38609)
0812 17:45:44.644425 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:44.644476 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 17:45:44.645878 (+ 1402us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:45:44.646678 (+ 800us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:45:44.646687 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:45:44.647357 (+ 670us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:45:44.648018 (+ 661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:44.648035 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:44.648896 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:44.648900 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:44.649997 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:44.650007 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:44.650576 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:44.650579 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:44.650732 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:44.651299 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:45:44.651318 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:45:44.653292 (+ 1974us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:45:44.655527 (+ 2235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:44.655537 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:44.655561 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:44.656024 (+ 463us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:44.656427 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:44.656430 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:44.656432 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:44.656691 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:44.657174 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:45:44.657181 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:45:44.657544 (+ 363us) client_negotiation.cc:769] Sending connection context
0812 17:45:44.657800 (+ 256us) client_negotiation.cc:240] Negotiation successful
0812 17:45:44.658185 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":124,"threads_started":1}
I20260812 17:45:44.660485 11412 heartbeater.cc:347] Connected to a master server at 127.17.255.62:35925
I20260812 17:45:44.660795 11412 heartbeater.cc:464] Registering TS with master...
I20260812 17:45:44.661394 11412 heartbeater.cc:511] Master 127.17.255.62:35925 requested a full tablet report, sending...
I20260812 17:45:44.662747 10587 ts_manager.cc:194] Registered new tserver with Master: 8c3fa5f61fb145fa997bb4d6f5ee2923 (127.17.255.3:36643)
I20260812 17:45:44.663378 10587 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.3@KRBTEST.COM'} at 127.17.255.3:38609
I20260812 17:45:44.670660 18428 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 17:45:44.676121 10932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:44.671529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48372 (local address 127.17.255.62:35925)
0812 17:45:44.671752 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:44.671757 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:44.671940 (+ 183us) server_negotiation.cc:407] Connection header received
0812 17:45:44.672182 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:44.672185 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:44.672344 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:44.672491 (+ 147us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:45:44.672776 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:44.673330 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:44.674275 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:44.674697 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:44.674863 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:44.675230 (+ 367us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:45:44.675696 (+ 466us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:45:44.675861 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:44.675895 (+ 34us) server_negotiation.cc:299] Negotiation successful
0812 17:45:44.675955 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113}
I20260812 17:45:44.677016 10587 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:48372:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 17:45:44.680727 10587 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 17:45:44.690016 10814 tablet_service.cc:1467] Processing CreateTablet for tablet 23f08307ec6d4e8fab41f129221e724d (DEFAULT_TABLE table=test-table [id=3d7485f9d3d04b499002b09e21f3ee59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:45:44.690843 10814 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23f08307ec6d4e8fab41f129221e724d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:45:44.693822 10738 tablet_bootstrap.cc:492] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4: Bootstrap starting.
I20260812 17:45:44.694905 10738 tablet_bootstrap.cc:654] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4: Neither blocks nor log segments found. Creating new log.
I20260812 17:45:44.695540 11426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:44.688846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.3:36643 (local address 127.0.0.1:38902)
0812 17:45:44.689156 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:44.689172 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 17:45:44.689265 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:45:44.690880 (+ 1615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:45:44.690883 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:45:44.690900 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:45:44.691010 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:44.691016 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:44.692904 (+ 1888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:44.692908 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:44.693997 (+ 1089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:44.694011 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:44.695077 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:44.695081 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:44.695169 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:44.695218 (+ 49us) client_negotiation.cc:769] Sending connection context
0812 17:45:44.695305 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 17:45:44.695392 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":118,"threads_started":1}
I20260812 17:45:44.695590 11431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:44.689595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38902 (local address 127.17.255.3:36643)
0812 17:45:44.689926 (+ 331us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:44.689941 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:44.689970 (+ 29us) server_negotiation.cc:407] Connection header received
0812 17:45:44.690040 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:44.690044 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:44.690516 (+ 472us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:44.691186 (+ 670us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:45:44.691462 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:44.692716 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:44.694149 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:44.694942 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:44.695077 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:44.695250 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:44.695342 (+ 92us) server_negotiation.cc:299] Negotiation successful
0812 17:45:44.695453 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":132,"threads_started":1}
I20260812 17:45:44.696643 10738 tablet_bootstrap.cc:492] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4: No bootstrap required, opened a new log
I20260812 17:45:44.696750 10738 ts_tablet_manager.cc:1397] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 17:45:44.697101 10942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:44.688580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:37663 (local address 127.0.0.1:60928)
0812 17:45:44.688727 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:44.688748 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 17:45:44.688847 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:45:44.689933 (+ 1086us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:45:44.689937 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:45:44.689956 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:45:44.690078 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:44.690085 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:44.691754 (+ 1669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:44.691758 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:44.693102 (+ 1344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:44.693113 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:44.696631 (+ 3518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:44.696635 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:44.696744 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:44.696774 (+ 30us) client_negotiation.cc:769] Sending connection context
0812 17:45:44.696872 (+ 98us) client_negotiation.cc:240] Negotiation successful
0812 17:45:44.696975 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260812 17:45:44.697204 11429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:44.688888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60928 (local address 127.17.255.2:37663)
0812 17:45:44.689317 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:44.689333 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:44.689362 (+ 29us) server_negotiation.cc:407] Connection header received
0812 17:45:44.689453 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:44.689465 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:44.689732 (+ 267us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:44.690280 (+ 548us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:45:44.690496 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:44.691592 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:44.693248 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:44.696471 (+ 3223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:44.696609 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:44.696787 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:44.696925 (+ 138us) server_negotiation.cc:299] Negotiation successful
0812 17:45:44.697035 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":168,"threads_started":1}
I20260812 17:45:44.697502 10738 raft_consensus.cc:348] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc53fa9679cb4e2ba9c5e0d3b9dac0ad" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 37663 } } peers { permanent_uuid: "8c3fa5f61fb145fa997bb4d6f5ee2923" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36643 } } peers { permanent_uuid: "5adc202b3d744c37a24e0aa492506ed4" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 38933 } }
I20260812 17:45:44.697606 10738 raft_consensus.cc:374] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:45:44.697633 10738 raft_consensus.cc:729] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5adc202b3d744c37a24e0aa492506ed4, State: Initialized, Role: FOLLOWER
I20260812 17:45:44.697783 10738 consensus_queue.cc:260] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc53fa9679cb4e2ba9c5e0d3b9dac0ad" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 37663 } } peers { permanent_uuid: "8c3fa5f61fb145fa997bb4d6f5ee2923" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36643 } } peers { permanent_uuid: "5adc202b3d744c37a24e0aa492506ed4" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 38933 } }
I20260812 17:45:44.698091 10738 ts_tablet_manager.cc:1428] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 17:45:44.699620 11292 tablet_service.cc:1467] Processing CreateTablet for tablet 23f08307ec6d4e8fab41f129221e724d (DEFAULT_TABLE table=test-table [id=3d7485f9d3d04b499002b09e21f3ee59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:45:44.700517 11053 tablet_service.cc:1467] Processing CreateTablet for tablet 23f08307ec6d4e8fab41f129221e724d (DEFAULT_TABLE table=test-table [id=3d7485f9d3d04b499002b09e21f3ee59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:45:44.701030 11292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23f08307ec6d4e8fab41f129221e724d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:45:44.701730 11053 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23f08307ec6d4e8fab41f129221e724d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 17:45:44.704855 10930 tablet.cc:2369] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 17:45:44.710354 11433 tablet_bootstrap.cc:492] T 23f08307ec6d4e8fab41f129221e724d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad: Bootstrap starting.
I20260812 17:45:44.710354 11437 tablet_bootstrap.cc:492] T 23f08307ec6d4e8fab41f129221e724d P 8c3fa5f61fb145fa997bb4d6f5ee2923: Bootstrap starting.
I20260812 17:45:44.712713 11437 tablet_bootstrap.cc:654] T 23f08307ec6d4e8fab41f129221e724d P 8c3fa5f61fb145fa997bb4d6f5ee2923: Neither blocks nor log segments found. Creating new log.
I20260812 17:45:44.713439 11433 tablet_bootstrap.cc:654] T 23f08307ec6d4e8fab41f129221e724d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad: Neither blocks nor log segments found. Creating new log.
I20260812 17:45:44.714325 11433 log.cc:824] T 23f08307ec6d4e8fab41f129221e724d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad: Log is configured to *not* fsync() on all Append() calls
I20260812 17:45:44.714321 11437 log.cc:824] T 23f08307ec6d4e8fab41f129221e724d P 8c3fa5f61fb145fa997bb4d6f5ee2923: Log is configured to *not* fsync() on all Append() calls
I20260812 17:45:44.716475 11437 tablet_bootstrap.cc:492] T 23f08307ec6d4e8fab41f129221e724d P 8c3fa5f61fb145fa997bb4d6f5ee2923: No bootstrap required, opened a new log
I20260812 17:45:44.716499 11433 tablet_bootstrap.cc:492] T 23f08307ec6d4e8fab41f129221e724d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad: No bootstrap required, opened a new log
I20260812 17:45:44.716710 11437 ts_tablet_manager.cc:1397] T 23f08307ec6d4e8fab41f129221e724d P 8c3fa5f61fb145fa997bb4d6f5ee2923: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.002s
I20260812 17:45:44.716714 11433 ts_tablet_manager.cc:1397] T 23f08307ec6d4e8fab41f129221e724d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260812 17:45:44.720513 11437 raft_consensus.cc:348] T 23f08307ec6d4e8fab41f129221e724d P 8c3fa5f61fb145fa997bb4d6f5ee2923 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc53fa9679cb4e2ba9c5e0d3b9dac0ad" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 37663 } } peers { permanent_uuid: "8c3fa5f61fb145fa997bb4d6f5ee2923" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36643 } } peers { permanent_uuid: "5adc202b3d744c37a24e0aa492506ed4" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 38933 } }
I20260812 17:45:44.720511 11433 raft_consensus.cc:348] T 23f08307ec6d4e8fab41f129221e724d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc53fa9679cb4e2ba9c5e0d3b9dac0ad" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 37663 } } peers { permanent_uuid: "8c3fa5f61fb145fa997bb4d6f5ee2923" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36643 } } peers { permanent_uuid: "5adc202b3d744c37a24e0aa492506ed4" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 38933 } }
I20260812 17:45:44.720763 11437 raft_consensus.cc:374] T 23f08307ec6d4e8fab41f129221e724d P 8c3fa5f61fb145fa997bb4d6f5ee2923 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:45:44.720793 11433 raft_consensus.cc:374] T 23f08307ec6d4e8fab41f129221e724d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:45:44.720842 11437 raft_consensus.cc:729] T 23f08307ec6d4e8fab41f129221e724d P 8c3fa5f61fb145fa997bb4d6f5ee2923 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3fa5f61fb145fa997bb4d6f5ee2923, State: Initialized, Role: FOLLOWER
I20260812 17:45:44.720865 11433 raft_consensus.cc:729] T 23f08307ec6d4e8fab41f129221e724d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc53fa9679cb4e2ba9c5e0d3b9dac0ad, State: Initialized, Role: FOLLOWER
I20260812 17:45:44.721352 11437 consensus_queue.cc:260] T 23f08307ec6d4e8fab41f129221e724d P 8c3fa5f61fb145fa997bb4d6f5ee2923 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc53fa9679cb4e2ba9c5e0d3b9dac0ad" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 37663 } } peers { permanent_uuid: "8c3fa5f61fb145fa997bb4d6f5ee2923" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36643 } } peers { permanent_uuid: "5adc202b3d744c37a24e0aa492506ed4" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 38933 } }
I20260812 17:45:44.721431 11433 consensus_queue.cc:260] T 23f08307ec6d4e8fab41f129221e724d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc53fa9679cb4e2ba9c5e0d3b9dac0ad" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 37663 } } peers { permanent_uuid: "8c3fa5f61fb145fa997bb4d6f5ee2923" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36643 } } peers { permanent_uuid: "5adc202b3d744c37a24e0aa492506ed4" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 38933 } }
I20260812 17:45:44.722167 11169 heartbeater.cc:503] Master 127.17.255.62:35925 was elected leader, sending a full tablet report...
I20260812 17:45:44.722158 11412 heartbeater.cc:503] Master 127.17.255.62:35925 was elected leader, sending a full tablet report...
I20260812 17:45:44.722599 11437 ts_tablet_manager.cc:1428] T 23f08307ec6d4e8fab41f129221e724d P 8c3fa5f61fb145fa997bb4d6f5ee2923: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20260812 17:45:44.723304 11433 ts_tablet_manager.cc:1428] T 23f08307ec6d4e8fab41f129221e724d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260812 17:45:44.747485 10941 raft_consensus.cc:482] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:45:44.747756 10941 raft_consensus.cc:504] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc53fa9679cb4e2ba9c5e0d3b9dac0ad" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 37663 } } peers { permanent_uuid: "8c3fa5f61fb145fa997bb4d6f5ee2923" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36643 } } peers { permanent_uuid: "5adc202b3d744c37a24e0aa492506ed4" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 38933 } }
I20260812 17:45:44.748988 10941 leader_election.cc:288] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc53fa9679cb4e2ba9c5e0d3b9dac0ad (127.17.255.2:37663), 8c3fa5f61fb145fa997bb4d6f5ee2923 (127.17.255.3:36643)
I20260812 17:45:44.753144 11429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:44.749390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:46721 (local address 127.17.255.2:37663)
0812 17:45:44.749546 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:44.749551 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:44.749732 (+ 181us) server_negotiation.cc:407] Connection header received
0812 17:45:44.749951 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:44.749955 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:44.750028 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:44.750107 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:45:44.750435 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:44.750942 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:44.752117 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:44.752513 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:44.752644 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:44.752701 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:44.752911 (+ 210us) server_negotiation.cc:299] Negotiation successful
0812 17:45:44.752995 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 17:45:44.753161 11431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:44.749399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:44093 (local address 127.17.255.3:36643)
0812 17:45:44.749545 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:44.749551 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:44.749914 (+ 363us) server_negotiation.cc:407] Connection header received
0812 17:45:44.750082 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:44.750085 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:44.750132 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:44.750226 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:45:44.750586 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:44.751082 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:44.752135 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:44.752554 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:44.752695 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:44.752753 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:44.752947 (+ 194us) server_negotiation.cc:299] Negotiation successful
0812 17:45:44.753029 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 17:45:44.753191 11444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:44.749231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.3:36643 (local address 127.17.255.1:44093)
0812 17:45:44.749806 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:44.749818 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 17:45:44.749954 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:45:44.750240 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:45:44.750243 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:45:44.750304 (+ 61us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:45:44.750467 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:44.750474 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:44.751205 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:44.751210 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:44.751994 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:44.752004 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:44.752690 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:44.752694 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:44.752806 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:44.752829 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 17:45:44.752930 (+ 101us) client_negotiation.cc:240] Negotiation successful
0812 17:45:44.753032 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"mutex_wait_us":257,"thread_start_us":109,"threads_started":1}
I20260812 17:45:44.753228 11443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:44.749231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:37663 (local address 127.17.255.1:46721)
0812 17:45:44.749632 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:44.749645 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 17:45:44.749794 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:45:44.750129 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:45:44.750131 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:45:44.750150 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:45:44.750289 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:44.750295 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:44.751066 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:44.751071 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:44.751989 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:44.751999 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:44.752645 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:44.752648 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:44.752753 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:44.752800 (+ 47us) client_negotiation.cc:769] Sending connection context
0812 17:45:44.752893 (+ 93us) client_negotiation.cc:240] Negotiation successful
0812 17:45:44.752995 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"mutex_wait_us":59,"thread_start_us":78,"threads_started":1}
I20260812 17:45:44.754115 11081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23f08307ec6d4e8fab41f129221e724d" candidate_uuid: "5adc202b3d744c37a24e0aa492506ed4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc53fa9679cb4e2ba9c5e0d3b9dac0ad" is_pre_election: true
I20260812 17:45:44.754662 11081 raft_consensus.cc:2454] T 23f08307ec6d4e8fab41f129221e724d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5adc202b3d744c37a24e0aa492506ed4 in term 0.
I20260812 17:45:44.754727 11334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23f08307ec6d4e8fab41f129221e724d" candidate_uuid: "5adc202b3d744c37a24e0aa492506ed4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3fa5f61fb145fa997bb4d6f5ee2923" is_pre_election: true
I20260812 17:45:44.755141 11334 raft_consensus.cc:2454] T 23f08307ec6d4e8fab41f129221e724d P 8c3fa5f61fb145fa997bb4d6f5ee2923 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5adc202b3d744c37a24e0aa492506ed4 in term 0.
I20260812 17:45:44.755381 10734 leader_election.cc:302] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5adc202b3d744c37a24e0aa492506ed4, cc53fa9679cb4e2ba9c5e0d3b9dac0ad; no voters:
I20260812 17:45:44.755766 10941 raft_consensus.cc:2781] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 17:45:44.755867 10941 raft_consensus.cc:482] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 17:45:44.755913 10941 raft_consensus.cc:3037] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:45:44.757158 10941 raft_consensus.cc:504] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc53fa9679cb4e2ba9c5e0d3b9dac0ad" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 37663 } } peers { permanent_uuid: "8c3fa5f61fb145fa997bb4d6f5ee2923" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36643 } } peers { permanent_uuid: "5adc202b3d744c37a24e0aa492506ed4" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 38933 } }
I20260812 17:45:44.757688 10941 leader_election.cc:288] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [CANDIDATE]: Term 1 election: Requested vote from peers cc53fa9679cb4e2ba9c5e0d3b9dac0ad (127.17.255.2:37663), 8c3fa5f61fb145fa997bb4d6f5ee2923 (127.17.255.3:36643)
I20260812 17:45:44.758159 11334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23f08307ec6d4e8fab41f129221e724d" candidate_uuid: "5adc202b3d744c37a24e0aa492506ed4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3fa5f61fb145fa997bb4d6f5ee2923"
I20260812 17:45:44.758306 11334 raft_consensus.cc:3037] T 23f08307ec6d4e8fab41f129221e724d P 8c3fa5f61fb145fa997bb4d6f5ee2923 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:45:44.758330 11081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23f08307ec6d4e8fab41f129221e724d" candidate_uuid: "5adc202b3d744c37a24e0aa492506ed4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc53fa9679cb4e2ba9c5e0d3b9dac0ad"
I20260812 17:45:44.758502 11081 raft_consensus.cc:3037] T 23f08307ec6d4e8fab41f129221e724d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:45:44.759529 11334 raft_consensus.cc:2454] T 23f08307ec6d4e8fab41f129221e724d P 8c3fa5f61fb145fa997bb4d6f5ee2923 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5adc202b3d744c37a24e0aa492506ed4 in term 1.
I20260812 17:45:44.759645 11081 raft_consensus.cc:2454] T 23f08307ec6d4e8fab41f129221e724d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5adc202b3d744c37a24e0aa492506ed4 in term 1.
I20260812 17:45:44.759986 10730 leader_election.cc:302] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5adc202b3d744c37a24e0aa492506ed4, 8c3fa5f61fb145fa997bb4d6f5ee2923; no voters:
I20260812 17:45:44.760211 10941 raft_consensus.cc:2781] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:45:44.760422 10941 raft_consensus.cc:686] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [term 1 LEADER]: Becoming Leader. State: Replica: 5adc202b3d744c37a24e0aa492506ed4, State: Running, Role: LEADER
I20260812 17:45:44.760723 10941 consensus_queue.cc:237] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc53fa9679cb4e2ba9c5e0d3b9dac0ad" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 37663 } } peers { permanent_uuid: "8c3fa5f61fb145fa997bb4d6f5ee2923" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36643 } } peers { permanent_uuid: "5adc202b3d744c37a24e0aa492506ed4" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 38933 } }
I20260812 17:45:44.764107 10586 catalog_manager.cc:5495] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5adc202b3d744c37a24e0aa492506ed4 (127.17.255.1). New cstate: current_term: 1 leader_uuid: "5adc202b3d744c37a24e0aa492506ed4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc53fa9679cb4e2ba9c5e0d3b9dac0ad" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 37663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3fa5f61fb145fa997bb4d6f5ee2923" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5adc202b3d744c37a24e0aa492506ed4" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 38933 } health_report { overall_health: HEALTHY } } }
I20260812 17:45:44.785990 11454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:44.782288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57550 (local address 127.17.255.1:38933)
0812 17:45:44.782631 (+ 343us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:44.782638 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:44.782651 (+ 13us) server_negotiation.cc:407] Connection header received
0812 17:45:44.782733 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:44.782735 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:44.782797 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:44.782918 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:45:44.783163 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:44.783757 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:44.784624 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:44.784859 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:44.784950 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:44.785177 (+ 227us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:45:44.785632 (+ 455us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:45:44.785726 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:44.785794 (+ 68us) server_negotiation.cc:299] Negotiation successful
0812 17:45:44.785865 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267,"thread_start_us":177,"threads_started":1}
I20260812 17:45:44.790129 11334 raft_consensus.cc:1261] T 23f08307ec6d4e8fab41f129221e724d P 8c3fa5f61fb145fa997bb4d6f5ee2923 [term 1 FOLLOWER]: Refusing update from remote peer 5adc202b3d744c37a24e0aa492506ed4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:45:44.790128 11081 raft_consensus.cc:1261] T 23f08307ec6d4e8fab41f129221e724d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad [term 1 FOLLOWER]: Refusing update from remote peer 5adc202b3d744c37a24e0aa492506ed4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:45:44.790988 11449 consensus_queue.cc:1035] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc53fa9679cb4e2ba9c5e0d3b9dac0ad" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 37663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:45:44.791234 10941 consensus_queue.cc:1035] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3fa5f61fb145fa997bb4d6f5ee2923" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:45:44.798997 11455 mvcc.cc:205] Tried to move back new op lower bound from 7317736426653777920 to 7317736426542759936. Current Snapshot: MvccSnapshot[applied={T|T < 7317736426653777920}]
I20260812 17:45:44.799710 11456 mvcc.cc:205] Tried to move back new op lower bound from 7317736426653777920 to 7317736426542759936. Current Snapshot: MvccSnapshot[applied={T|T < 7317736426653777920}]
I20260812 17:45:44.810724 10585 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:48372:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:45:44.810909 10585 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:48372:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:45:44.813632 10585 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0: Sending DeleteTablet for 3 replicas of tablet 23f08307ec6d4e8fab41f129221e724d
I20260812 17:45:44.814514 10814 tablet_service.cc:1514] Processing DeleteTablet for tablet 23f08307ec6d4e8fab41f129221e724d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:45:44 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:57544
I20260812 17:45:44.814543 11053 tablet_service.cc:1514] Processing DeleteTablet for tablet 23f08307ec6d4e8fab41f129221e724d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:45:44 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:60928
I20260812 17:45:44.814623 11292 tablet_service.cc:1514] Processing DeleteTablet for tablet 23f08307ec6d4e8fab41f129221e724d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:45:44 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:38902
I20260812 17:45:44.814975 11469 tablet_replica.cc:330] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4: stopping tablet replica
I20260812 17:45:44.815112 11469 raft_consensus.cc:2229] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [term 1 LEADER]: Raft consensus shutting down.
I20260812 17:45:44.815359 11471 tablet_replica.cc:330] T 23f08307ec6d4e8fab41f129221e724d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad: stopping tablet replica
I20260812 17:45:44.815429 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 10665
I20260812 17:45:44.843088 11471 raft_consensus.cc:2229] T 23f08307ec6d4e8fab41f129221e724d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:45:44.843665 11471 raft_consensus.cc:2258] T 23f08307ec6d4e8fab41f129221e724d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:45:44.847258 11471 ts_tablet_manager.cc:1905] T 23f08307ec6d4e8fab41f129221e724d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:45:44.850857 11472 tablet_replica.cc:330] T 23f08307ec6d4e8fab41f129221e724d P 8c3fa5f61fb145fa997bb4d6f5ee2923: stopping tablet replica
I20260812 17:45:44.851338 11472 raft_consensus.cc:2229] T 23f08307ec6d4e8fab41f129221e724d P 8c3fa5f61fb145fa997bb4d6f5ee2923 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:45:44.851466 11471 ts_tablet_manager.cc:1918] T 23f08307ec6d4e8fab41f129221e724d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 17:45:44.851595 11471 log.cc:1196] T 23f08307ec6d4e8fab41f129221e724d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/wal/wals/23f08307ec6d4e8fab41f129221e724d
I20260812 17:45:44.851818 11472 raft_consensus.cc:2258] T 23f08307ec6d4e8fab41f129221e724d P 8c3fa5f61fb145fa997bb4d6f5ee2923 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:45:44.852012 11471 ts_tablet_manager.cc:1939] T 23f08307ec6d4e8fab41f129221e724d P cc53fa9679cb4e2ba9c5e0d3b9dac0ad: Deleting consensus metadata
I20260812 17:45:44.853469 10569 catalog_manager.cc:4841] TS cc53fa9679cb4e2ba9c5e0d3b9dac0ad (127.17.255.2:37663): tablet 23f08307ec6d4e8fab41f129221e724d (table test-table [id=3d7485f9d3d04b499002b09e21f3ee59]) successfully deleted
I20260812 17:45:44.853896 11472 ts_tablet_manager.cc:1905] T 23f08307ec6d4e8fab41f129221e724d P 8c3fa5f61fb145fa997bb4d6f5ee2923: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:45:44.857689 11472 ts_tablet_manager.cc:1918] T 23f08307ec6d4e8fab41f129221e724d P 8c3fa5f61fb145fa997bb4d6f5ee2923: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 17:45:44.857893 11472 log.cc:1196] T 23f08307ec6d4e8fab41f129221e724d P 8c3fa5f61fb145fa997bb4d6f5ee2923: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/wal/wals/23f08307ec6d4e8fab41f129221e724d
I20260812 17:45:44.858299 11472 ts_tablet_manager.cc:1939] T 23f08307ec6d4e8fab41f129221e724d P 8c3fa5f61fb145fa997bb4d6f5ee2923: Deleting consensus metadata
W20260812 17:45:44.859361 10563 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.255.1:38933 (error 108)
I20260812 17:45:44.859655 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 10934
I20260812 17:45:44.866110 10563 catalog_manager.cc:4841] TS 8c3fa5f61fb145fa997bb4d6f5ee2923 (127.17.255.3:36643): tablet 23f08307ec6d4e8fab41f129221e724d (table test-table [id=3d7485f9d3d04b499002b09e21f3ee59]) successfully deleted
I20260812 17:45:44.866446 10942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:44.865934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:38933 (local address 127.0.0.1:57562)
0812 17:45:44.866138 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:44.866248 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.1:38933: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260812 17:45:44.866677 10563 catalog_manager.cc:4584] TS 5adc202b3d744c37a24e0aa492506ed4 (127.17.255.1:38933): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 23f08307ec6d4e8fab41f129221e724d: Network error: Client connection negotiation failed: client connection to 127.17.255.1:38933: connect: Connection refused (error 111)
I20260812 17:45:44.872294 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 11176
I20260812 17:45:44.893353 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 10539
I20260812 17:45:44.910952 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:35925
--webserver_interface=127.17.255.62
--webserver_port=40023
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:38991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:35925
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:45:45.029136 11474 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:45:45.029495 11474 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:45:45.029579 11474 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:45:45.033818 11474 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:45:45.033950 11474 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:45:45.033991 11474 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:45:45.034032 11474 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:45:45.034065 11474 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:45:45.039743 11474 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:38991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:35925
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:35925
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=40023
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11474
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:45:45.040974 11474 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:45:45.042091 11474 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:45:45.050930 11484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:45:45.050931 11483 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:45:45.051041 11474 server_base.cc:1034] running on GCE node
W20260812 17:45:45.051043 11491 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:45:45.051863 11474 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:45:45.053004 11474 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:45:45.054194 11474 hybrid_clock.cc:648] HybridClock initialized: now 1786556745054167 us; error 42 us; skew 500 ppm
Aug 12 17:45:45 dist-test-slave-tk9z krb5kdc[9501](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556745, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:45:45.057232 11474 init.cc:377] Logged in from keytab as kudu/127.17.255.62@KRBTEST.COM (short username kudu)
I20260812 17:45:45.058177 11474 webserver.cc:460] Webserver started at http://127.17.255.62:40023/ using document root <none> and password file <none>
I20260812 17:45:45.058907 11474 fs_manager.cc:359] Metadata directory not provided
I20260812 17:45:45.058985 11474 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:45:45.063088 11474 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:45:45.065476 11509 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:45.066888 11474 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:45:45.067034 11474 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "3fedf30da66b4795aa5ccab7b46ee0b0"
format_stamp: "Formatted at 2026-08-12 17:45:42 on dist-test-slave-tk9z"
server_key: "c4ee715cc8b78617a14e5d1258c860bf"
server_key_iv: "c7dd9c463d8f02f201bc36a06207861d"
server_key_version: "encryptionkey@0"
I20260812 17:45:45.067619 11474 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:45:45.083106 11474 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:45:45.086833 11474 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:45:45.087065 11474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:45:45.095113 11474 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:35925
I20260812 17:45:45.095486 11590 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:35925 every 8 connection(s)
I20260812 17:45:45.096365 11474 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:45:45.099042 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 11474
I20260812 17:45:45.099536 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.1:38933
--local_ip_for_outbound_sockets=127.17.255.1
--tserver_master_addrs=127.17.255.62:35925
--webserver_port=45161
--webserver_interface=127.17.255.1
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:38991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 17:45:45.101843 11591 sys_catalog.cc:263] Verifying existing consensus state
I20260812 17:45:45.104710 11591 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0: Bootstrap starting.
I20260812 17:45:45.133031 11591 log.cc:824] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0: Log is configured to *not* fsync() on all Append() calls
I20260812 17:45:45.148573 11591 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 17:45:45.149046 11591 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0: Bootstrap complete.
I20260812 17:45:45.153374 11591 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fedf30da66b4795aa5ccab7b46ee0b0" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 35925 } }
I20260812 17:45:45.153779 11591 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fedf30da66b4795aa5ccab7b46ee0b0, State: Initialized, Role: FOLLOWER
I20260812 17:45:45.154353 11591 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fedf30da66b4795aa5ccab7b46ee0b0" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 35925 } }
I20260812 17:45:45.154505 11591 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:45:45.154603 11591 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:45:45.154727 11591 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [term 2 FOLLOWER]: Advancing to term 3
I20260812 17:45:45.156831 11591 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fedf30da66b4795aa5ccab7b46ee0b0" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 35925 } }
I20260812 17:45:45.157189 11591 leader_election.cc:302] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3fedf30da66b4795aa5ccab7b46ee0b0; no voters:
I20260812 17:45:45.157536 11591 leader_election.cc:288] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260812 17:45:45.157687 11600 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 17:45:45.157971 11600 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [term 3 LEADER]: Becoming Leader. State: Replica: 3fedf30da66b4795aa5ccab7b46ee0b0, State: Running, Role: LEADER
I20260812 17:45:45.158341 11600 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fedf30da66b4795aa5ccab7b46ee0b0" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 35925 } }
I20260812 17:45:45.158954 11591 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:45:45.160020 11601 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "3fedf30da66b4795aa5ccab7b46ee0b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fedf30da66b4795aa5ccab7b46ee0b0" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 35925 } } }
I20260812 17:45:45.160171 11601 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [sys.catalog]: This master's current role is: LEADER
I20260812 17:45:45.160506 11602 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3fedf30da66b4795aa5ccab7b46ee0b0. Latest consensus state: current_term: 3 leader_uuid: "3fedf30da66b4795aa5ccab7b46ee0b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fedf30da66b4795aa5ccab7b46ee0b0" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 35925 } } }
I20260812 17:45:45.160609 11602 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3fedf30da66b4795aa5ccab7b46ee0b0 [sys.catalog]: This master's current role is: LEADER
I20260812 17:45:45.160996 11618 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:45:45.166862 11618 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:45:45.167716 11618 catalog_manager.cc:1259] Loaded cluster ID: 3a8795c3560d40b69e74691da8fefd56
I20260812 17:45:45.167797 11618 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260812 17:45:45.169365 11618 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fc57275f9ad google::LogMessage::Fail() at ??:0
@ 0x7fc57276288a google::LogMessage::SendToLog() at ??:0
@ 0x7fc57275f4de google::LogMessage::Flush() at ??:0
@ 0x7fc572760a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fc57d0a2fdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7fc57d0a3d2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fc57d0a0579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7fc57d0e4640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fc5749b13d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fc5749b1c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7fc5749b33f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fc5749a2512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fc575fe66db start_thread at ??:0
@ 0x7fc57125d61f clone at ??:0
W20260812 17:45:45.267776 11595 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:45:45.268108 11595 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:45:45.268187 11595 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:45:45.272542 11595 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:45:45.272647 11595 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:45:45.272742 11595 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.1
I20260812 17:45:45.278605 11595 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:38991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.1:38933
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.255.1
--webserver_port=45161
--tserver_master_addrs=127.17.255.62:35925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11595
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.1
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:45:45.279835 11595 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:45:45.280964 11595 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:45:45.292122 11661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:45:45.292122 11664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:45:45.292115 11669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:45:45.292594 11595 server_base.cc:1034] running on GCE node
I20260812 17:45:45.293125 11595 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:45:45.293928 11595 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:45:45.295130 11595 hybrid_clock.cc:648] HybridClock initialized: now 1786556745295114 us; error 33 us; skew 500 ppm
Aug 12 17:45:45 dist-test-slave-tk9z krb5kdc[9501](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556745, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:45:45.298660 11595 init.cc:377] Logged in from keytab as kudu/127.17.255.1@KRBTEST.COM (short username kudu)
I20260812 17:45:45.300086 11595 webserver.cc:460] Webserver started at http://127.17.255.1:45161/ using document root <none> and password file <none>
I20260812 17:45:45.300964 11595 fs_manager.cc:359] Metadata directory not provided
I20260812 17:45:45.301083 11595 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:45:45.307178 11595 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 17:45:45.310421 11690 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:45.312248 11595 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 17:45:45.312391 11595 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/wal
uuid: "5adc202b3d744c37a24e0aa492506ed4"
format_stamp: "Formatted at 2026-08-12 17:45:42 on dist-test-slave-tk9z"
server_key: "6c490ea9ec14c47f131004164d390559"
server_key_iv: "65ae582cbc754536e0a24cddb74b9d63"
server_key_version: "encryptionkey@0"
I20260812 17:45:45.313230 11595 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:45:45.340329 11595 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:45:45.344964 11595 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:45:45.345214 11595 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:45:45.346057 11595 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:45:45.347710 11705 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 17:45:45.352240 11595 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 17:45:45.352335 11595 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.001s sys 0.000s
I20260812 17:45:45.352414 11595 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 17:45:45.355120 11595 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 17:45:45.355193 11595 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.002s sys 0.000s
I20260812 17:45:45.355566 11705 tablet_bootstrap.cc:492] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4: Bootstrap starting.
I20260812 17:45:45.367868 11595 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.1:38933
I20260812 17:45:45.368175 11896 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.1:38933 every 8 connection(s)
I20260812 17:45:45.369412 11595 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
I20260812 17:45:45.376865 11705 log.cc:824] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4: Log is configured to *not* fsync() on all Append() calls
I20260812 17:45:45.379778 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 11595
I20260812 17:45:45.380362 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.2:37663
--local_ip_for_outbound_sockets=127.17.255.2
--tserver_master_addrs=127.17.255.62:35925
--webserver_port=39573
--webserver_interface=127.17.255.2
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:38991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 17:45:45.386250 11705 tablet_bootstrap.cc:492] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 17:45:45.386906 11705 tablet_bootstrap.cc:492] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4: Bootstrap complete.
I20260812 17:45:45.388561 11705 ts_tablet_manager.cc:1397] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4: Time spent bootstrapping tablet: real 0.033s user 0.022s sys 0.009s
I20260812 17:45:45.393591 11705 raft_consensus.cc:348] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc53fa9679cb4e2ba9c5e0d3b9dac0ad" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 37663 } } peers { permanent_uuid: "8c3fa5f61fb145fa997bb4d6f5ee2923" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36643 } } peers { permanent_uuid: "5adc202b3d744c37a24e0aa492506ed4" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 38933 } }
I20260812 17:45:45.394462 11705 raft_consensus.cc:729] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5adc202b3d744c37a24e0aa492506ed4, State: Initialized, Role: FOLLOWER
I20260812 17:45:45.395186 11705 consensus_queue.cc:260] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc53fa9679cb4e2ba9c5e0d3b9dac0ad" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 37663 } } peers { permanent_uuid: "8c3fa5f61fb145fa997bb4d6f5ee2923" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36643 } } peers { permanent_uuid: "5adc202b3d744c37a24e0aa492506ed4" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 38933 } }
I20260812 17:45:45.396766 11705 ts_tablet_manager.cc:1428] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4: Time spent starting tablet: real 0.008s user 0.006s sys 0.003s
W20260812 17:45:45.429303 11902 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:45:45.372071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.1:33887)
0812 17:45:45.372724 (+ 653us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:45.372785 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0812 17:45:45.374041 (+ 1256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:45:45.428494 (+ 54453us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":169,"threads_started":1}
W20260812 17:45:45.430007 11897 heartbeater.cc:644] Failed to heartbeat to 127.17.255.62:35925 (0 consecutive failures): Network error: Failed to ping master at 127.17.255.62:35925: Client connection negotiation failed: client connection to 127.17.255.62:35925: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 17:45:45.430945 11902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:45.430648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.1:40365)
0812 17:45:45.430786 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:45.430883 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260812 17:45:45.431685 11902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:45.431467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.1:42559)
0812 17:45:45.431580 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:45.431634 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260812 17:45:45.431937 11897 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 17:45:45.520087 11904 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:45:45.520424 11904 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:45:45.520509 11904 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:45:45.524803 11904 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:45:45.524899 11904 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:45:45.524992 11904 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.2
I20260812 17:45:45.530926 11904 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:38991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.2:37663
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.255.2
--webserver_port=39573
--tserver_master_addrs=127.17.255.62:35925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11904
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.2
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:45:45.532218 11904 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:45:45.533623 11904 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:45:45.544276 11916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:45:45.544330 11919 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:45:45.544265 11917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:45:45.544492 11904 server_base.cc:1034] running on GCE node
I20260812 17:45:45.545032 11904 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:45:45.545735 11904 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:45:45.546919 11904 hybrid_clock.cc:648] HybridClock initialized: now 1786556745546878 us; error 52 us; skew 500 ppm
Aug 12 17:45:45 dist-test-slave-tk9z krb5kdc[9501](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556745, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:45:45.549974 11904 init.cc:377] Logged in from keytab as kudu/127.17.255.2@KRBTEST.COM (short username kudu)
I20260812 17:45:45.551047 11904 webserver.cc:460] Webserver started at http://127.17.255.2:39573/ using document root <none> and password file <none>
I20260812 17:45:45.551645 11904 fs_manager.cc:359] Metadata directory not provided
I20260812 17:45:45.551710 11904 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:45:45.555833 11904 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 17:45:45.558000 11932 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:45.559571 11904 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 17:45:45.559724 11904 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/wal
uuid: "cc53fa9679cb4e2ba9c5e0d3b9dac0ad"
format_stamp: "Formatted at 2026-08-12 17:45:43 on dist-test-slave-tk9z"
server_key: "849a17ff1381dd62113e2918b7284441"
server_key_iv: "1a9ad396965de95a0ce6ed3f27fdace4"
server_key_version: "encryptionkey@0"
I20260812 17:45:45.560415 11904 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:45:45.582108 11904 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:45:45.586067 11904 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:45:45.586318 11904 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:45:45.587041 11904 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:45:45.588002 11904 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:45:45.588052 11904 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:45.588130 11904 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:45:45.588165 11904 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:45.597446 11904 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.2:37663
I20260812 17:45:45.597517 12147 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.2:37663 every 8 connection(s)
I20260812 17:45:45.598834 11904 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
I20260812 17:45:45.602975 12152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:45.601062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.2:50645)
0812 17:45:45.601592 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:45.602035 (+ 443us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":126,"threads_started":1}
W20260812 17:45:45.603451 12150 heartbeater.cc:644] Failed to heartbeat to 127.17.255.62:35925 (0 consecutive failures): Network error: Failed to ping master at 127.17.255.62:35925: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
I20260812 17:45:45.604136 12152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:45.603894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.2:54201)
0812 17:45:45.604023 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:45.604074 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260812 17:45:45.604768 12152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:45.604532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.2:45441)
0812 17:45:45.604667 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:45.604712 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260812 17:45:45.604873 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 11904
W20260812 17:45:45.605057 12150 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 17:45:45.605362 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.3:36643
--local_ip_for_outbound_sockets=127.17.255.3
--tserver_master_addrs=127.17.255.62:35925
--webserver_port=35499
--webserver_interface=127.17.255.3
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:38991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:45:45.731370 12156 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:45:45.731676 12156 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:45:45.731724 12156 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:45:45.735941 12156 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:45:45.736016 12156 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:45:45.736078 12156 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.3
I20260812 17:45:45.741988 12156 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:38991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.3:36643
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.255.3
--webserver_port=35499
--tserver_master_addrs=127.17.255.62:35925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12156
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.3
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:45:45.743287 12156 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:45:45.744450 12156 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:45:45.754990 12164 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:45:45.755007 12173 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:45:45.755151 12156 server_base.cc:1034] running on GCE node
W20260812 17:45:45.755347 12177 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:45:45.755829 12156 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:45:45.756526 12156 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:45:45.757707 12156 hybrid_clock.cc:648] HybridClock initialized: now 1786556745757690 us; error 32 us; skew 500 ppm
Aug 12 17:45:45 dist-test-slave-tk9z krb5kdc[9501](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556745, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:45:45.760879 12156 init.cc:377] Logged in from keytab as kudu/127.17.255.3@KRBTEST.COM (short username kudu)
I20260812 17:45:45.761895 12156 webserver.cc:460] Webserver started at http://127.17.255.3:35499/ using document root <none> and password file <none>
I20260812 17:45:45.762580 12156 fs_manager.cc:359] Metadata directory not provided
I20260812 17:45:45.762651 12156 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:45:45.767196 12156 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 17:45:45.769586 12192 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:45.771064 12156 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:45:45.771202 12156 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/wal
uuid: "8c3fa5f61fb145fa997bb4d6f5ee2923"
format_stamp: "Formatted at 2026-08-12 17:45:43 on dist-test-slave-tk9z"
server_key: "4ffd3c251240672856c3823a91dcdc72"
server_key_iv: "993e4cc8ba7a34df7b7f957dfc64f50b"
server_key_version: "encryptionkey@0"
I20260812 17:45:45.771795 12156 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:45:45.800789 12156 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:45:45.804572 12156 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:45:45.804800 12156 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:45:45.805505 12156 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:45:45.806511 12156 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:45:45.806562 12156 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:45.806605 12156 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:45:45.806658 12156 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:45:45.816155 12156 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.3:36643
I20260812 17:45:45.816365 12396 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.3:36643 every 8 connection(s)
I20260812 17:45:45.817302 12156 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
I20260812 17:45:45.821559 12400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:45.819767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.3:55341)
0812 17:45:45.820337 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:45.820789 (+ 452us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":122,"threads_started":1}
W20260812 17:45:45.822116 12398 heartbeater.cc:644] Failed to heartbeat to 127.17.255.62:35925 (0 consecutive failures): Network error: Failed to ping master at 127.17.255.62:35925: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
I20260812 17:45:45.822857 12400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:45.822622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.3:57569)
0812 17:45:45.822743 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:45.822799 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260812 17:45:45.823520 12400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:45.823306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.3:36141)
0812 17:45:45.823413 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:45.823464 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260812 17:45:45.823729 12398 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 17:45:45.824167 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 12156
I20260812 17:45:46.433125 12403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:46.432631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.1:58581)
0812 17:45:46.432932 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:46.433003 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":84,"threads_started":1}
I20260812 17:45:46.606289 12406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:46.605747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.2:41667)
0812 17:45:46.606115 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:46.606181 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":101,"threads_started":1}
I20260812 17:45:46.824941 12407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:46.824412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.3:38557)
0812 17:45:46.824764 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:46.824832 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":99,"threads_started":1}
I20260812 17:45:47.181811 12408 raft_consensus.cc:482] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:45:47.182060 12408 raft_consensus.cc:504] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc53fa9679cb4e2ba9c5e0d3b9dac0ad" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 37663 } } peers { permanent_uuid: "8c3fa5f61fb145fa997bb4d6f5ee2923" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36643 } } peers { permanent_uuid: "5adc202b3d744c37a24e0aa492506ed4" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 38933 } }
I20260812 17:45:47.183302 12408 leader_election.cc:288] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cc53fa9679cb4e2ba9c5e0d3b9dac0ad (127.17.255.2:37663), 8c3fa5f61fb145fa997bb4d6f5ee2923 (127.17.255.3:36643)
Aug 12 17:45:47 dist-test-slave-tk9z krb5kdc[9501](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556745, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for kudu/127.17.255.3@KRBTEST.COM
Aug 12 17:45:47 dist-test-slave-tk9z krb5kdc[9501](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556745, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for kudu/127.17.255.2@KRBTEST.COM
I20260812 17:45:47.198215 12413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:47.183583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.3:36643 (local address 127.17.255.1:35921)
0812 17:45:47.184122 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:47.184136 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 17:45:47.184258 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:45:47.185959 (+ 1701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:45:47.185966 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:45:47.186593 (+ 627us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:45:47.187097 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:47.187111 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:47.188414 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:47.188417 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:47.189312 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:47.189323 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:47.190084 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:47.190088 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:47.190328 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:47.191072 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:45:47.191089 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:45:47.192730 (+ 1641us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:45:47.195506 (+ 2776us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:47.195509 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:47.195522 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:47.195971 (+ 449us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:47.196360 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:47.196363 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:47.196365 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:47.196516 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:47.197188 (+ 672us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:45:47.197194 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:45:47.197461 (+ 267us) client_negotiation.cc:769] Sending connection context
0812 17:45:47.197661 (+ 200us) client_negotiation.cc:240] Negotiation successful
0812 17:45:47.198009 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":478,"mutex_wait_us":269,"spinlock_wait_cycles":28928,"thread_start_us":83,"threads_started":1}
I20260812 17:45:47.198230 12414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:47.183920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:35921 (local address 127.17.255.3:36643)
0812 17:45:47.184279 (+ 359us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:47.184301 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:47.184341 (+ 40us) server_negotiation.cc:407] Connection header received
0812 17:45:47.185169 (+ 828us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:47.185177 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:47.185542 (+ 365us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:47.185883 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:45:47.187282 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:47.188249 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:47.189484 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:47.189944 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:47.190122 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:47.193015 (+ 2893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:45:47.193020 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:45:47.193033 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:45:47.193063 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:45:47.195373 (+ 2310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:47.196078 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:47.196084 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:47.196090 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:47.196270 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:47.196625 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:47.196628 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:47.196630 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:47.197058 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:45:47.197213 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:47.197787 (+ 574us) server_negotiation.cc:299] Negotiation successful
0812 17:45:47.198062 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":249,"thread_start_us":85,"threads_started":1}
I20260812 17:45:47.198278 12412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:47.183730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:34061 (local address 127.17.255.2:37663)
0812 17:45:47.184127 (+ 397us) server_negotiation.cc:206] Beginning negotiation
0812 17:45:47.184148 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0812 17:45:47.184200 (+ 52us) server_negotiation.cc:407] Connection header received
0812 17:45:47.185110 (+ 910us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:45:47.185121 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:45:47.185528 (+ 407us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:45:47.185942 (+ 414us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:45:47.187281 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:47.188245 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:47.189466 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:45:47.189948 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:45:47.190128 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:47.193266 (+ 3138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:45:47.193272 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:45:47.193290 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:45:47.193328 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:45:47.195363 (+ 2035us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:47.196125 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:47.196132 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:47.196141 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:47.196299 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:45:47.196643 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:45:47.196647 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:45:47.196649 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:45:47.197058 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:45:47.197214 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0812 17:45:47.197777 (+ 563us) server_negotiation.cc:299] Negotiation successful
0812 17:45:47.198086 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":72,"threads_started":1}
I20260812 17:45:47.198266 12410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:47.183583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:37663 (local address 127.17.255.1:34061)
0812 17:45:47.183893 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:47.183910 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 17:45:47.184029 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:45:47.185960 (+ 1931us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:45:47.185966 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:45:47.186592 (+ 626us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:45:47.187098 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:47.187112 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:47.188405 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:47.188409 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:47.189312 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:45:47.189324 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:45:47.190082 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:45:47.190086 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:45:47.190328 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:45:47.191122 (+ 794us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:45:47.191135 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:45:47.193060 (+ 1925us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:45:47.195498 (+ 2438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:47.195504 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:47.195519 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:47.195983 (+ 464us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:47.196445 (+ 462us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:45:47.196449 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:45:47.196451 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:45:47.196541 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:45:47.197188 (+ 647us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:45:47.197194 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:45:47.197460 (+ 266us) client_negotiation.cc:769] Sending connection context
0812 17:45:47.197660 (+ 200us) client_negotiation.cc:240] Negotiation successful
0812 17:45:47.198103 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"mutex_wait_us":343,"spinlock_wait_cycles":51712,"thread_start_us":62,"threads_started":1}
W20260812 17:45:47.201015 11694 leader_election.cc:341] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8c3fa5f61fb145fa997bb4d6f5ee2923 (127.17.255.3:36643): Not found: Tablet not found: 23f08307ec6d4e8fab41f129221e724d
W20260812 17:45:47.201229 11698 leader_election.cc:341] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cc53fa9679cb4e2ba9c5e0d3b9dac0ad (127.17.255.2:37663): Not found: Tablet not found: 23f08307ec6d4e8fab41f129221e724d
I20260812 17:45:47.201326 11698 leader_election.cc:302] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5adc202b3d744c37a24e0aa492506ed4; no voters: 8c3fa5f61fb145fa997bb4d6f5ee2923, cc53fa9679cb4e2ba9c5e0d3b9dac0ad
I20260812 17:45:47.201686 12408 raft_consensus.cc:2726] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 17:45:47.434569 12410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:47.434096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.1:58555)
0812 17:45:47.434292 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:47.434470 (+ 178us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260812 17:45:47.607719 12415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:47.607244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.2:50451)
0812 17:45:47.607548 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:47.607604 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":99,"threads_started":1}
I20260812 17:45:47.826443 12417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:47.825934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.3:47167)
0812 17:45:47.826222 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:47.826320 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":78,"threads_started":1}
I20260812 17:45:48.435909 12418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:48.435440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.1:49401)
0812 17:45:48.435738 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:48.435803 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":84,"threads_started":1}
I20260812 17:45:48.609223 12419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:48.608736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.2:34629)
0812 17:45:48.609049 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:48.609120 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":84,"threads_started":1}
I20260812 17:45:48.827685 12422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:48.827218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.3:55597)
0812 17:45:48.827491 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:48.827548 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":109,"threads_started":1}
I20260812 17:45:49.437345 12424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:49.436847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.1:47433)
0812 17:45:49.437137 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:49.437198 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":90,"threads_started":1}
I20260812 17:45:49.447086 12427 raft_consensus.cc:482] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:45:49.447244 12427 raft_consensus.cc:504] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc53fa9679cb4e2ba9c5e0d3b9dac0ad" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 37663 } } peers { permanent_uuid: "8c3fa5f61fb145fa997bb4d6f5ee2923" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36643 } } peers { permanent_uuid: "5adc202b3d744c37a24e0aa492506ed4" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 38933 } }
I20260812 17:45:49.447727 12427 leader_election.cc:288] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cc53fa9679cb4e2ba9c5e0d3b9dac0ad (127.17.255.2:37663), 8c3fa5f61fb145fa997bb4d6f5ee2923 (127.17.255.3:36643)
W20260812 17:45:49.448693 11694 leader_election.cc:341] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8c3fa5f61fb145fa997bb4d6f5ee2923 (127.17.255.3:36643): Not found: Tablet not found: 23f08307ec6d4e8fab41f129221e724d
W20260812 17:45:49.448807 11698 leader_election.cc:341] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cc53fa9679cb4e2ba9c5e0d3b9dac0ad (127.17.255.2:37663): Not found: Tablet not found: 23f08307ec6d4e8fab41f129221e724d
I20260812 17:45:49.448935 11698 leader_election.cc:302] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5adc202b3d744c37a24e0aa492506ed4; no voters: 8c3fa5f61fb145fa997bb4d6f5ee2923, cc53fa9679cb4e2ba9c5e0d3b9dac0ad
I20260812 17:45:49.449100 12427 raft_consensus.cc:2726] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 17:45:49.610675 12430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:49.610135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.2:57983)
0812 17:45:49.610508 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:49.610574 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":97,"threads_started":1}
I20260812 17:45:49.828857 12433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:49.828446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.3:52279)
0812 17:45:49.828698 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:49.828753 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":82,"threads_started":1}
I20260812 17:45:50.438977 12435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:50.438435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.1:37355)
0812 17:45:50.438805 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:50.438873 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":76,"threads_started":1}
I20260812 17:45:50.611963 12436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:50.611508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.2:46731)
0812 17:45:50.611804 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:50.611865 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":86,"threads_started":1}
I20260812 17:45:50.830287 12438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:50.829820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.3:35265)
0812 17:45:50.830104 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:50.830168 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":80,"threads_started":1}
I20260812 17:45:51.440385 12439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:51.439937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.1:48933)
0812 17:45:51.440220 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:51.440284 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":85,"threads_started":1}
I20260812 17:45:51.535375 12441 raft_consensus.cc:482] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:45:51.535583 12441 raft_consensus.cc:504] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc53fa9679cb4e2ba9c5e0d3b9dac0ad" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 37663 } } peers { permanent_uuid: "8c3fa5f61fb145fa997bb4d6f5ee2923" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36643 } } peers { permanent_uuid: "5adc202b3d744c37a24e0aa492506ed4" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 38933 } }
I20260812 17:45:51.536089 12441 leader_election.cc:288] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cc53fa9679cb4e2ba9c5e0d3b9dac0ad (127.17.255.2:37663), 8c3fa5f61fb145fa997bb4d6f5ee2923 (127.17.255.3:36643)
W20260812 17:45:51.537052 11698 leader_election.cc:341] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cc53fa9679cb4e2ba9c5e0d3b9dac0ad (127.17.255.2:37663): Not found: Tablet not found: 23f08307ec6d4e8fab41f129221e724d
W20260812 17:45:51.537156 11694 leader_election.cc:341] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8c3fa5f61fb145fa997bb4d6f5ee2923 (127.17.255.3:36643): Not found: Tablet not found: 23f08307ec6d4e8fab41f129221e724d
I20260812 17:45:51.537272 11694 leader_election.cc:302] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5adc202b3d744c37a24e0aa492506ed4; no voters: 8c3fa5f61fb145fa997bb4d6f5ee2923, cc53fa9679cb4e2ba9c5e0d3b9dac0ad
I20260812 17:45:51.537442 12441 raft_consensus.cc:2726] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 17:45:51.613247 12442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:51.612795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.2:37151)
0812 17:45:51.613087 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:51.613148 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":80,"threads_started":1}
I20260812 17:45:51.831821 12446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:51.831352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.3:42625)
0812 17:45:51.831652 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:51.831720 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":86,"threads_started":1}
I20260812 17:45:52.441787 12448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:52.441274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.1:33107)
0812 17:45:52.441608 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:52.441682 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":77,"threads_started":1}
I20260812 17:45:52.614704 12451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:52.614134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.2:33815)
0812 17:45:52.614545 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:52.614604 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":115,"threads_started":1}
I20260812 17:45:52.833273 12452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:52.832749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.3:37493)
0812 17:45:52.833100 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:52.833167 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":112,"threads_started":1}
I20260812 17:45:53.443185 12454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:53.442640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.1:38345)
0812 17:45:53.442993 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:53.443058 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":141,"threads_started":1}
I20260812 17:45:53.616164 12455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:53.615667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.2:49721)
0812 17:45:53.615993 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:53.616061 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":85,"threads_started":1}
I20260812 17:45:53.834704 12456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:53.834119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.3:39827)
0812 17:45:53.834535 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:53.834601 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":97,"threads_started":1}
I20260812 17:45:54.444530 12459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:54.444060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.1:36501)
0812 17:45:54.444360 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:54.444426 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":79,"threads_started":1}
I20260812 17:45:54.617583 12464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:54.617079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.2:54741)
0812 17:45:54.617403 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:54.617474 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":82,"threads_started":1}
I20260812 17:45:54.810532 12470 raft_consensus.cc:482] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:45:54.810683 12470 raft_consensus.cc:504] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc53fa9679cb4e2ba9c5e0d3b9dac0ad" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 37663 } } peers { permanent_uuid: "8c3fa5f61fb145fa997bb4d6f5ee2923" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36643 } } peers { permanent_uuid: "5adc202b3d744c37a24e0aa492506ed4" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 38933 } }
I20260812 17:45:54.811136 12470 leader_election.cc:288] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cc53fa9679cb4e2ba9c5e0d3b9dac0ad (127.17.255.2:37663), 8c3fa5f61fb145fa997bb4d6f5ee2923 (127.17.255.3:36643)
W20260812 17:45:54.811996 11698 leader_election.cc:341] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cc53fa9679cb4e2ba9c5e0d3b9dac0ad (127.17.255.2:37663): Not found: Tablet not found: 23f08307ec6d4e8fab41f129221e724d
W20260812 17:45:54.812114 11694 leader_election.cc:341] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8c3fa5f61fb145fa997bb4d6f5ee2923 (127.17.255.3:36643): Not found: Tablet not found: 23f08307ec6d4e8fab41f129221e724d
I20260812 17:45:54.812234 11694 leader_election.cc:302] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5adc202b3d744c37a24e0aa492506ed4; no voters: 8c3fa5f61fb145fa997bb4d6f5ee2923, cc53fa9679cb4e2ba9c5e0d3b9dac0ad
I20260812 17:45:54.812440 12470 raft_consensus.cc:2726] T 23f08307ec6d4e8fab41f129221e724d P 5adc202b3d744c37a24e0aa492506ed4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 17:45:54.836148 12472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:54.835660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.3:50207)
0812 17:45:54.835944 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:54.836008 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":75,"threads_started":1}
I20260812 17:45:55.446107 12474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:55.445622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.1:44363)
0812 17:45:55.445937 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:55.446006 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":118,"threads_started":1}
I20260812 17:45:55.619189 12475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:55.618738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.2:50961)
0812 17:45:55.619023 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:55.619087 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":80,"threads_started":1}
I20260812 17:45:55.837546 12476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:55.837040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.3:54457)
0812 17:45:55.837353 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:55.837433 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":85,"threads_started":1}
I20260812 17:45:56.447582 12477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:56.447126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.1:57917)
0812 17:45:56.447408 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:56.447476 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":82,"threads_started":1}
I20260812 17:45:56.620487 12479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:56.620024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.2:57135)
0812 17:45:56.620281 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:56.620367 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":78,"threads_started":1}
I20260812 17:45:56.839110 12480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:56.838635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.3:45893)
0812 17:45:56.838928 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:56.839008 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":82,"threads_started":1}
I20260812 17:45:57.449093 12482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:57.448609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.1:55923)
0812 17:45:57.448927 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:57.448992 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":100,"threads_started":1}
I20260812 17:45:57.622025 12484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:57.621559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.2:56943)
0812 17:45:57.621858 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:57.621920 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":80,"threads_started":1}
I20260812 17:45:57.840488 12485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:57.839998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.3:35793)
0812 17:45:57.840307 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:57.840380 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":79,"threads_started":1}
I20260812 17:45:58.450631 12487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:58.450044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.1:59317)
0812 17:45:58.450451 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:58.450518 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":100,"threads_started":1}
I20260812 17:45:58.623458 12490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:58.622919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.2:37457)
0812 17:45:58.623245 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:58.623345 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":82,"threads_started":1}
I20260812 17:45:58.841895 12491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:58.841423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.3:53495)
0812 17:45:58.841726 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:58.841788 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":92,"threads_started":1}
I20260812 17:45:59.452033 12492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:59.451553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.1:51337)
0812 17:45:59.451860 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:59.451928 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":80,"threads_started":1}
I20260812 17:45:59.624846 12493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:59.624401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.2:53829)
0812 17:45:59.624689 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:59.624747 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":100,"threads_started":1}
I20260812 17:45:59.843451 12494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:45:59.842931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.3:40795)
0812 17:45:59.843276 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0812 17:45:59.843341 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":116,"threads_started":1}
I20260812 17:46:00.453682 12498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:00.453176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.1:57581)
0812 17:46:00.453508 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:00.453577 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":81,"threads_started":1}
I20260812 17:46:00.626444 12499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:00.625847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.2:39119)
0812 17:46:00.626183 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:00.626272 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":101,"threads_started":1}
I20260812 17:46:00.832126 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 11595
I20260812 17:46:00.844969 12501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:00.844528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:35925 (local address 127.17.255.3:60885)
0812 17:46:00.844805 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:00.844867 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:35925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":94,"threads_started":1}
I20260812 17:46:00.848685 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 11904
I20260812 17:46:00.865309 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 12156
2026-08-12T17:46:00Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19932 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:46:00 dist-test-slave-tk9z krb5kdc[12508](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:46:00 dist-test-slave-tk9z krb5kdc[12508](info): set up 2 sockets
Aug 12 17:46:00 dist-test-slave-tk9z krb5kdc[12508](info): commencing operation
krb5kdc: starting...
W20260812 17:46:02.238701 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.337s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:46:02 dist-test-slave-tk9z krb5kdc[12508](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556762, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:46:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:46:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.255.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
I20260812 17:46:02.383080 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:34829
--webserver_interface=127.17.255.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:38455
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:34829
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:46:02.503758 12526 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:46:02.504055 12526 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:46:02.504099 12526 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:46:02.508148 12526 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 17:46:02.508211 12526 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 17:46:02.508227 12526 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 17:46:02.508241 12526 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:46:02.508261 12526 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:46:02.508279 12526 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:46:02.508296 12526 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:46:02.508311 12526 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:46:02.514209 12526 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:38455
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:34829
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:34829
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12526
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:46:02.515446 12526 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:46:02.516520 12526 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:46:02.526217 12544 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:46:02.526222 12540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:46:02.526726 12539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:46:02.526750 12526 server_base.cc:1034] running on GCE node
I20260812 17:46:02.527487 12526 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:46:02.528785 12526 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:46:02.530052 12526 hybrid_clock.cc:648] HybridClock initialized: now 1786556762530019 us; error 45 us; skew 500 ppm
Aug 12 17:46:02 dist-test-slave-tk9z krb5kdc[12508](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556762, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:46:02.534014 12526 init.cc:377] Logged in from keytab as kudu/127.17.255.62@KRBTEST.COM (short username kudu)
I20260812 17:46:02.535387 12526 webserver.cc:460] Webserver started at http://127.17.255.62:34953/ using document root <none> and password file <none>
I20260812 17:46:02.536065 12526 fs_manager.cc:359] Metadata directory not provided
I20260812 17:46:02.536136 12526 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:46:02.536335 12526 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:46:02.538781 12526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "ba73241e720441cb8621a47ee30d8289"
format_stamp: "Formatted at 2026-08-12 17:46:02 on dist-test-slave-tk9z"
server_key: "84ac12452f5e32644bcd7fdb08eedcb4"
server_key_iv: "23fa21a9a7f5204a8e55becf9dfa8bcc"
server_key_version: "encryptionkey@0"
I20260812 17:46:02.539450 12526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "ba73241e720441cb8621a47ee30d8289"
format_stamp: "Formatted at 2026-08-12 17:46:02 on dist-test-slave-tk9z"
server_key: "84ac12452f5e32644bcd7fdb08eedcb4"
server_key_iv: "23fa21a9a7f5204a8e55becf9dfa8bcc"
server_key_version: "encryptionkey@0"
I20260812 17:46:02.544888 12526 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 17:46:02.548457 12557 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:46:02.550660 12526 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 17:46:02.550882 12526 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "ba73241e720441cb8621a47ee30d8289"
format_stamp: "Formatted at 2026-08-12 17:46:02 on dist-test-slave-tk9z"
server_key: "84ac12452f5e32644bcd7fdb08eedcb4"
server_key_iv: "23fa21a9a7f5204a8e55becf9dfa8bcc"
server_key_version: "encryptionkey@0"
I20260812 17:46:02.551064 12526 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:46:02.569281 12526 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:46:02.574586 12526 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:46:02.574841 12526 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:46:02.585520 12526 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:34829
I20260812 17:46:02.585862 12663 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:34829 every 8 connection(s)
I20260812 17:46:02.587085 12526 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:46:02.591524 12665 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:46:02.597510 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 12526
I20260812 17:46:02.597666 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:46:02.597978 18428 external_mini_cluster.cc:1428] Setting key ae86386f0574184e61e755f122c4f69e
I20260812 17:46:02.600611 12665 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289: Bootstrap starting.
I20260812 17:46:02.603250 12665 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289: Neither blocks nor log segments found. Creating new log.
I20260812 17:46:02.604072 12665 log.cc:824] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289: Log is configured to *not* fsync() on all Append() calls
I20260812 17:46:02.606135 12665 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289: No bootstrap required, opened a new log
Aug 12 17:46:02 dist-test-slave-tk9z krb5kdc[12508](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556762, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:46:02.609915 12665 raft_consensus.cc:348] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba73241e720441cb8621a47ee30d8289" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 34829 } }
I20260812 17:46:02.610205 12665 raft_consensus.cc:374] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:46:02.610311 12665 raft_consensus.cc:729] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba73241e720441cb8621a47ee30d8289, State: Initialized, Role: FOLLOWER
I20260812 17:46:02.610898 12665 consensus_queue.cc:260] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba73241e720441cb8621a47ee30d8289" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 34829 } }
I20260812 17:46:02.611068 12665 raft_consensus.cc:388] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:46:02.611140 12665 raft_consensus.cc:482] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:46:02.611236 12665 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:46:02.612232 12665 raft_consensus.cc:504] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba73241e720441cb8621a47ee30d8289" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 34829 } }
I20260812 17:46:02.612737 12665 leader_election.cc:302] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ba73241e720441cb8621a47ee30d8289; no voters:
I20260812 17:46:02.613157 12665 leader_election.cc:288] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:46:02.613246 12675 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:46:02.613446 12675 raft_consensus.cc:686] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [term 1 LEADER]: Becoming Leader. State: Replica: ba73241e720441cb8621a47ee30d8289, State: Running, Role: LEADER
I20260812 17:46:02.613770 12675 consensus_queue.cc:237] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba73241e720441cb8621a47ee30d8289" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 34829 } }
I20260812 17:46:02.613929 12670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:02.599592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48088 (local address 127.17.255.62:34829)
0812 17:46:02.600132 (+ 540us) server_negotiation.cc:206] Beginning negotiation
0812 17:46:02.600150 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 17:46:02.600191 (+ 41us) server_negotiation.cc:407] Connection header received
0812 17:46:02.600969 (+ 778us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:46:02.600991 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:46:02.601444 (+ 453us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:46:02.601831 (+ 387us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:46:02.602866 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:02.603953 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:02.604884 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:02.605386 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:02.605582 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:46:02.608246 (+ 2664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:46:02.608251 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:46:02.608267 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:46:02.608298 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:46:02.610163 (+ 1865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:46:02.610800 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:46:02.610807 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:46:02.610821 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:46:02.610953 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:46:02.611263 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:46:02.611266 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:46:02.611268 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:46:02.611733 (+ 465us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:46:02.612072 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0812 17:46:02.612411 (+ 339us) server_negotiation.cc:299] Negotiation successful
0812 17:46:02.612791 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":176,"threads_started":1}
I20260812 17:46:02.614640 12665 sys_catalog.cc:564] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:46:02.615556 12678 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ba73241e720441cb8621a47ee30d8289. Latest consensus state: current_term: 1 leader_uuid: "ba73241e720441cb8621a47ee30d8289" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba73241e720441cb8621a47ee30d8289" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 34829 } } }
I20260812 17:46:02.615707 12678 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [sys.catalog]: This master's current role is: LEADER
I20260812 17:46:02.616071 12679 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ba73241e720441cb8621a47ee30d8289" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba73241e720441cb8621a47ee30d8289" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 34829 } } }
I20260812 17:46:02.616178 12679 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [sys.catalog]: This master's current role is: LEADER
W20260812 17:46:02.619762 12703 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 17:46:02.619856 12703 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 17:46:02.619931 12693 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:46:02.620630 12693 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:46:02.626995 12693 catalog_manager.cc:1347] Generated new cluster ID: ff844b8d8c844a2db744eb9428b5b5db
I20260812 17:46:02.627079 12693 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:46:02.641040 12693 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:46:02.642520 12693 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:46:02.648936 12693 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289: Generated new TSK 0
I20260812 17:46:02.649866 12693 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.255.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab.
Entry for principal kudu/127.17.255.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab.
I20260812 17:46:02.691123 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.1:0
--local_ip_for_outbound_sockets=127.17.255.1
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:34829
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:38455
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:46:02.812126 12714 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:46:02.812422 12714 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:46:02.812533 12714 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:46:02.816793 12714 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:46:02.816854 12714 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:46:02.816911 12714 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.1
I20260812 17:46:02.822310 12714 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:38455
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:34829
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12714
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.1
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:46:02.823530 12714 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:46:02.824664 12714 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:46:02.835132 12721 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:46:02.835141 12729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:46:02.835319 12714 server_base.cc:1034] running on GCE node
W20260812 17:46:02.835132 12722 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:46:02.835945 12714 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:46:02.836669 12714 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:46:02.837891 12714 hybrid_clock.cc:648] HybridClock initialized: now 1786556762837872 us; error 33 us; skew 500 ppm
Aug 12 17:46:02 dist-test-slave-tk9z krb5kdc[12508](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556762, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:46:02.840996 12714 init.cc:377] Logged in from keytab as kudu/127.17.255.1@KRBTEST.COM (short username kudu)
I20260812 17:46:02.841938 12714 webserver.cc:460] Webserver started at http://127.17.255.1:35947/ using document root <none> and password file <none>
I20260812 17:46:02.842638 12714 fs_manager.cc:359] Metadata directory not provided
I20260812 17:46:02.842736 12714 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:46:02.842995 12714 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:46:02.845153 12714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/data/instance:
uuid: "02ff7ae11a3348839780d12d801af0de"
format_stamp: "Formatted at 2026-08-12 17:46:02 on dist-test-slave-tk9z"
server_key: "e4e68c3dee78aa2d3ffaf27b1e4f18e0"
server_key_iv: "65704cd40fe9d2e5325786198c55d212"
server_key_version: "encryptionkey@0"
I20260812 17:46:02.845760 12714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance:
uuid: "02ff7ae11a3348839780d12d801af0de"
format_stamp: "Formatted at 2026-08-12 17:46:02 on dist-test-slave-tk9z"
server_key: "e4e68c3dee78aa2d3ffaf27b1e4f18e0"
server_key_iv: "65704cd40fe9d2e5325786198c55d212"
server_key_version: "encryptionkey@0"
I20260812 17:46:02.849611 12714 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 17:46:02.852350 12739 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:46:02.853776 12714 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 17:46:02.853941 12714 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/wal
uuid: "02ff7ae11a3348839780d12d801af0de"
format_stamp: "Formatted at 2026-08-12 17:46:02 on dist-test-slave-tk9z"
server_key: "e4e68c3dee78aa2d3ffaf27b1e4f18e0"
server_key_iv: "65704cd40fe9d2e5325786198c55d212"
server_key_version: "encryptionkey@0"
I20260812 17:46:02.854080 12714 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:46:02.873575 12714 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:46:02.877027 12714 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:46:02.877267 12714 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:46:02.877947 12714 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:46:02.878938 12714 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:46:02.879014 12714 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:46:02.879094 12714 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:46:02.879145 12714 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:46:02.888458 12714 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.1:33045
I20260812 17:46:02.888484 12941 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.1:33045 every 8 connection(s)
I20260812 17:46:02.889460 12714 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
Aug 12 17:46:02 dist-test-slave-tk9z krb5kdc[12508](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556762, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:46:02.899616 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 12714
I20260812 17:46:02.899807 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance
I20260812 17:46:02.900199 18428 external_mini_cluster.cc:1428] Setting key cecca617c452800715d0d851346532ca
I20260812 17:46:02.904062 12670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:02.891558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:44365 (local address 127.17.255.62:34829)
0812 17:46:02.891705 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0812 17:46:02.891709 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:46:02.892852 (+ 1143us) server_negotiation.cc:407] Connection header received
0812 17:46:02.893805 (+ 953us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:46:02.893809 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:46:02.893871 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:46:02.893980 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:46:02.895383 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:02.895932 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:02.897100 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:02.897339 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:02.897453 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:46:02.900069 (+ 2616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:46:02.900073 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:46:02.900077 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:46:02.900110 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:46:02.901700 (+ 1590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:46:02.902206 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:46:02.902211 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:46:02.902216 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:46:02.902319 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:46:02.902772 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:46:02.902779 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:46:02.902784 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:46:02.903049 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:46:02.903156 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 17:46:02.903674 (+ 518us) server_negotiation.cc:299] Negotiation successful
0812 17:46:02.903836 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 17:46:02.904778 12944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:02.891974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.1:44365)
0812 17:46:02.892686 (+ 712us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:02.892729 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 17:46:02.893583 (+ 854us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:46:02.894178 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:46:02.894185 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:46:02.894709 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:46:02.895211 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:46:02.895225 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:46:02.896082 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:46:02.896085 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:46:02.896965 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:46:02.896975 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:46:02.897499 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:46:02.897503 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:46:02.897676 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:46:02.898309 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:46:02.898326 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:46:02.899883 (+ 1557us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:46:02.901817 (+ 1934us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:46:02.901822 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:46:02.901834 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:46:02.902097 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:46:02.902505 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:46:02.902508 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:46:02.902524 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:46:02.902666 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:46:02.903161 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:46:02.903167 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:46:02.903409 (+ 242us) client_negotiation.cc:769] Sending connection context
0812 17:46:02.903590 (+ 181us) client_negotiation.cc:240] Negotiation successful
0812 17:46:02.903850 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":115,"threads_started":1}
I20260812 17:46:02.906111 12942 heartbeater.cc:347] Connected to a master server at 127.17.255.62:34829
I20260812 17:46:02.906420 12942 heartbeater.cc:464] Registering TS with master...
I20260812 17:46:02.907094 12942 heartbeater.cc:511] Master 127.17.255.62:34829 requested a full tablet report, sending...
I20260812 17:46:02.909116 12599 ts_manager.cc:194] Registered new tserver with Master: 02ff7ae11a3348839780d12d801af0de (127.17.255.1:33045)
I20260812 17:46:02.910943 12599 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.1@KRBTEST.COM'} at 127.17.255.1:44365
WARNING: no policy specified for kudu/127.17.255.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab.
Entry for principal kudu/127.17.255.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab.
I20260812 17:46:02.933935 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.2:0
--local_ip_for_outbound_sockets=127.17.255.2
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:34829
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:38455
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:46:03.054591 12951 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:46:03.054886 12951 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:46:03.054931 12951 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:46:03.059521 12951 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:46:03.059607 12951 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:46:03.059702 12951 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.2
I20260812 17:46:03.065155 12951 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:38455
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:34829
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12951
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.2
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:46:03.066341 12951 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:46:03.067535 12951 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:46:03.078557 12972 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:46:03.078572 12966 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:46:03.078588 12968 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:46:03.078748 12951 server_base.cc:1034] running on GCE node
I20260812 17:46:03.079358 12951 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:46:03.080086 12951 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:46:03.081308 12951 hybrid_clock.cc:648] HybridClock initialized: now 1786556763081266 us; error 60 us; skew 500 ppm
Aug 12 17:46:03 dist-test-slave-tk9z krb5kdc[12508](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556763, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:46:03.084755 12951 init.cc:377] Logged in from keytab as kudu/127.17.255.2@KRBTEST.COM (short username kudu)
I20260812 17:46:03.085837 12951 webserver.cc:460] Webserver started at http://127.17.255.2:36885/ using document root <none> and password file <none>
I20260812 17:46:03.086549 12951 fs_manager.cc:359] Metadata directory not provided
I20260812 17:46:03.086651 12951 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:46:03.086916 12951 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:46:03.089109 12951 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/data/instance:
uuid: "984a95e37bed43babed18a396dca0a5d"
format_stamp: "Formatted at 2026-08-12 17:46:03 on dist-test-slave-tk9z"
server_key: "97214328b4fa8085502c521d2da319c2"
server_key_iv: "9f8b546908f41a7ba4c3600f3003853e"
server_key_version: "encryptionkey@0"
I20260812 17:46:03.089711 12951 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance:
uuid: "984a95e37bed43babed18a396dca0a5d"
format_stamp: "Formatted at 2026-08-12 17:46:03 on dist-test-slave-tk9z"
server_key: "97214328b4fa8085502c521d2da319c2"
server_key_iv: "9f8b546908f41a7ba4c3600f3003853e"
server_key_version: "encryptionkey@0"
I20260812 17:46:03.093695 12951 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 17:46:03.096521 12988 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:46:03.098012 12951 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 17:46:03.098182 12951 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/wal
uuid: "984a95e37bed43babed18a396dca0a5d"
format_stamp: "Formatted at 2026-08-12 17:46:03 on dist-test-slave-tk9z"
server_key: "97214328b4fa8085502c521d2da319c2"
server_key_iv: "9f8b546908f41a7ba4c3600f3003853e"
server_key_version: "encryptionkey@0"
I20260812 17:46:03.098330 12951 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:46:03.126209 12951 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:46:03.129915 12951 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:46:03.130162 12951 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:46:03.130939 12951 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:46:03.131868 12951 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:46:03.131942 12951 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:46:03.132017 12951 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:46:03.132069 12951 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:46:03.142132 12951 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.2:41055
I20260812 17:46:03.142156 13182 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.2:41055 every 8 connection(s)
I20260812 17:46:03.143236 12951 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
I20260812 17:46:03.152446 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 12951
I20260812 17:46:03.152572 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance
I20260812 17:46:03.152944 18428 external_mini_cluster.cc:1428] Setting key bd0b69029ed0aaaf7a067837078933e8
Aug 12 17:46:03 dist-test-slave-tk9z krb5kdc[12508](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556763, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:46:03.159816 12670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:03.145338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:59353 (local address 127.17.255.62:34829)
0812 17:46:03.145498 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0812 17:46:03.145502 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:46:03.146699 (+ 1197us) server_negotiation.cc:407] Connection header received
0812 17:46:03.147634 (+ 935us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:46:03.147637 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:46:03.147687 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:46:03.147772 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:46:03.149251 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:03.149783 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:03.151112 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:03.151342 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:03.151463 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:46:03.154596 (+ 3133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:46:03.154601 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:46:03.154604 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:46:03.154636 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:46:03.156762 (+ 2126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:46:03.157703 (+ 941us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:46:03.157710 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:46:03.157712 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:46:03.157817 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:46:03.158354 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:46:03.158357 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:46:03.158358 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:46:03.158630 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:46:03.158716 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 17:46:03.159512 (+ 796us) server_negotiation.cc:299] Negotiation successful
0812 17:46:03.159656 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 17:46:03.161162 13186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:03.145776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.2:59353)
0812 17:46:03.146534 (+ 758us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:03.146590 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0812 17:46:03.147406 (+ 816us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:46:03.147995 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:46:03.148004 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:46:03.148414 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:46:03.148958 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:46:03.148972 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:46:03.149919 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:46:03.149923 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:46:03.150978 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:46:03.150989 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:46:03.151509 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:46:03.151513 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:46:03.151696 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:46:03.152357 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:46:03.152375 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:46:03.154325 (+ 1950us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:46:03.156950 (+ 2625us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:46:03.156957 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:46:03.157020 (+ 63us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:46:03.157523 (+ 503us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:46:03.157996 (+ 473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:46:03.158001 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:46:03.158006 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:46:03.158252 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:46:03.158747 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:46:03.158758 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:46:03.159166 (+ 408us) client_negotiation.cc:769] Sending connection context
0812 17:46:03.159398 (+ 232us) client_negotiation.cc:240] Negotiation successful
0812 17:46:03.159821 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":115,"threads_started":1}
I20260812 17:46:03.162611 13184 heartbeater.cc:347] Connected to a master server at 127.17.255.62:34829
I20260812 17:46:03.162918 13184 heartbeater.cc:464] Registering TS with master...
I20260812 17:46:03.163475 13184 heartbeater.cc:511] Master 127.17.255.62:34829 requested a full tablet report, sending...
I20260812 17:46:03.164687 12599 ts_manager.cc:194] Registered new tserver with Master: 984a95e37bed43babed18a396dca0a5d (127.17.255.2:41055)
WARNING: no policy specified for kudu/127.17.255.3@KRBTEST.COM; defaulting to no policy
I20260812 17:46:03.165373 12599 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.2@KRBTEST.COM'} at 127.17.255.2:59353
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab.
Entry for principal kudu/127.17.255.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab.
I20260812 17:46:03.185443 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.3:0
--local_ip_for_outbound_sockets=127.17.255.3
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:34829
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:38455
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:46:03.305142 13190 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:46:03.305444 13190 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:46:03.305537 13190 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:46:03.309665 13190 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:46:03.309772 13190 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:46:03.309876 13190 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.3
I20260812 17:46:03.315694 13190 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:38455
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:34829
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13190
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.3
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:46:03.316933 13190 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:46:03.318033 13190 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:46:03.328474 13198 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:46:03.328473 13202 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:46:03.328696 13190 server_base.cc:1034] running on GCE node
W20260812 17:46:03.328449 13200 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:46:03.329413 13190 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:46:03.330089 13190 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:46:03.331300 13190 hybrid_clock.cc:648] HybridClock initialized: now 1786556763331261 us; error 50 us; skew 500 ppm
Aug 12 17:46:03 dist-test-slave-tk9z krb5kdc[12508](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556763, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:46:03.334574 13190 init.cc:377] Logged in from keytab as kudu/127.17.255.3@KRBTEST.COM (short username kudu)
I20260812 17:46:03.335645 13190 webserver.cc:460] Webserver started at http://127.17.255.3:36289/ using document root <none> and password file <none>
I20260812 17:46:03.336274 13190 fs_manager.cc:359] Metadata directory not provided
I20260812 17:46:03.336345 13190 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:46:03.336596 13190 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:46:03.338972 13190 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/data/instance:
uuid: "6b05ee36b7774a1eadc6845e792fbbb9"
format_stamp: "Formatted at 2026-08-12 17:46:03 on dist-test-slave-tk9z"
server_key: "67c484eeea3966f3f91f8098cb888f47"
server_key_iv: "24eea2671fe2ec9f66b07f125f65424d"
server_key_version: "encryptionkey@0"
I20260812 17:46:03.339612 13190 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance:
uuid: "6b05ee36b7774a1eadc6845e792fbbb9"
format_stamp: "Formatted at 2026-08-12 17:46:03 on dist-test-slave-tk9z"
server_key: "67c484eeea3966f3f91f8098cb888f47"
server_key_iv: "24eea2671fe2ec9f66b07f125f65424d"
server_key_version: "encryptionkey@0"
I20260812 17:46:03.344014 13190 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 17:46:03.346971 13216 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:46:03.348526 13190 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:46:03.348729 13190 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/wal
uuid: "6b05ee36b7774a1eadc6845e792fbbb9"
format_stamp: "Formatted at 2026-08-12 17:46:03 on dist-test-slave-tk9z"
server_key: "67c484eeea3966f3f91f8098cb888f47"
server_key_iv: "24eea2671fe2ec9f66b07f125f65424d"
server_key_version: "encryptionkey@0"
I20260812 17:46:03.348889 13190 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:46:03.385530 13190 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:46:03.389552 13190 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:46:03.389817 13190 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:46:03.390626 13190 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:46:03.391630 13190 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:46:03.391709 13190 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:46:03.391794 13190 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:46:03.391837 13190 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:46:03.402269 13190 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.3:37193
I20260812 17:46:03.402364 13441 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.3:37193 every 8 connection(s)
I20260812 17:46:03.403470 13190 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
I20260812 17:46:03.404253 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 13190
I20260812 17:46:03.404390 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance
I20260812 17:46:03.404683 18428 external_mini_cluster.cc:1428] Setting key 4deeaec4c0134cd9d335aab2e1a2a56d
Aug 12 17:46:03 dist-test-slave-tk9z krb5kdc[12508](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556763, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:46:03.420069 12670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:03.405759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:48391 (local address 127.17.255.62:34829)
0812 17:46:03.405918 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0812 17:46:03.405924 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:46:03.407101 (+ 1177us) server_negotiation.cc:407] Connection header received
0812 17:46:03.408484 (+ 1383us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:46:03.408486 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:46:03.408535 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:46:03.408612 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:46:03.409855 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:03.410434 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:03.411755 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:03.411989 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:03.412073 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:46:03.415381 (+ 3308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:46:03.415388 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:46:03.415391 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:46:03.415429 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:46:03.417219 (+ 1790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:46:03.417829 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:46:03.417833 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:46:03.417835 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:46:03.417946 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:46:03.418648 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:46:03.418652 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:46:03.418653 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:46:03.418949 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:46:03.419071 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0812 17:46:03.419758 (+ 687us) server_negotiation.cc:299] Negotiation successful
0812 17:46:03.419941 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 17:46:03.421030 13444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:03.406336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.3:48391)
0812 17:46:03.406927 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:03.406984 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 17:46:03.408241 (+ 1257us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:46:03.408759 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:46:03.408768 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:46:03.409157 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:46:03.409703 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:46:03.409718 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:46:03.410584 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:46:03.410587 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:46:03.411625 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:46:03.411637 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:46:03.412347 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:46:03.412351 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:46:03.412527 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:46:03.413157 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:46:03.413183 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:46:03.415085 (+ 1902us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:46:03.417357 (+ 2272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:46:03.417363 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:46:03.417386 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:46:03.417693 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:46:03.418249 (+ 556us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:46:03.418252 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:46:03.418254 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:46:03.418520 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:46:03.419068 (+ 548us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:46:03.419074 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:46:03.419433 (+ 359us) client_negotiation.cc:769] Sending connection context
0812 17:46:03.419688 (+ 255us) client_negotiation.cc:240] Negotiation successful
0812 17:46:03.420064 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":148,"threads_started":1}
I20260812 17:46:03.422428 13442 heartbeater.cc:347] Connected to a master server at 127.17.255.62:34829
I20260812 17:46:03.422703 13442 heartbeater.cc:464] Registering TS with master...
I20260812 17:46:03.423280 13442 heartbeater.cc:511] Master 127.17.255.62:34829 requested a full tablet report, sending...
I20260812 17:46:03.424463 12599 ts_manager.cc:194] Registered new tserver with Master: 6b05ee36b7774a1eadc6845e792fbbb9 (127.17.255.3:37193)
I20260812 17:46:03.425060 12599 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.3@KRBTEST.COM'} at 127.17.255.3:48391
I20260812 17:46:03.431887 18428 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 17:46:03.442580 12670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:03.434071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48092 (local address 127.17.255.62:34829)
0812 17:46:03.434224 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0812 17:46:03.434231 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 17:46:03.434367 (+ 136us) server_negotiation.cc:407] Connection header received
0812 17:46:03.434539 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:46:03.434541 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:46:03.434587 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:46:03.434656 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:46:03.435498 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:03.436022 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:03.437011 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:03.437242 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:03.437329 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:46:03.439055 (+ 1726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:46:03.439058 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:46:03.439060 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:46:03.439088 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:46:03.440688 (+ 1600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:46:03.441145 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:46:03.441149 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:46:03.441150 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:46:03.441241 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:46:03.441541 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:46:03.441544 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:46:03.441545 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:46:03.441786 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:46:03.441901 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 17:46:03.442157 (+ 256us) server_negotiation.cc:299] Negotiation successful
0812 17:46:03.442346 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 17:46:03.445812 12599 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48092:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 17:46:03.449349 12599 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 17:46:03.466084 13463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:03.459634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57430 (local address 127.17.255.1:33045)
0812 17:46:03.460537 (+ 903us) server_negotiation.cc:206] Beginning negotiation
0812 17:46:03.460546 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 17:46:03.460576 (+ 30us) server_negotiation.cc:407] Connection header received
0812 17:46:03.460665 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:46:03.460670 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:46:03.460928 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:46:03.461133 (+ 205us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:46:03.461493 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:03.462728 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:03.464472 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:03.465331 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:03.465454 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:46:03.465618 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0812 17:46:03.465811 (+ 193us) server_negotiation.cc:299] Negotiation successful
0812 17:46:03.465925 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":789,"thread_start_us":161,"threads_started":1}
I20260812 17:46:03.466075 13462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:03.459511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:33045 (local address 127.0.0.1:57430)
0812 17:46:03.460046 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:03.460090 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 17:46:03.460217 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:46:03.461142 (+ 925us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:46:03.461149 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:46:03.461178 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:46:03.461337 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:46:03.461345 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:46:03.462890 (+ 1545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:46:03.462893 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:46:03.464301 (+ 1408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:46:03.464315 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:46:03.465459 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:46:03.465463 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:46:03.465574 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:46:03.465613 (+ 39us) client_negotiation.cc:769] Sending connection context
0812 17:46:03.465771 (+ 158us) client_negotiation.cc:240] Negotiation successful
0812 17:46:03.465918 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":81,"threads_started":1}
I20260812 17:46:03.467085 13461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:03.459638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.3:37193 (local address 127.0.0.1:55602)
0812 17:46:03.460738 (+ 1100us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:03.460752 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 17:46:03.460851 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:46:03.462728 (+ 1877us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:46:03.462731 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:46:03.462751 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:46:03.462857 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:46:03.462863 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:46:03.464265 (+ 1402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:46:03.464269 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:46:03.465043 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:46:03.465052 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:46:03.466646 (+ 1594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:46:03.466650 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:46:03.466779 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:46:03.466804 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 17:46:03.466877 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 17:46:03.466952 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1036,"mutex_wait_us":23,"thread_start_us":88,"threads_started":1}
I20260812 17:46:03.467356 13467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:03.460745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:41055 (local address 127.0.0.1:48196)
0812 17:46:03.461801 (+ 1056us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:03.461816 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 17:46:03.461911 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:46:03.462395 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:46:03.462399 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:46:03.462420 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:46:03.462524 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:46:03.462531 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:46:03.463955 (+ 1424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:46:03.463959 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:46:03.465126 (+ 1167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:46:03.465137 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:46:03.466446 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:46:03.466449 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:46:03.466544 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:46:03.466584 (+ 40us) client_negotiation.cc:769] Sending connection context
0812 17:46:03.466654 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 17:46:03.467228 (+ 574us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":998,"mutex_wait_us":514,"thread_start_us":88,"threads_started":1}
I20260812 17:46:03.467617 13464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:03.460411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55602 (local address 127.17.255.3:37193)
0812 17:46:03.462136 (+ 1725us) server_negotiation.cc:206] Beginning negotiation
0812 17:46:03.462145 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 17:46:03.462164 (+ 19us) server_negotiation.cc:407] Connection header received
0812 17:46:03.462237 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:46:03.462240 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:46:03.462539 (+ 299us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:46:03.462753 (+ 214us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:46:03.462966 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:03.464107 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:03.465181 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:03.466068 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:03.466638 (+ 570us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:46:03.466806 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0812 17:46:03.466930 (+ 124us) server_negotiation.cc:299] Negotiation successful
0812 17:46:03.467046 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1632,"thread_start_us":174,"threads_started":1}
I20260812 17:46:03.468073 13468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:03.461316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48196 (local address 127.17.255.2:41055)
0812 17:46:03.461783 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0812 17:46:03.461795 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 17:46:03.461918 (+ 123us) server_negotiation.cc:407] Connection header received
0812 17:46:03.462001 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:46:03.462007 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:46:03.462192 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:46:03.462431 (+ 239us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:46:03.462631 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:03.463792 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:03.465281 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:03.466075 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:03.466184 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:46:03.466353 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0812 17:46:03.467807 (+ 1454us) server_negotiation.cc:299] Negotiation successful
0812 17:46:03.467921 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":226,"threads_started":1}
I20260812 17:46:03.470083 12827 tablet_service.cc:1467] Processing CreateTablet for tablet ba07f548587d43d7b03fa319c503454f (DEFAULT_TABLE table=test-table [id=9dd5ee60beec4a19a5a9ad928c0323bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:46:03.470582 13067 tablet_service.cc:1467] Processing CreateTablet for tablet ba07f548587d43d7b03fa319c503454f (DEFAULT_TABLE table=test-table [id=9dd5ee60beec4a19a5a9ad928c0323bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:46:03.470757 13310 tablet_service.cc:1467] Processing CreateTablet for tablet ba07f548587d43d7b03fa319c503454f (DEFAULT_TABLE table=test-table [id=9dd5ee60beec4a19a5a9ad928c0323bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:46:03.471470 12827 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba07f548587d43d7b03fa319c503454f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:46:03.471657 13067 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba07f548587d43d7b03fa319c503454f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:46:03.471741 13310 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba07f548587d43d7b03fa319c503454f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:46:03.478029 13469 tablet_bootstrap.cc:492] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d: Bootstrap starting.
I20260812 17:46:03.479583 13470 tablet_bootstrap.cc:492] T ba07f548587d43d7b03fa319c503454f P 02ff7ae11a3348839780d12d801af0de: Bootstrap starting.
I20260812 17:46:03.481231 13469 tablet_bootstrap.cc:654] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d: Neither blocks nor log segments found. Creating new log.
I20260812 17:46:03.481901 13470 tablet_bootstrap.cc:654] T ba07f548587d43d7b03fa319c503454f P 02ff7ae11a3348839780d12d801af0de: Neither blocks nor log segments found. Creating new log.
I20260812 17:46:03.482425 13469 log.cc:824] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d: Log is configured to *not* fsync() on all Append() calls
I20260812 17:46:03.482784 13470 log.cc:824] T ba07f548587d43d7b03fa319c503454f P 02ff7ae11a3348839780d12d801af0de: Log is configured to *not* fsync() on all Append() calls
I20260812 17:46:03.483613 13472 tablet_bootstrap.cc:492] T ba07f548587d43d7b03fa319c503454f P 6b05ee36b7774a1eadc6845e792fbbb9: Bootstrap starting.
I20260812 17:46:03.484702 13469 tablet_bootstrap.cc:492] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d: No bootstrap required, opened a new log
I20260812 17:46:03.484933 13469 ts_tablet_manager.cc:1397] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260812 17:46:03.484952 13470 tablet_bootstrap.cc:492] T ba07f548587d43d7b03fa319c503454f P 02ff7ae11a3348839780d12d801af0de: No bootstrap required, opened a new log
I20260812 17:46:03.485128 13470 ts_tablet_manager.cc:1397] T ba07f548587d43d7b03fa319c503454f P 02ff7ae11a3348839780d12d801af0de: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 17:46:03.486287 13472 tablet_bootstrap.cc:654] T ba07f548587d43d7b03fa319c503454f P 6b05ee36b7774a1eadc6845e792fbbb9: Neither blocks nor log segments found. Creating new log.
I20260812 17:46:03.487287 13472 log.cc:824] T ba07f548587d43d7b03fa319c503454f P 6b05ee36b7774a1eadc6845e792fbbb9: Log is configured to *not* fsync() on all Append() calls
I20260812 17:46:03.488339 13469 raft_consensus.cc:348] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02ff7ae11a3348839780d12d801af0de" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33045 } } peers { permanent_uuid: "6b05ee36b7774a1eadc6845e792fbbb9" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 37193 } } peers { permanent_uuid: "984a95e37bed43babed18a396dca0a5d" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 41055 } }
I20260812 17:46:03.488617 13469 raft_consensus.cc:374] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:46:03.488673 13469 raft_consensus.cc:729] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 984a95e37bed43babed18a396dca0a5d, State: Initialized, Role: FOLLOWER
I20260812 17:46:03.489172 13469 consensus_queue.cc:260] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02ff7ae11a3348839780d12d801af0de" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33045 } } peers { permanent_uuid: "6b05ee36b7774a1eadc6845e792fbbb9" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 37193 } } peers { permanent_uuid: "984a95e37bed43babed18a396dca0a5d" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 41055 } }
I20260812 17:46:03.489591 13472 tablet_bootstrap.cc:492] T ba07f548587d43d7b03fa319c503454f P 6b05ee36b7774a1eadc6845e792fbbb9: No bootstrap required, opened a new log
I20260812 17:46:03.489778 13472 ts_tablet_manager.cc:1397] T ba07f548587d43d7b03fa319c503454f P 6b05ee36b7774a1eadc6845e792fbbb9: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 17:46:03.489861 13470 raft_consensus.cc:348] T ba07f548587d43d7b03fa319c503454f P 02ff7ae11a3348839780d12d801af0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02ff7ae11a3348839780d12d801af0de" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33045 } } peers { permanent_uuid: "6b05ee36b7774a1eadc6845e792fbbb9" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 37193 } } peers { permanent_uuid: "984a95e37bed43babed18a396dca0a5d" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 41055 } }
I20260812 17:46:03.490118 13470 raft_consensus.cc:374] T ba07f548587d43d7b03fa319c503454f P 02ff7ae11a3348839780d12d801af0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:46:03.490167 13470 raft_consensus.cc:729] T ba07f548587d43d7b03fa319c503454f P 02ff7ae11a3348839780d12d801af0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02ff7ae11a3348839780d12d801af0de, State: Initialized, Role: FOLLOWER
I20260812 17:46:03.490336 13469 ts_tablet_manager.cc:1428] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260812 17:46:03.490648 13470 consensus_queue.cc:260] T ba07f548587d43d7b03fa319c503454f P 02ff7ae11a3348839780d12d801af0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02ff7ae11a3348839780d12d801af0de" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33045 } } peers { permanent_uuid: "6b05ee36b7774a1eadc6845e792fbbb9" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 37193 } } peers { permanent_uuid: "984a95e37bed43babed18a396dca0a5d" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 41055 } }
I20260812 17:46:03.490834 13184 heartbeater.cc:503] Master 127.17.255.62:34829 was elected leader, sending a full tablet report...
I20260812 17:46:03.491351 12942 heartbeater.cc:503] Master 127.17.255.62:34829 was elected leader, sending a full tablet report...
I20260812 17:46:03.491636 13470 ts_tablet_manager.cc:1428] T ba07f548587d43d7b03fa319c503454f P 02ff7ae11a3348839780d12d801af0de: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260812 17:46:03.493501 13472 raft_consensus.cc:348] T ba07f548587d43d7b03fa319c503454f P 6b05ee36b7774a1eadc6845e792fbbb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02ff7ae11a3348839780d12d801af0de" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33045 } } peers { permanent_uuid: "6b05ee36b7774a1eadc6845e792fbbb9" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 37193 } } peers { permanent_uuid: "984a95e37bed43babed18a396dca0a5d" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 41055 } }
I20260812 17:46:03.493701 13472 raft_consensus.cc:374] T ba07f548587d43d7b03fa319c503454f P 6b05ee36b7774a1eadc6845e792fbbb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:46:03.493742 13472 raft_consensus.cc:729] T ba07f548587d43d7b03fa319c503454f P 6b05ee36b7774a1eadc6845e792fbbb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b05ee36b7774a1eadc6845e792fbbb9, State: Initialized, Role: FOLLOWER
I20260812 17:46:03.494127 13472 consensus_queue.cc:260] T ba07f548587d43d7b03fa319c503454f P 6b05ee36b7774a1eadc6845e792fbbb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02ff7ae11a3348839780d12d801af0de" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33045 } } peers { permanent_uuid: "6b05ee36b7774a1eadc6845e792fbbb9" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 37193 } } peers { permanent_uuid: "984a95e37bed43babed18a396dca0a5d" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 41055 } }
I20260812 17:46:03.495064 13442 heartbeater.cc:503] Master 127.17.255.62:34829 was elected leader, sending a full tablet report...
I20260812 17:46:03.495080 13472 ts_tablet_manager.cc:1428] T ba07f548587d43d7b03fa319c503454f P 6b05ee36b7774a1eadc6845e792fbbb9: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260812 17:46:03.506822 13481 raft_consensus.cc:482] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:46:03.507045 13481 raft_consensus.cc:504] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02ff7ae11a3348839780d12d801af0de" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33045 } } peers { permanent_uuid: "6b05ee36b7774a1eadc6845e792fbbb9" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 37193 } } peers { permanent_uuid: "984a95e37bed43babed18a396dca0a5d" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 41055 } }
I20260812 17:46:03.508392 13481 leader_election.cc:288] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02ff7ae11a3348839780d12d801af0de (127.17.255.1:33045), 6b05ee36b7774a1eadc6845e792fbbb9 (127.17.255.3:37193)
I20260812 17:46:03.512709 13464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:03.509166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:36575 (local address 127.17.255.3:37193)
0812 17:46:03.509292 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0812 17:46:03.509296 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:46:03.509329 (+ 33us) server_negotiation.cc:407] Connection header received
0812 17:46:03.509387 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:46:03.509390 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:46:03.509434 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:46:03.509510 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:46:03.509898 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:03.510500 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:03.511660 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:03.512072 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:03.512232 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:46:03.512292 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 17:46:03.512494 (+ 202us) server_negotiation.cc:299] Negotiation successful
0812 17:46:03.512571 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 17:46:03.512723 13186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:03.508608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:33045 (local address 127.17.255.2:32861)
0812 17:46:03.508836 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:03.508855 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 17:46:03.508963 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:46:03.509392 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:46:03.509396 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:46:03.509414 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:46:03.509559 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:46:03.509567 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:46:03.510455 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:46:03.510459 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:46:03.511457 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:46:03.511467 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:46:03.512196 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:46:03.512200 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:46:03.512321 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:46:03.512392 (+ 71us) client_negotiation.cc:769] Sending connection context
0812 17:46:03.512495 (+ 103us) client_negotiation.cc:240] Negotiation successful
0812 17:46:03.512571 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"mutex_wait_us":121}
I20260812 17:46:03.512732 13463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:03.508771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:32861 (local address 127.17.255.1:33045)
0812 17:46:03.508919 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0812 17:46:03.508924 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:46:03.508940 (+ 16us) server_negotiation.cc:407] Connection header received
0812 17:46:03.509108 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:46:03.509112 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:46:03.509169 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:46:03.509243 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:46:03.509700 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:03.510300 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:03.511601 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:03.512054 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:03.512187 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:46:03.512246 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 17:46:03.512531 (+ 285us) server_negotiation.cc:299] Negotiation successful
0812 17:46:03.512616 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 17:46:03.512748 13486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:03.508696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.3:37193 (local address 127.17.255.2:36575)
0812 17:46:03.509135 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:03.509152 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 17:46:03.509254 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:46:03.509555 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:46:03.509557 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:46:03.509575 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:46:03.509720 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:46:03.509727 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:46:03.510635 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:46:03.510638 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:46:03.511479 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:46:03.511489 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:46:03.512234 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:46:03.512237 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:46:03.512336 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:46:03.512379 (+ 43us) client_negotiation.cc:769] Sending connection context
0812 17:46:03.512447 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 17:46:03.512540 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":372,"mutex_wait_us":25,"thread_start_us":164,"threads_started":1}
I20260812 17:46:03.513414 12861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba07f548587d43d7b03fa319c503454f" candidate_uuid: "984a95e37bed43babed18a396dca0a5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02ff7ae11a3348839780d12d801af0de" is_pre_election: true
I20260812 17:46:03.513525 13352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba07f548587d43d7b03fa319c503454f" candidate_uuid: "984a95e37bed43babed18a396dca0a5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b05ee36b7774a1eadc6845e792fbbb9" is_pre_election: true
I20260812 17:46:03.513794 12861 raft_consensus.cc:2454] T ba07f548587d43d7b03fa319c503454f P 02ff7ae11a3348839780d12d801af0de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 984a95e37bed43babed18a396dca0a5d in term 0.
I20260812 17:46:03.513873 13352 raft_consensus.cc:2454] T ba07f548587d43d7b03fa319c503454f P 6b05ee36b7774a1eadc6845e792fbbb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 984a95e37bed43babed18a396dca0a5d in term 0.
I20260812 17:46:03.514430 12990 leader_election.cc:302] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 02ff7ae11a3348839780d12d801af0de, 6b05ee36b7774a1eadc6845e792fbbb9, 984a95e37bed43babed18a396dca0a5d; no voters:
I20260812 17:46:03.514772 13481 raft_consensus.cc:2781] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 17:46:03.514868 13481 raft_consensus.cc:482] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 17:46:03.514925 13481 raft_consensus.cc:3037] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:46:03.516311 13481 raft_consensus.cc:504] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02ff7ae11a3348839780d12d801af0de" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33045 } } peers { permanent_uuid: "6b05ee36b7774a1eadc6845e792fbbb9" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 37193 } } peers { permanent_uuid: "984a95e37bed43babed18a396dca0a5d" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 41055 } }
I20260812 17:46:03.516767 13481 leader_election.cc:288] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d [CANDIDATE]: Term 1 election: Requested vote from peers 02ff7ae11a3348839780d12d801af0de (127.17.255.1:33045), 6b05ee36b7774a1eadc6845e792fbbb9 (127.17.255.3:37193)
I20260812 17:46:03.517175 12861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba07f548587d43d7b03fa319c503454f" candidate_uuid: "984a95e37bed43babed18a396dca0a5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02ff7ae11a3348839780d12d801af0de"
I20260812 17:46:03.517249 13352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba07f548587d43d7b03fa319c503454f" candidate_uuid: "984a95e37bed43babed18a396dca0a5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b05ee36b7774a1eadc6845e792fbbb9"
I20260812 17:46:03.517323 12861 raft_consensus.cc:3037] T ba07f548587d43d7b03fa319c503454f P 02ff7ae11a3348839780d12d801af0de [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:46:03.517413 13352 raft_consensus.cc:3037] T ba07f548587d43d7b03fa319c503454f P 6b05ee36b7774a1eadc6845e792fbbb9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:46:03.518545 12861 raft_consensus.cc:2454] T ba07f548587d43d7b03fa319c503454f P 02ff7ae11a3348839780d12d801af0de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 984a95e37bed43babed18a396dca0a5d in term 1.
I20260812 17:46:03.518577 13352 raft_consensus.cc:2454] T ba07f548587d43d7b03fa319c503454f P 6b05ee36b7774a1eadc6845e792fbbb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 984a95e37bed43babed18a396dca0a5d in term 1.
I20260812 17:46:03.518901 12992 leader_election.cc:302] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02ff7ae11a3348839780d12d801af0de, 984a95e37bed43babed18a396dca0a5d; no voters:
I20260812 17:46:03.519091 13481 raft_consensus.cc:2781] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:46:03.519402 13481 raft_consensus.cc:686] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d [term 1 LEADER]: Becoming Leader. State: Replica: 984a95e37bed43babed18a396dca0a5d, State: Running, Role: LEADER
I20260812 17:46:03.519809 13481 consensus_queue.cc:237] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02ff7ae11a3348839780d12d801af0de" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33045 } } peers { permanent_uuid: "6b05ee36b7774a1eadc6845e792fbbb9" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 37193 } } peers { permanent_uuid: "984a95e37bed43babed18a396dca0a5d" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 41055 } }
I20260812 17:46:03.523303 12599 catalog_manager.cc:5495] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d reported cstate change: term changed from 0 to 1, leader changed from <none> to 984a95e37bed43babed18a396dca0a5d (127.17.255.2). New cstate: current_term: 1 leader_uuid: "984a95e37bed43babed18a396dca0a5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02ff7ae11a3348839780d12d801af0de" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b05ee36b7774a1eadc6845e792fbbb9" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 37193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "984a95e37bed43babed18a396dca0a5d" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 41055 } health_report { overall_health: HEALTHY } } }
I20260812 17:46:03.547495 13468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:03.543731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48200 (local address 127.17.255.2:41055)
0812 17:46:03.543898 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0812 17:46:03.543903 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:46:03.543921 (+ 18us) server_negotiation.cc:407] Connection header received
0812 17:46:03.544027 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:46:03.544030 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:46:03.544091 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:46:03.544214 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:46:03.544469 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:03.544991 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:03.545865 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:03.546100 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:03.546213 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:46:03.546609 (+ 396us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:46:03.547061 (+ 452us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:46:03.547204 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0812 17:46:03.547247 (+ 43us) server_negotiation.cc:299] Negotiation successful
0812 17:46:03.547309 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 17:46:03.554030 13352 raft_consensus.cc:1261] T ba07f548587d43d7b03fa319c503454f P 6b05ee36b7774a1eadc6845e792fbbb9 [term 1 FOLLOWER]: Refusing update from remote peer 984a95e37bed43babed18a396dca0a5d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:46:03.554046 12861 raft_consensus.cc:1261] T ba07f548587d43d7b03fa319c503454f P 02ff7ae11a3348839780d12d801af0de [term 1 FOLLOWER]: Refusing update from remote peer 984a95e37bed43babed18a396dca0a5d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:46:03.554796 13481 consensus_queue.cc:1035] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "02ff7ae11a3348839780d12d801af0de" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:46:03.555063 13487 consensus_queue.cc:1035] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b05ee36b7774a1eadc6845e792fbbb9" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 37193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:46:03.565354 13496 mvcc.cc:205] Tried to move back new op lower bound from 7317736503508824064 to 7317736503379808256. Current Snapshot: MvccSnapshot[applied={T|T < 7317736503508824064}]
I20260812 17:46:03.566073 13495 mvcc.cc:205] Tried to move back new op lower bound from 7317736503508824064 to 7317736503379808256. Current Snapshot: MvccSnapshot[applied={T|T < 7317736503508824064}]
I20260812 17:46:03.573242 12599 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48092:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:46:03.573477 12599 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48092:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:46:03.576611 12599 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289: Sending DeleteTablet for 3 replicas of tablet ba07f548587d43d7b03fa319c503454f
I20260812 17:46:03.577652 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 12714
I20260812 17:46:03.577626 13310 tablet_service.cc:1514] Processing DeleteTablet for tablet ba07f548587d43d7b03fa319c503454f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:46:03 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:55602
I20260812 17:46:03.577695 12827 tablet_service.cc:1514] Processing DeleteTablet for tablet ba07f548587d43d7b03fa319c503454f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:46:03 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:57430
I20260812 17:46:03.578509 13067 tablet_service.cc:1514] Processing DeleteTablet for tablet ba07f548587d43d7b03fa319c503454f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:46:03 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:48196
I20260812 17:46:03.586836 13513 tablet_replica.cc:330] T ba07f548587d43d7b03fa319c503454f P 6b05ee36b7774a1eadc6845e792fbbb9: stopping tablet replica
I20260812 17:46:03.587312 13513 raft_consensus.cc:2229] T ba07f548587d43d7b03fa319c503454f P 6b05ee36b7774a1eadc6845e792fbbb9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:46:03.587790 13513 raft_consensus.cc:2258] T ba07f548587d43d7b03fa319c503454f P 6b05ee36b7774a1eadc6845e792fbbb9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:46:03.590672 13514 tablet_replica.cc:330] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d: stopping tablet replica
I20260812 17:46:03.591068 13514 raft_consensus.cc:2229] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d [term 1 LEADER]: Raft consensus shutting down.
I20260812 17:46:03.591566 13514 raft_consensus.cc:2258] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:46:03.593583 13514 ts_tablet_manager.cc:1905] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:46:03.593887 13513 ts_tablet_manager.cc:1905] T ba07f548587d43d7b03fa319c503454f P 6b05ee36b7774a1eadc6845e792fbbb9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:46:03.594446 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 12951
W20260812 17:46:03.594468 12564 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.255.1:33045 (error 108)
I20260812 17:46:03.606200 13467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:03.605506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:33045 (local address 127.0.0.1:57444)
0812 17:46:03.605943 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:03.606062 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.1:33045: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":312}
W20260812 17:46:03.606727 12564 catalog_manager.cc:4584] TS 02ff7ae11a3348839780d12d801af0de (127.17.255.1:33045): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ba07f548587d43d7b03fa319c503454f: Network error: Client connection negotiation failed: client connection to 127.17.255.1:33045: connect: Connection refused (error 111)
I20260812 17:46:03.611032 13513 ts_tablet_manager.cc:1918] T ba07f548587d43d7b03fa319c503454f P 6b05ee36b7774a1eadc6845e792fbbb9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 17:46:03.611186 13513 log.cc:1196] T ba07f548587d43d7b03fa319c503454f P 6b05ee36b7774a1eadc6845e792fbbb9: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/wal/wals/ba07f548587d43d7b03fa319c503454f
I20260812 17:46:03.611585 13513 ts_tablet_manager.cc:1939] T ba07f548587d43d7b03fa319c503454f P 6b05ee36b7774a1eadc6845e792fbbb9: Deleting consensus metadata
I20260812 17:46:03.613394 12558 catalog_manager.cc:4841] TS 6b05ee36b7774a1eadc6845e792fbbb9 (127.17.255.3:37193): tablet ba07f548587d43d7b03fa319c503454f (table test-table [id=9dd5ee60beec4a19a5a9ad928c0323bd]) successfully deleted
I20260812 17:46:03.615895 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 13190
I20260812 17:46:03.615906 13467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:03.615574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:41055 (local address 127.0.0.1:48208)
0812 17:46:03.615739 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:03.615803 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.2:41055: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260812 17:46:03.632427 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 12526
I20260812 17:46:23.649953 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:34829
--webserver_interface=127.17.255.62
--webserver_port=34953
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:38455
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:34829
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:46:23.778031 13516 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:46:23.778378 13516 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:46:23.778517 13516 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:46:23.782691 13516 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 17:46:23.782789 13516 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 17:46:23.782819 13516 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 17:46:23.782852 13516 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:46:23.782897 13516 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:46:23.782953 13516 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:46:23.782992 13516 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:46:23.783030 13516 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:46:23.788769 13516 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:38455
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:34829
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:34829
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=34953
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13516
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:46:23.789970 13516 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:46:23.791127 13516 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:46:23.806744 13532 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:46:23.806725 13531 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:46:23.806773 13535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:46:23.807022 13516 server_base.cc:1034] running on GCE node
I20260812 17:46:23.807698 13516 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:46:23.809006 13516 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:46:23.810215 13516 hybrid_clock.cc:648] HybridClock initialized: now 1786556783810196 us; error 32 us; skew 500 ppm
Aug 12 17:46:23 dist-test-slave-tk9z krb5kdc[12508](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556783, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:46:23.813452 13516 init.cc:377] Logged in from keytab as kudu/127.17.255.62@KRBTEST.COM (short username kudu)
I20260812 17:46:23.816968 13516 webserver.cc:460] Webserver started at http://127.17.255.62:34953/ using document root <none> and password file <none>
I20260812 17:46:23.817618 13516 fs_manager.cc:359] Metadata directory not provided
I20260812 17:46:23.817700 13516 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:46:23.821983 13516 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260812 17:46:23.824429 13552 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:46:23.825829 13516 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260812 17:46:23.825987 13516 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "ba73241e720441cb8621a47ee30d8289"
format_stamp: "Formatted at 2026-08-12 17:46:02 on dist-test-slave-tk9z"
server_key: "84ac12452f5e32644bcd7fdb08eedcb4"
server_key_iv: "23fa21a9a7f5204a8e55becf9dfa8bcc"
server_key_version: "encryptionkey@0"
I20260812 17:46:23.826731 13516 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:46:23.847836 13516 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:46:23.851622 13516 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:46:23.851872 13516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:46:23.860641 13516 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:34829
I20260812 17:46:23.860960 13658 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:34829 every 8 connection(s)
I20260812 17:46:23.861963 13516 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:46:23.867023 13659 sys_catalog.cc:263] Verifying existing consensus state
I20260812 17:46:23.868999 13659 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289: Bootstrap starting.
I20260812 17:46:23.869498 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 13516
I20260812 17:46:23.869973 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.1:33045
--local_ip_for_outbound_sockets=127.17.255.1
--tserver_master_addrs=127.17.255.62:34829
--webserver_port=35947
--webserver_interface=127.17.255.1
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:38455
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 17:46:23.887954 13659 log.cc:824] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289: Log is configured to *not* fsync() on all Append() calls
I20260812 17:46:23.897534 13659 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 17:46:23.897996 13659 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289: Bootstrap complete.
I20260812 17:46:23.902477 13659 raft_consensus.cc:348] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba73241e720441cb8621a47ee30d8289" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 34829 } }
I20260812 17:46:23.902964 13659 raft_consensus.cc:729] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba73241e720441cb8621a47ee30d8289, State: Initialized, Role: FOLLOWER
I20260812 17:46:23.903553 13659 consensus_queue.cc:260] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba73241e720441cb8621a47ee30d8289" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 34829 } }
I20260812 17:46:23.903709 13659 raft_consensus.cc:388] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:46:23.903810 13659 raft_consensus.cc:482] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:46:23.903940 13659 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [term 1 FOLLOWER]: Advancing to term 2
I20260812 17:46:23.906059 13659 raft_consensus.cc:504] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba73241e720441cb8621a47ee30d8289" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 34829 } }
I20260812 17:46:23.906512 13659 leader_election.cc:302] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ba73241e720441cb8621a47ee30d8289; no voters:
I20260812 17:46:23.906934 13659 leader_election.cc:288] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 17:46:23.907102 13671 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 17:46:23.907374 13671 raft_consensus.cc:686] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [term 2 LEADER]: Becoming Leader. State: Replica: ba73241e720441cb8621a47ee30d8289, State: Running, Role: LEADER
I20260812 17:46:23.907742 13671 consensus_queue.cc:237] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba73241e720441cb8621a47ee30d8289" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 34829 } }
I20260812 17:46:23.908305 13659 sys_catalog.cc:564] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:46:23.908812 13671 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ba73241e720441cb8621a47ee30d8289. Latest consensus state: current_term: 2 leader_uuid: "ba73241e720441cb8621a47ee30d8289" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba73241e720441cb8621a47ee30d8289" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 34829 } } }
I20260812 17:46:23.908932 13671 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [sys.catalog]: This master's current role is: LEADER
I20260812 17:46:23.909319 13677 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:46:23.909463 13672 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "ba73241e720441cb8621a47ee30d8289" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba73241e720441cb8621a47ee30d8289" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 34829 } } }
I20260812 17:46:23.909651 13672 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [sys.catalog]: This master's current role is: LEADER
I20260812 17:46:23.914800 13677 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:46:23.915546 13677 catalog_manager.cc:1259] Loaded cluster ID: ff844b8d8c844a2db744eb9428b5b5db
I20260812 17:46:23.915628 13677 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:46:23.917440 13677 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:46:23.918071 13677 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289: Loaded TSK: 0
I20260812 17:46:23.928089 13677 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289: Generated new TSK 1
I20260812 17:46:23.928396 13677 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 17:46:24.004827 13665 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:46:24.005167 13665 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:46:24.005267 13665 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:46:24.009871 13665 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:46:24.009987 13665 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:46:24.010084 13665 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.1
I20260812 17:46:24.015769 13665 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:38455
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.1:33045
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.255.1
--webserver_port=35947
--tserver_master_addrs=127.17.255.62:34829
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13665
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.1
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:46:24.016876 13665 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:46:24.018029 13665 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:46:24.028434 13707 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:46:24.028637 13706 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:46:24.028471 13711 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:46:24.029237 13665 server_base.cc:1034] running on GCE node
I20260812 17:46:24.029747 13665 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:46:24.030584 13665 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:46:24.031800 13665 hybrid_clock.cc:648] HybridClock initialized: now 1786556784031788 us; error 50 us; skew 500 ppm
Aug 12 17:46:24 dist-test-slave-tk9z krb5kdc[12508](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556784, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:46:24.035244 13665 init.cc:377] Logged in from keytab as kudu/127.17.255.1@KRBTEST.COM (short username kudu)
I20260812 17:46:24.036419 13665 webserver.cc:460] Webserver started at http://127.17.255.1:35947/ using document root <none> and password file <none>
I20260812 17:46:24.037065 13665 fs_manager.cc:359] Metadata directory not provided
I20260812 17:46:24.037192 13665 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:46:24.041687 13665 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.001s
I20260812 17:46:24.044127 13724 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:46:24.045542 13665 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 17:46:24.045667 13665 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/wal
uuid: "02ff7ae11a3348839780d12d801af0de"
format_stamp: "Formatted at 2026-08-12 17:46:02 on dist-test-slave-tk9z"
server_key: "e4e68c3dee78aa2d3ffaf27b1e4f18e0"
server_key_iv: "65704cd40fe9d2e5325786198c55d212"
server_key_version: "encryptionkey@0"
I20260812 17:46:24.046249 13665 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:46:24.066601 13665 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:46:24.069916 13665 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:46:24.070135 13665 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:46:24.070864 13665 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:46:24.072116 13735 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 17:46:24.076764 13665 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 17:46:24.076848 13665 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.001s sys 0.000s
I20260812 17:46:24.076939 13665 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 17:46:24.078997 13665 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 17:46:24.079053 13665 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.002s sys 0.000s
I20260812 17:46:24.079435 13735 tablet_bootstrap.cc:492] T ba07f548587d43d7b03fa319c503454f P 02ff7ae11a3348839780d12d801af0de: Bootstrap starting.
I20260812 17:46:24.092093 13665 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.1:33045
I20260812 17:46:24.092221 13910 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.1:33045 every 8 connection(s)
I20260812 17:46:24.093312 13665 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
I20260812 17:46:24.098614 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 13665
I20260812 17:46:24.099200 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.2:41055
--local_ip_for_outbound_sockets=127.17.255.2
--tserver_master_addrs=127.17.255.62:34829
--webserver_port=36885
--webserver_interface=127.17.255.2
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:38455
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 17:46:24.100242 13735 log.cc:824] T ba07f548587d43d7b03fa319c503454f P 02ff7ae11a3348839780d12d801af0de: Log is configured to *not* fsync() on all Append() calls
Aug 12 17:46:24 dist-test-slave-tk9z krb5kdc[12508](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556784, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:46:24.109297 13735 tablet_bootstrap.cc:492] T ba07f548587d43d7b03fa319c503454f P 02ff7ae11a3348839780d12d801af0de: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 17:46:24.109817 13735 tablet_bootstrap.cc:492] T ba07f548587d43d7b03fa319c503454f P 02ff7ae11a3348839780d12d801af0de: Bootstrap complete.
I20260812 17:46:24.111500 13735 ts_tablet_manager.cc:1397] T ba07f548587d43d7b03fa319c503454f P 02ff7ae11a3348839780d12d801af0de: Time spent bootstrapping tablet: real 0.032s user 0.020s sys 0.011s
I20260812 17:46:24.114557 13735 raft_consensus.cc:348] T ba07f548587d43d7b03fa319c503454f P 02ff7ae11a3348839780d12d801af0de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02ff7ae11a3348839780d12d801af0de" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33045 } } peers { permanent_uuid: "6b05ee36b7774a1eadc6845e792fbbb9" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 37193 } } peers { permanent_uuid: "984a95e37bed43babed18a396dca0a5d" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 41055 } }
I20260812 17:46:24.115106 13735 raft_consensus.cc:729] T ba07f548587d43d7b03fa319c503454f P 02ff7ae11a3348839780d12d801af0de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02ff7ae11a3348839780d12d801af0de, State: Initialized, Role: FOLLOWER
I20260812 17:46:24.115744 13920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:24.095880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.1:48045)
0812 17:46:24.096564 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:24.096621 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 17:46:24.097509 (+ 888us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:46:24.099147 (+ 1638us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:46:24.099157 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:46:24.099876 (+ 719us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:46:24.100635 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:46:24.100660 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:46:24.102664 (+ 2004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:46:24.102670 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:46:24.104156 (+ 1486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:46:24.104174 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:46:24.105207 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:46:24.105213 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:46:24.105480 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:46:24.106255 (+ 775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:46:24.106285 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:46:24.108480 (+ 2195us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:46:24.111750 (+ 3270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:46:24.111756 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:46:24.111772 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:46:24.112128 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:46:24.112645 (+ 517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:46:24.112648 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:46:24.112650 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:46:24.112827 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:46:24.113688 (+ 861us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:46:24.113695 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:46:24.114000 (+ 305us) client_negotiation.cc:769] Sending connection context
0812 17:46:24.114213 (+ 213us) client_negotiation.cc:240] Negotiation successful
0812 17:46:24.114613 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":166,"threads_started":1}
I20260812 17:46:24.115741 13919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:24.095958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:48045 (local address 127.17.255.62:34829)
0812 17:46:24.096453 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0812 17:46:24.096493 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0812 17:46:24.096767 (+ 274us) server_negotiation.cc:407] Connection header received
0812 17:46:24.098061 (+ 1294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:46:24.098079 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:46:24.098618 (+ 539us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:46:24.099029 (+ 411us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:46:24.100884 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:24.102475 (+ 1591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:24.104326 (+ 1851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:24.105027 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:24.105201 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:46:24.108758 (+ 3557us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:46:24.108770 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:46:24.108792 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:46:24.108838 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:46:24.111476 (+ 2638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:46:24.112279 (+ 803us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:46:24.112289 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:46:24.112298 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:46:24.112503 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:46:24.112946 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:46:24.112950 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:46:24.112952 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:46:24.113535 (+ 583us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:46:24.113664 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0812 17:46:24.114429 (+ 765us) server_negotiation.cc:299] Negotiation successful
0812 17:46:24.114885 (+ 456us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":151,"threads_started":1}
I20260812 17:46:24.115681 13735 consensus_queue.cc:260] T ba07f548587d43d7b03fa319c503454f P 02ff7ae11a3348839780d12d801af0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02ff7ae11a3348839780d12d801af0de" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33045 } } peers { permanent_uuid: "6b05ee36b7774a1eadc6845e792fbbb9" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 37193 } } peers { permanent_uuid: "984a95e37bed43babed18a396dca0a5d" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 41055 } }
I20260812 17:46:24.116986 13735 ts_tablet_manager.cc:1428] T ba07f548587d43d7b03fa319c503454f P 02ff7ae11a3348839780d12d801af0de: Time spent starting tablet: real 0.005s user 0.004s sys 0.001s
I20260812 17:46:24.118602 13912 heartbeater.cc:347] Connected to a master server at 127.17.255.62:34829
I20260812 17:46:24.118875 13912 heartbeater.cc:464] Registering TS with master...
I20260812 17:46:24.119485 13912 heartbeater.cc:511] Master 127.17.255.62:34829 requested a full tablet report, sending...
I20260812 17:46:24.122486 13583 ts_manager.cc:194] Registered new tserver with Master: 02ff7ae11a3348839780d12d801af0de (127.17.255.1:33045)
I20260812 17:46:24.126909 13583 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.1@KRBTEST.COM'} at 127.17.255.1:48045
I20260812 17:46:24.130180 13912 heartbeater.cc:503] Master 127.17.255.62:34829 was elected leader, sending a full tablet report...
Aug 12 17:46:24 dist-test-slave-tk9z krb5kdc[12508](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556783, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for kudu/127.17.255.1@KRBTEST.COM
I20260812 17:46:24.137607 13926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:24.126177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:33045 (local address 127.0.0.1:48146)
0812 17:46:24.126983 (+ 806us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:24.127043 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0812 17:46:24.127203 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:46:24.127718 (+ 515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:46:24.127725 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:46:24.128193 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:46:24.128302 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:46:24.128310 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:46:24.129305 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:46:24.129308 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:46:24.129986 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:46:24.129998 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:46:24.130787 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:46:24.130791 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:46:24.130916 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:46:24.131565 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:46:24.131581 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:46:24.133300 (+ 1719us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:46:24.135697 (+ 2397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:46:24.135706 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:46:24.135711 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:46:24.135995 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:46:24.136356 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:46:24.136359 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:46:24.136360 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:46:24.136458 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:46:24.137048 (+ 590us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:46:24.137054 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:46:24.137170 (+ 116us) client_negotiation.cc:769] Sending connection context
0812 17:46:24.137301 (+ 131us) client_negotiation.cc:240] Negotiation successful
0812 17:46:24.137471 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":626,"thread_start_us":139,"threads_started":1}
I20260812 17:46:24.137760 13931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:24.126239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48146 (local address 127.17.255.1:33045)
0812 17:46:24.126714 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0812 17:46:24.126727 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 17:46:24.127320 (+ 593us) server_negotiation.cc:407] Connection header received
0812 17:46:24.127387 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:46:24.127391 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:46:24.127564 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:46:24.127716 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:46:24.128429 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:24.129186 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:24.130170 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:24.130650 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:24.130759 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:46:24.133453 (+ 2694us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:46:24.133464 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:46:24.133477 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:46:24.133506 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:46:24.135540 (+ 2034us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:46:24.136122 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:46:24.136128 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:46:24.136130 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:46:24.136230 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:46:24.136563 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:46:24.136566 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:46:24.136568 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:46:24.136917 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:46:24.137056 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0812 17:46:24.137408 (+ 352us) server_negotiation.cc:299] Negotiation successful
0812 17:46:24.137591 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":374,"thread_start_us":105,"threads_started":1}
I20260812 17:46:24.138868 13808 tablet_service.cc:1514] Processing DeleteTablet for tablet ba07f548587d43d7b03fa319c503454f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:46:03 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:48146
I20260812 17:46:24.139835 13932 tablet_replica.cc:330] stopping tablet replica
I20260812 17:46:24.140177 13932 raft_consensus.cc:2229] T ba07f548587d43d7b03fa319c503454f P 02ff7ae11a3348839780d12d801af0de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:46:24.140451 13932 raft_consensus.cc:2258] T ba07f548587d43d7b03fa319c503454f P 02ff7ae11a3348839780d12d801af0de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:46:24.141639 13932 ts_tablet_manager.cc:1905] T ba07f548587d43d7b03fa319c503454f P 02ff7ae11a3348839780d12d801af0de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:46:24.146461 13932 ts_tablet_manager.cc:1918] T ba07f548587d43d7b03fa319c503454f P 02ff7ae11a3348839780d12d801af0de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 17:46:24.146572 13932 log.cc:1196] T ba07f548587d43d7b03fa319c503454f P 02ff7ae11a3348839780d12d801af0de: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/wal/wals/ba07f548587d43d7b03fa319c503454f
I20260812 17:46:24.146893 13932 ts_tablet_manager.cc:1939] T ba07f548587d43d7b03fa319c503454f P 02ff7ae11a3348839780d12d801af0de: Deleting consensus metadata
I20260812 17:46:24.149003 13556 catalog_manager.cc:4841] TS 02ff7ae11a3348839780d12d801af0de (127.17.255.1:33045): tablet ba07f548587d43d7b03fa319c503454f (table test-table [id=9dd5ee60beec4a19a5a9ad928c0323bd]) successfully deleted
W20260812 17:46:24.239281 13923 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:46:24.239581 13923 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:46:24.239629 13923 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:46:24.244035 13923 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:46:24.244107 13923 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:46:24.244202 13923 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.2
I20260812 17:46:24.249734 13923 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:38455
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.2:41055
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.255.2
--webserver_port=36885
--tserver_master_addrs=127.17.255.62:34829
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13923
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.2
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:46:24.250979 13923 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:46:24.252071 13923 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:46:24.262238 13938 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:46:24.262284 13944 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:46:24.262358 13923 server_base.cc:1034] running on GCE node
W20260812 17:46:24.262594 13940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:46:24.263028 13923 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:46:24.263711 13923 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:46:24.264901 13923 hybrid_clock.cc:648] HybridClock initialized: now 1786556784264864 us; error 54 us; skew 500 ppm
Aug 12 17:46:24 dist-test-slave-tk9z krb5kdc[12508](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556784, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:46:24.267902 13923 init.cc:377] Logged in from keytab as kudu/127.17.255.2@KRBTEST.COM (short username kudu)
I20260812 17:46:24.268823 13923 webserver.cc:460] Webserver started at http://127.17.255.2:36885/ using document root <none> and password file <none>
I20260812 17:46:24.269419 13923 fs_manager.cc:359] Metadata directory not provided
I20260812 17:46:24.269556 13923 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:46:24.273808 13923 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260812 17:46:24.276207 13958 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:46:24.277602 13923 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 17:46:24.277876 13923 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/wal
uuid: "984a95e37bed43babed18a396dca0a5d"
format_stamp: "Formatted at 2026-08-12 17:46:03 on dist-test-slave-tk9z"
server_key: "97214328b4fa8085502c521d2da319c2"
server_key_iv: "9f8b546908f41a7ba4c3600f3003853e"
server_key_version: "encryptionkey@0"
I20260812 17:46:24.278520 13923 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:46:24.293754 13923 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:46:24.296913 13923 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:46:24.297132 13923 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:46:24.297770 13923 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:46:24.299022 13971 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 17:46:24.303810 13923 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 17:46:24.303917 13923 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.001s sys 0.000s
I20260812 17:46:24.304009 13923 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 17:46:24.305823 13923 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 17:46:24.305897 13923 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260812 17:46:24.306236 13971 tablet_bootstrap.cc:492] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d: Bootstrap starting.
I20260812 17:46:24.312860 13971 log.cc:824] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d: Log is configured to *not* fsync() on all Append() calls
I20260812 17:46:24.317011 13923 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.2:41055
I20260812 17:46:24.317104 14181 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.2:41055 every 8 connection(s)
I20260812 17:46:24.317961 13923 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
I20260812 17:46:24.319670 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 13923
I20260812 17:46:24.320237 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.3:37193
--local_ip_for_outbound_sockets=127.17.255.3
--tserver_master_addrs=127.17.255.62:34829
--webserver_port=36289
--webserver_interface=127.17.255.3
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:38455
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 17:46:24.323182 13971 tablet_bootstrap.cc:492] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 17:46:24.323642 13971 tablet_bootstrap.cc:492] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d: Bootstrap complete.
I20260812 17:46:24.324071 13971 ts_tablet_manager.cc:1397] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d: Time spent bootstrapping tablet: real 0.018s user 0.017s sys 0.000s
I20260812 17:46:24.327284 13971 raft_consensus.cc:348] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02ff7ae11a3348839780d12d801af0de" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33045 } } peers { permanent_uuid: "6b05ee36b7774a1eadc6845e792fbbb9" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 37193 } } peers { permanent_uuid: "984a95e37bed43babed18a396dca0a5d" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 41055 } }
I20260812 17:46:24.327811 13971 raft_consensus.cc:729] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 984a95e37bed43babed18a396dca0a5d, State: Initialized, Role: FOLLOWER
I20260812 17:46:24.328450 13971 consensus_queue.cc:260] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02ff7ae11a3348839780d12d801af0de" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33045 } } peers { permanent_uuid: "6b05ee36b7774a1eadc6845e792fbbb9" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 37193 } } peers { permanent_uuid: "984a95e37bed43babed18a396dca0a5d" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 41055 } }
I20260812 17:46:24.329648 13971 ts_tablet_manager.cc:1428] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
Aug 12 17:46:24 dist-test-slave-tk9z krb5kdc[12508](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556784, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:46:24.335583 13919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:24.319963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:42203 (local address 127.17.255.62:34829)
0812 17:46:24.320130 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0812 17:46:24.320135 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:46:24.321457 (+ 1322us) server_negotiation.cc:407] Connection header received
0812 17:46:24.322840 (+ 1383us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:46:24.322845 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:46:24.322909 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:46:24.323023 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:46:24.324523 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:24.325399 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:24.326720 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:24.327088 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:24.327221 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:46:24.331367 (+ 4146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:46:24.331371 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:46:24.331373 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:46:24.331407 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:46:24.333139 (+ 1732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:46:24.333784 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:46:24.333789 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:46:24.333796 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:46:24.333884 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:46:24.334261 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:46:24.334265 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:46:24.334266 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:46:24.334561 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:46:24.334676 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 17:46:24.335246 (+ 570us) server_negotiation.cc:299] Negotiation successful
0812 17:46:24.335401 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260812 17:46:24.336483 14187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:24.320095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.2:42203)
0812 17:46:24.321278 (+ 1183us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:24.321322 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 17:46:24.322557 (+ 1235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:46:24.323222 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:46:24.323231 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:46:24.323771 (+ 540us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:46:24.324347 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:46:24.324365 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:46:24.325577 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:46:24.325579 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:46:24.326573 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:46:24.326588 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:46:24.327243 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:46:24.327250 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:46:24.327537 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:46:24.328811 (+ 1274us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:46:24.328840 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:46:24.331121 (+ 2281us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:46:24.333281 (+ 2160us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:46:24.333288 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:46:24.333304 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:46:24.333665 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:46:24.333986 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:46:24.333992 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:46:24.333994 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:46:24.334152 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:46:24.334676 (+ 524us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:46:24.334686 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:46:24.334986 (+ 300us) client_negotiation.cc:769] Sending connection context
0812 17:46:24.335184 (+ 198us) client_negotiation.cc:240] Negotiation successful
0812 17:46:24.335547 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1001,"thread_start_us":182,"threads_started":1}
I20260812 17:46:24.337671 14182 heartbeater.cc:347] Connected to a master server at 127.17.255.62:34829
I20260812 17:46:24.337949 14182 heartbeater.cc:464] Registering TS with master...
I20260812 17:46:24.338593 14182 heartbeater.cc:511] Master 127.17.255.62:34829 requested a full tablet report, sending...
I20260812 17:46:24.340628 13583 ts_manager.cc:194] Registered new tserver with Master: 984a95e37bed43babed18a396dca0a5d (127.17.255.2:41055)
I20260812 17:46:24.341884 13583 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.2@KRBTEST.COM'} at 127.17.255.2:42203
I20260812 17:46:24.344040 14182 heartbeater.cc:503] Master 127.17.255.62:34829 was elected leader, sending a full tablet report...
Aug 12 17:46:24 dist-test-slave-tk9z krb5kdc[12508](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556783, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for kudu/127.17.255.2@KRBTEST.COM
I20260812 17:46:24.355192 13926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:24.341531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:41055 (local address 127.0.0.1:60312)
0812 17:46:24.341724 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:24.341738 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 17:46:24.341814 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:46:24.344505 (+ 2691us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:46:24.344509 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:46:24.344717 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:46:24.344854 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:46:24.344862 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:46:24.346473 (+ 1611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:46:24.346477 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:46:24.347071 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:46:24.347082 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:46:24.348012 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:46:24.348015 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:46:24.348101 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:46:24.348737 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:46:24.348751 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:46:24.350562 (+ 1811us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:46:24.353205 (+ 2643us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:46:24.353208 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:46:24.353215 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:46:24.353449 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:46:24.353846 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:46:24.353849 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:46:24.353851 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:46:24.353949 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:46:24.354590 (+ 641us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:46:24.354593 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:46:24.354773 (+ 180us) client_negotiation.cc:769] Sending connection context
0812 17:46:24.354903 (+ 130us) client_negotiation.cc:240] Negotiation successful
0812 17:46:24.355054 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121}
I20260812 17:46:24.355415 14191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:24.341676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60312 (local address 127.17.255.2:41055)
0812 17:46:24.342060 (+ 384us) server_negotiation.cc:206] Beginning negotiation
0812 17:46:24.342073 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 17:46:24.342096 (+ 23us) server_negotiation.cc:407] Connection header received
0812 17:46:24.342165 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:46:24.342171 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:46:24.342485 (+ 314us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:46:24.342627 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:46:24.345000 (+ 2373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:24.346268 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:24.347206 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:24.347854 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:24.347977 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:46:24.350756 (+ 2779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:46:24.350771 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:46:24.350789 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:46:24.350822 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:46:24.353050 (+ 2228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:46:24.353583 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:46:24.353590 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:46:24.353592 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:46:24.353698 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:46:24.354053 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:46:24.354056 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:46:24.354058 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:46:24.354450 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:46:24.354595 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0812 17:46:24.355041 (+ 446us) server_negotiation.cc:299] Negotiation successful
0812 17:46:24.355238 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285,"thread_start_us":118,"threads_started":1}
I20260812 17:46:24.356621 14036 tablet_service.cc:1514] Processing DeleteTablet for tablet ba07f548587d43d7b03fa319c503454f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:46:03 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:60312
I20260812 17:46:24.357607 14192 tablet_replica.cc:330] stopping tablet replica
I20260812 17:46:24.357970 14192 raft_consensus.cc:2229] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:46:24.358249 14192 raft_consensus.cc:2258] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:46:24.359355 14192 ts_tablet_manager.cc:1905] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:46:24.363237 14192 ts_tablet_manager.cc:1918] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 17:46:24.363327 14192 log.cc:1196] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/wal/wals/ba07f548587d43d7b03fa319c503454f
I20260812 17:46:24.363602 14192 ts_tablet_manager.cc:1939] T ba07f548587d43d7b03fa319c503454f P 984a95e37bed43babed18a396dca0a5d: Deleting consensus metadata
I20260812 17:46:24.365722 13556 catalog_manager.cc:4841] TS 984a95e37bed43babed18a396dca0a5d (127.17.255.2:41055): tablet ba07f548587d43d7b03fa319c503454f (table test-table [id=9dd5ee60beec4a19a5a9ad928c0323bd]) successfully deleted
W20260812 17:46:24.454012 14188 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:46:24.454360 14188 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:46:24.454471 14188 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:46:24.458810 14188 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:46:24.458911 14188 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:46:24.459020 14188 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.3
I20260812 17:46:24.464704 14188 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:38455
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.3:37193
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.255.3
--webserver_port=36289
--tserver_master_addrs=127.17.255.62:34829
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14188
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.3
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:46:24.465988 14188 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:46:24.467182 14188 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:46:24.478009 14201 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:46:24.478052 14203 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:46:24.478009 14199 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:46:24.478129 14188 server_base.cc:1034] running on GCE node
I20260812 17:46:24.478737 14188 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:46:24.479555 14188 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:46:24.480751 14188 hybrid_clock.cc:648] HybridClock initialized: now 1786556784480710 us; error 56 us; skew 500 ppm
Aug 12 17:46:24 dist-test-slave-tk9z krb5kdc[12508](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556784, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:46:24.484329 14188 init.cc:377] Logged in from keytab as kudu/127.17.255.3@KRBTEST.COM (short username kudu)
I20260812 17:46:24.485411 14188 webserver.cc:460] Webserver started at http://127.17.255.3:36289/ using document root <none> and password file <none>
I20260812 17:46:24.486042 14188 fs_manager.cc:359] Metadata directory not provided
I20260812 17:46:24.486123 14188 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:46:24.490204 14188 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:46:24.492576 14221 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:46:24.493928 14188 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 17:46:24.494077 14188 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/wal
uuid: "6b05ee36b7774a1eadc6845e792fbbb9"
format_stamp: "Formatted at 2026-08-12 17:46:03 on dist-test-slave-tk9z"
server_key: "67c484eeea3966f3f91f8098cb888f47"
server_key_iv: "24eea2671fe2ec9f66b07f125f65424d"
server_key_version: "encryptionkey@0"
I20260812 17:46:24.494738 14188 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:46:24.516813 14188 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:46:24.520502 14188 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:46:24.520740 14188 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:46:24.521420 14188 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:46:24.522428 14188 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:46:24.522500 14188 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:46:24.522576 14188 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:46:24.522620 14188 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:46:24.532299 14188 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.3:37193
I20260812 17:46:24.532370 14427 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.3:37193 every 8 connection(s)
I20260812 17:46:24.533457 14188 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
I20260812 17:46:24.542711 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 14188
Aug 12 17:46:24 dist-test-slave-tk9z krb5kdc[12508](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556784, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:46:24.549686 13919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:24.535547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:43271 (local address 127.17.255.62:34829)
0812 17:46:24.535690 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0812 17:46:24.535694 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:46:24.536991 (+ 1297us) server_negotiation.cc:407] Connection header received
0812 17:46:24.537996 (+ 1005us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:46:24.537999 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:46:24.538065 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:46:24.538148 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:46:24.539461 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:24.540015 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:24.541254 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:24.541504 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:24.541616 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:46:24.544975 (+ 3359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:46:24.544978 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:46:24.544980 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:46:24.545007 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:46:24.546879 (+ 1872us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:46:24.547492 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:46:24.547494 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:46:24.547496 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:46:24.547574 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:46:24.548025 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:46:24.548029 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:46:24.548031 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:46:24.548259 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:46:24.548533 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0812 17:46:24.549298 (+ 765us) server_negotiation.cc:299] Negotiation successful
0812 17:46:24.549443 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 17:46:24.550998 14433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:24.536003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.3:43271)
0812 17:46:24.536800 (+ 797us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:24.536849 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 17:46:24.537757 (+ 908us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:46:24.538350 (+ 593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:46:24.538357 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:46:24.538763 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:46:24.539283 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:46:24.539297 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:46:24.540154 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:46:24.540160 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:46:24.541110 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:46:24.541121 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:46:24.541685 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:46:24.541691 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:46:24.541872 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:46:24.542539 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:46:24.542557 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:46:24.544734 (+ 2177us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:46:24.547007 (+ 2273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:46:24.547016 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:46:24.547038 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:46:24.547369 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:46:24.547677 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:46:24.547683 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:46:24.547687 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:46:24.547873 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:46:24.548562 (+ 689us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:46:24.548573 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:46:24.548983 (+ 410us) client_negotiation.cc:769] Sending connection context
0812 17:46:24.549221 (+ 238us) client_negotiation.cc:240] Negotiation successful
0812 17:46:24.549720 (+ 499us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":575,"thread_start_us":123,"threads_started":1}
I20260812 17:46:24.552423 14428 heartbeater.cc:347] Connected to a master server at 127.17.255.62:34829
I20260812 17:46:24.552726 14428 heartbeater.cc:464] Registering TS with master...
I20260812 17:46:24.553246 14435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:24.543511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44912 (local address 127.17.255.62:34829)
0812 17:46:24.543831 (+ 320us) server_negotiation.cc:206] Beginning negotiation
0812 17:46:24.543838 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 17:46:24.544059 (+ 221us) server_negotiation.cc:407] Connection header received
0812 17:46:24.544148 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:46:24.544151 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:46:24.544214 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:46:24.544316 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:46:24.545255 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:24.546005 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:24.547044 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:24.547276 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:24.547360 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:46:24.549040 (+ 1680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:46:24.549043 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:46:24.549045 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:46:24.549069 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:46:24.550980 (+ 1911us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:46:24.551544 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:46:24.551548 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:46:24.551550 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:46:24.551647 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:46:24.552144 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:46:24.552147 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:46:24.552149 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:46:24.552435 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:46:24.552673 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0812 17:46:24.552928 (+ 255us) server_negotiation.cc:299] Negotiation successful
0812 17:46:24.553065 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":214,"thread_start_us":105,"threads_started":1}
I20260812 17:46:24.553435 14428 heartbeater.cc:511] Master 127.17.255.62:34829 requested a full tablet report, sending...
I20260812 17:46:24.554720 13586 ts_manager.cc:194] Registered new tserver with Master: 6b05ee36b7774a1eadc6845e792fbbb9 (127.17.255.3:37193)
I20260812 17:46:24.555572 13586 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.3@KRBTEST.COM'} at 127.17.255.3:43271
I20260812 17:46:24.567718 18428 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 17:46:24.572441 14435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:24.568449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44928 (local address 127.17.255.62:34829)
0812 17:46:24.568586 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0812 17:46:24.568590 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:46:24.568800 (+ 210us) server_negotiation.cc:407] Connection header received
0812 17:46:24.569019 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:46:24.569021 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:46:24.569141 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:46:24.569239 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:46:24.569497 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:24.570027 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:24.571108 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:24.571404 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:24.571499 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:46:24.571845 (+ 346us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:46:24.572022 (+ 177us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0812 17:46:24.572320 (+ 298us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44928: token expired
Metrics: {"server-negotiator.queue_time_us":48}
W20260812 17:46:24.572563 14435 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44928: token expired
W20260812 17:46:24.572983 13450 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.17.255.62:34829)
I20260812 17:46:24.581698 14435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:24.573565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44936 (local address 127.17.255.62:34829)
0812 17:46:24.573696 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 17:46:24.573700 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:46:24.573711 (+ 11us) server_negotiation.cc:407] Connection header received
0812 17:46:24.573746 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:46:24.573748 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:46:24.573789 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:46:24.573863 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:46:24.574720 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:24.575235 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:24.576076 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:24.576292 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:24.576410 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:46:24.577936 (+ 1526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:46:24.577939 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:46:24.577941 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:46:24.577967 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:46:24.579617 (+ 1650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:46:24.580099 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:46:24.580102 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:46:24.580103 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:46:24.580195 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:46:24.580615 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:46:24.580618 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:46:24.580620 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:46:24.580844 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:46:24.580961 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 17:46:24.581289 (+ 328us) server_negotiation.cc:299] Negotiation successful
0812 17:46:24.581467 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 17:46:24.585052 13586 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44936:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 17:46:24.588773 13586 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 17:46:24.597640 13808 tablet_service.cc:1467] Processing CreateTablet for tablet d9a5a610f45c456a98ef62297db4926d (DEFAULT_TABLE table=test-table [id=40791c80b55044af99737b5eeba69f6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:46:24.597640 14036 tablet_service.cc:1467] Processing CreateTablet for tablet d9a5a610f45c456a98ef62297db4926d (DEFAULT_TABLE table=test-table [id=40791c80b55044af99737b5eeba69f6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:46:24.598397 13808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9a5a610f45c456a98ef62297db4926d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:46:24.598369 14036 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9a5a610f45c456a98ef62297db4926d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:46:24.601482 13971 tablet_bootstrap.cc:492] T d9a5a610f45c456a98ef62297db4926d P 984a95e37bed43babed18a396dca0a5d: Bootstrap starting.
I20260812 17:46:24.601516 13735 tablet_bootstrap.cc:492] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de: Bootstrap starting.
I20260812 17:46:24.602550 13735 tablet_bootstrap.cc:654] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de: Neither blocks nor log segments found. Creating new log.
I20260812 17:46:24.602653 13971 tablet_bootstrap.cc:654] T d9a5a610f45c456a98ef62297db4926d P 984a95e37bed43babed18a396dca0a5d: Neither blocks nor log segments found. Creating new log.
I20260812 17:46:24.604233 13735 tablet_bootstrap.cc:492] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de: No bootstrap required, opened a new log
I20260812 17:46:24.604350 13735 ts_tablet_manager.cc:1397] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260812 17:46:24.604357 13971 tablet_bootstrap.cc:492] T d9a5a610f45c456a98ef62297db4926d P 984a95e37bed43babed18a396dca0a5d: No bootstrap required, opened a new log
I20260812 17:46:24.604444 13971 ts_tablet_manager.cc:1397] T d9a5a610f45c456a98ef62297db4926d P 984a95e37bed43babed18a396dca0a5d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 17:46:24.604610 13926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:24.596767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.3:37193 (local address 127.0.0.1:44198)
0812 17:46:24.596883 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:24.596901 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 17:46:24.596994 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:46:24.597955 (+ 961us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:46:24.597959 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:46:24.597978 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:46:24.598096 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:46:24.598102 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:46:24.599926 (+ 1824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:46:24.599932 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:46:24.600790 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:46:24.600809 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:46:24.604076 (+ 3267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:46:24.604080 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:46:24.604190 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:46:24.604260 (+ 70us) client_negotiation.cc:769] Sending connection context
0812 17:46:24.604360 (+ 100us) client_negotiation.cc:240] Negotiation successful
0812 17:46:24.604468 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260812 17:46:24.604688 14447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:24.596993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44198 (local address 127.17.255.3:37193)
0812 17:46:24.597396 (+ 403us) server_negotiation.cc:206] Beginning negotiation
0812 17:46:24.597412 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 17:46:24.597441 (+ 29us) server_negotiation.cc:407] Connection header received
0812 17:46:24.597515 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:46:24.597520 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:46:24.597750 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:46:24.598276 (+ 526us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:46:24.598549 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:24.599722 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:24.600928 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:24.603924 (+ 2996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:24.604060 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:46:24.604244 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0812 17:46:24.604414 (+ 170us) server_negotiation.cc:299] Negotiation successful
0812 17:46:24.604537 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":200,"threads_started":1}
I20260812 17:46:24.604885 13735 raft_consensus.cc:348] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b05ee36b7774a1eadc6845e792fbbb9" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 37193 } } peers { permanent_uuid: "984a95e37bed43babed18a396dca0a5d" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 41055 } } peers { permanent_uuid: "02ff7ae11a3348839780d12d801af0de" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33045 } }
I20260812 17:46:24.605028 13735 raft_consensus.cc:374] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:46:24.604948 13971 raft_consensus.cc:348] T d9a5a610f45c456a98ef62297db4926d P 984a95e37bed43babed18a396dca0a5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b05ee36b7774a1eadc6845e792fbbb9" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 37193 } } peers { permanent_uuid: "984a95e37bed43babed18a396dca0a5d" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 41055 } } peers { permanent_uuid: "02ff7ae11a3348839780d12d801af0de" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33045 } }
I20260812 17:46:24.605072 13735 raft_consensus.cc:729] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02ff7ae11a3348839780d12d801af0de, State: Initialized, Role: FOLLOWER
I20260812 17:46:24.605078 13971 raft_consensus.cc:374] T d9a5a610f45c456a98ef62297db4926d P 984a95e37bed43babed18a396dca0a5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:46:24.605118 13971 raft_consensus.cc:729] T d9a5a610f45c456a98ef62297db4926d P 984a95e37bed43babed18a396dca0a5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 984a95e37bed43babed18a396dca0a5d, State: Initialized, Role: FOLLOWER
I20260812 17:46:24.605206 13735 consensus_queue.cc:260] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b05ee36b7774a1eadc6845e792fbbb9" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 37193 } } peers { permanent_uuid: "984a95e37bed43babed18a396dca0a5d" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 41055 } } peers { permanent_uuid: "02ff7ae11a3348839780d12d801af0de" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33045 } }
I20260812 17:46:24.605275 13971 consensus_queue.cc:260] T d9a5a610f45c456a98ef62297db4926d P 984a95e37bed43babed18a396dca0a5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b05ee36b7774a1eadc6845e792fbbb9" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 37193 } } peers { permanent_uuid: "984a95e37bed43babed18a396dca0a5d" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 41055 } } peers { permanent_uuid: "02ff7ae11a3348839780d12d801af0de" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33045 } }
I20260812 17:46:24.605465 13735 ts_tablet_manager.cc:1428] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260812 17:46:24.606021 13971 ts_tablet_manager.cc:1428] T d9a5a610f45c456a98ef62297db4926d P 984a95e37bed43babed18a396dca0a5d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 17:46:24.608155 14305 tablet_service.cc:1467] Processing CreateTablet for tablet d9a5a610f45c456a98ef62297db4926d (DEFAULT_TABLE table=test-table [id=40791c80b55044af99737b5eeba69f6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:46:24.609447 14305 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9a5a610f45c456a98ef62297db4926d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:46:24.617107 14453 tablet_bootstrap.cc:492] T d9a5a610f45c456a98ef62297db4926d P 6b05ee36b7774a1eadc6845e792fbbb9: Bootstrap starting.
I20260812 17:46:24.619670 14453 tablet_bootstrap.cc:654] T d9a5a610f45c456a98ef62297db4926d P 6b05ee36b7774a1eadc6845e792fbbb9: Neither blocks nor log segments found. Creating new log.
I20260812 17:46:24.620595 14453 log.cc:824] T d9a5a610f45c456a98ef62297db4926d P 6b05ee36b7774a1eadc6845e792fbbb9: Log is configured to *not* fsync() on all Append() calls
I20260812 17:46:24.622611 14453 tablet_bootstrap.cc:492] T d9a5a610f45c456a98ef62297db4926d P 6b05ee36b7774a1eadc6845e792fbbb9: No bootstrap required, opened a new log
I20260812 17:46:24.622833 14453 ts_tablet_manager.cc:1397] T d9a5a610f45c456a98ef62297db4926d P 6b05ee36b7774a1eadc6845e792fbbb9: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260812 17:46:24.625757 14453 raft_consensus.cc:348] T d9a5a610f45c456a98ef62297db4926d P 6b05ee36b7774a1eadc6845e792fbbb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b05ee36b7774a1eadc6845e792fbbb9" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 37193 } } peers { permanent_uuid: "984a95e37bed43babed18a396dca0a5d" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 41055 } } peers { permanent_uuid: "02ff7ae11a3348839780d12d801af0de" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33045 } }
I20260812 17:46:24.626050 14453 raft_consensus.cc:374] T d9a5a610f45c456a98ef62297db4926d P 6b05ee36b7774a1eadc6845e792fbbb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:46:24.626133 14453 raft_consensus.cc:729] T d9a5a610f45c456a98ef62297db4926d P 6b05ee36b7774a1eadc6845e792fbbb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b05ee36b7774a1eadc6845e792fbbb9, State: Initialized, Role: FOLLOWER
I20260812 17:46:24.626648 14453 consensus_queue.cc:260] T d9a5a610f45c456a98ef62297db4926d P 6b05ee36b7774a1eadc6845e792fbbb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b05ee36b7774a1eadc6845e792fbbb9" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 37193 } } peers { permanent_uuid: "984a95e37bed43babed18a396dca0a5d" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 41055 } } peers { permanent_uuid: "02ff7ae11a3348839780d12d801af0de" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33045 } }
I20260812 17:46:24.627420 14428 heartbeater.cc:503] Master 127.17.255.62:34829 was elected leader, sending a full tablet report...
I20260812 17:46:24.627753 14453 ts_tablet_manager.cc:1428] T d9a5a610f45c456a98ef62297db4926d P 6b05ee36b7774a1eadc6845e792fbbb9: Time spent starting tablet: real 0.005s user 0.001s sys 0.003s
W20260812 17:46:24.784570 14430 tablet.cc:2369] T d9a5a610f45c456a98ef62297db4926d P 6b05ee36b7774a1eadc6845e792fbbb9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 17:46:24.819304 14184 tablet.cc:2369] T d9a5a610f45c456a98ef62297db4926d P 984a95e37bed43babed18a396dca0a5d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 17:46:24.844867 13916 tablet.cc:2369] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 17:46:24.951167 13924 raft_consensus.cc:482] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:46:24.951462 13924 raft_consensus.cc:504] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b05ee36b7774a1eadc6845e792fbbb9" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 37193 } } peers { permanent_uuid: "984a95e37bed43babed18a396dca0a5d" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 41055 } } peers { permanent_uuid: "02ff7ae11a3348839780d12d801af0de" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33045 } }
I20260812 17:46:24.952634 13924 leader_election.cc:288] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b05ee36b7774a1eadc6845e792fbbb9 (127.17.255.3:37193), 984a95e37bed43babed18a396dca0a5d (127.17.255.2:41055)
I20260812 17:46:24.958868 14447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:24.953177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:39753 (local address 127.17.255.3:37193)
0812 17:46:24.953321 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0812 17:46:24.953327 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:46:24.953548 (+ 221us) server_negotiation.cc:407] Connection header received
0812 17:46:24.953902 (+ 354us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:46:24.953906 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:46:24.953956 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:46:24.954063 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:46:24.954643 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:24.955479 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:24.957492 (+ 2013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:24.958110 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:24.958266 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:46:24.958346 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 17:46:24.958632 (+ 286us) server_negotiation.cc:299] Negotiation successful
0812 17:46:24.958723 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 17:46:24.958878 14461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:24.953172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:35281 (local address 127.17.255.2:41055)
0812 17:46:24.953493 (+ 321us) server_negotiation.cc:206] Beginning negotiation
0812 17:46:24.953496 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 17:46:24.953692 (+ 196us) server_negotiation.cc:407] Connection header received
0812 17:46:24.953895 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:46:24.953898 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:46:24.953973 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:46:24.954099 (+ 126us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:46:24.954643 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:24.955498 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:24.957493 (+ 1995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:24.958253 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:24.958403 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:46:24.958551 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0812 17:46:24.958656 (+ 105us) server_negotiation.cc:299] Negotiation successful
0812 17:46:24.958732 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":250,"thread_start_us":69,"threads_started":1}
I20260812 17:46:24.958915 14457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:24.953022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.3:37193 (local address 127.17.255.1:39753)
0812 17:46:24.953454 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:24.953472 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 17:46:24.953622 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:46:24.954135 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:46:24.954139 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:46:24.954193 (+ 54us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:46:24.954453 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:46:24.954463 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:46:24.955648 (+ 1185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:46:24.955652 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:46:24.957310 (+ 1658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:46:24.957324 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:46:24.958264 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:46:24.958267 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:46:24.958426 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:46:24.958492 (+ 66us) client_negotiation.cc:769] Sending connection context
0812 17:46:24.958585 (+ 93us) client_negotiation.cc:240] Negotiation successful
0812 17:46:24.958687 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":340,"mutex_wait_us":322,"spinlock_wait_cycles":89600,"thread_start_us":108,"threads_started":1}
I20260812 17:46:24.958915 14459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:24.953022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:41055 (local address 127.17.255.1:35281)
0812 17:46:24.953587 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:24.953601 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 17:46:24.953699 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:46:24.954135 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:46:24.954139 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:46:24.954194 (+ 55us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:46:24.954459 (+ 265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:46:24.954465 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:46:24.955648 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:46:24.955652 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:46:24.957314 (+ 1662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:46:24.957324 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:46:24.958409 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:46:24.958412 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:46:24.958538 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:46:24.958573 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 17:46:24.958640 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 17:46:24.958689 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":499,"mutex_wait_us":188,"spinlock_wait_cycles":10880,"thread_start_us":87,"threads_started":1}
I20260812 17:46:24.959770 14336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9a5a610f45c456a98ef62297db4926d" candidate_uuid: "02ff7ae11a3348839780d12d801af0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b05ee36b7774a1eadc6845e792fbbb9" is_pre_election: true
I20260812 17:46:24.959965 14091 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9a5a610f45c456a98ef62297db4926d" candidate_uuid: "02ff7ae11a3348839780d12d801af0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "984a95e37bed43babed18a396dca0a5d" is_pre_election: true
I20260812 17:46:24.960189 14336 raft_consensus.cc:2454] T d9a5a610f45c456a98ef62297db4926d P 6b05ee36b7774a1eadc6845e792fbbb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02ff7ae11a3348839780d12d801af0de in term 0.
I20260812 17:46:24.960233 14091 raft_consensus.cc:2454] T d9a5a610f45c456a98ef62297db4926d P 984a95e37bed43babed18a396dca0a5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02ff7ae11a3348839780d12d801af0de in term 0.
I20260812 17:46:24.960861 13727 leader_election.cc:302] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 02ff7ae11a3348839780d12d801af0de, 6b05ee36b7774a1eadc6845e792fbbb9, 984a95e37bed43babed18a396dca0a5d; no voters:
I20260812 17:46:24.961210 13924 raft_consensus.cc:2781] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 17:46:24.961315 13924 raft_consensus.cc:482] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 17:46:24.961373 13924 raft_consensus.cc:3037] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:46:24.962508 13924 raft_consensus.cc:504] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b05ee36b7774a1eadc6845e792fbbb9" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 37193 } } peers { permanent_uuid: "984a95e37bed43babed18a396dca0a5d" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 41055 } } peers { permanent_uuid: "02ff7ae11a3348839780d12d801af0de" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33045 } }
I20260812 17:46:24.962900 13924 leader_election.cc:288] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [CANDIDATE]: Term 1 election: Requested vote from peers 6b05ee36b7774a1eadc6845e792fbbb9 (127.17.255.3:37193), 984a95e37bed43babed18a396dca0a5d (127.17.255.2:41055)
I20260812 17:46:24.963290 14336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9a5a610f45c456a98ef62297db4926d" candidate_uuid: "02ff7ae11a3348839780d12d801af0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b05ee36b7774a1eadc6845e792fbbb9"
I20260812 17:46:24.963346 14091 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9a5a610f45c456a98ef62297db4926d" candidate_uuid: "02ff7ae11a3348839780d12d801af0de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "984a95e37bed43babed18a396dca0a5d"
I20260812 17:46:24.963449 14336 raft_consensus.cc:3037] T d9a5a610f45c456a98ef62297db4926d P 6b05ee36b7774a1eadc6845e792fbbb9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:46:24.963546 14091 raft_consensus.cc:3037] T d9a5a610f45c456a98ef62297db4926d P 984a95e37bed43babed18a396dca0a5d [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:46:24.964700 14336 raft_consensus.cc:2454] T d9a5a610f45c456a98ef62297db4926d P 6b05ee36b7774a1eadc6845e792fbbb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02ff7ae11a3348839780d12d801af0de in term 1.
I20260812 17:46:24.965003 14091 raft_consensus.cc:2454] T d9a5a610f45c456a98ef62297db4926d P 984a95e37bed43babed18a396dca0a5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02ff7ae11a3348839780d12d801af0de in term 1.
I20260812 17:46:24.965170 13725 leader_election.cc:302] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02ff7ae11a3348839780d12d801af0de, 6b05ee36b7774a1eadc6845e792fbbb9; no voters:
I20260812 17:46:24.965407 13924 raft_consensus.cc:2781] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:46:24.965623 13924 raft_consensus.cc:686] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [term 1 LEADER]: Becoming Leader. State: Replica: 02ff7ae11a3348839780d12d801af0de, State: Running, Role: LEADER
I20260812 17:46:24.965943 13924 consensus_queue.cc:237] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b05ee36b7774a1eadc6845e792fbbb9" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 37193 } } peers { permanent_uuid: "984a95e37bed43babed18a396dca0a5d" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 41055 } } peers { permanent_uuid: "02ff7ae11a3348839780d12d801af0de" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33045 } }
I20260812 17:46:24.969594 13583 catalog_manager.cc:5495] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de reported cstate change: term changed from 0 to 1, leader changed from <none> to 02ff7ae11a3348839780d12d801af0de (127.17.255.1). New cstate: current_term: 1 leader_uuid: "02ff7ae11a3348839780d12d801af0de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b05ee36b7774a1eadc6845e792fbbb9" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 37193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "984a95e37bed43babed18a396dca0a5d" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 41055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02ff7ae11a3348839780d12d801af0de" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33045 } health_report { overall_health: HEALTHY } } }
I20260812 17:46:25.060742 14466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:25.056688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48158 (local address 127.17.255.1:33045)
0812 17:46:25.057036 (+ 348us) server_negotiation.cc:206] Beginning negotiation
0812 17:46:25.057045 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 17:46:25.057056 (+ 11us) server_negotiation.cc:407] Connection header received
0812 17:46:25.057141 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:46:25.057144 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:46:25.057201 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:46:25.057344 (+ 143us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:46:25.057611 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:25.058168 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:25.059122 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:25.059350 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:25.059485 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:46:25.059826 (+ 341us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:46:25.060309 (+ 483us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:46:25.060462 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0812 17:46:25.060500 (+ 38us) server_negotiation.cc:299] Negotiation successful
0812 17:46:25.060561 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":258,"thread_start_us":117,"threads_started":1}
I20260812 17:46:25.065145 14336 raft_consensus.cc:1261] T d9a5a610f45c456a98ef62297db4926d P 6b05ee36b7774a1eadc6845e792fbbb9 [term 1 FOLLOWER]: Refusing update from remote peer 02ff7ae11a3348839780d12d801af0de: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:46:25.065142 14091 raft_consensus.cc:1261] T d9a5a610f45c456a98ef62297db4926d P 984a95e37bed43babed18a396dca0a5d [term 1 FOLLOWER]: Refusing update from remote peer 02ff7ae11a3348839780d12d801af0de: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:46:25.065936 13924 consensus_queue.cc:1035] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b05ee36b7774a1eadc6845e792fbbb9" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 37193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:46:25.066215 14462 consensus_queue.cc:1035] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [LEADER]: Connected to new peer: Peer: permanent_uuid: "984a95e37bed43babed18a396dca0a5d" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 41055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:46:25.072337 14468 mvcc.cc:205] Tried to move back new op lower bound from 7317736591619682304 to 7317736591223762944. Current Snapshot: MvccSnapshot[applied={T|T < 7317736591619682304}]
I20260812 17:46:25.072784 14469 mvcc.cc:205] Tried to move back new op lower bound from 7317736591619682304 to 7317736591223762944. Current Snapshot: MvccSnapshot[applied={T|T < 7317736591619682304}]
I20260812 17:46:25.076031 14475 mvcc.cc:205] Tried to move back new op lower bound from 7317736591619682304 to 7317736591223762944. Current Snapshot: MvccSnapshot[applied={T|T < 7317736591619682304}]
I20260812 17:46:25.083637 13583 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44936:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:46:25.083881 13583 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44936:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:46:25.086820 13583 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289: Sending DeleteTablet for 3 replicas of tablet d9a5a610f45c456a98ef62297db4926d
I20260812 17:46:25.087648 13808 tablet_service.cc:1514] Processing DeleteTablet for tablet d9a5a610f45c456a98ef62297db4926d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:46:25 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:48146
I20260812 17:46:25.087684 14036 tablet_service.cc:1514] Processing DeleteTablet for tablet d9a5a610f45c456a98ef62297db4926d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:46:25 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:60312
I20260812 17:46:25.087765 14305 tablet_service.cc:1514] Processing DeleteTablet for tablet d9a5a610f45c456a98ef62297db4926d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:46:25 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:44198
I20260812 17:46:25.088119 14492 tablet_replica.cc:330] T d9a5a610f45c456a98ef62297db4926d P 984a95e37bed43babed18a396dca0a5d: stopping tablet replica
I20260812 17:46:25.088286 14492 raft_consensus.cc:2229] T d9a5a610f45c456a98ef62297db4926d P 984a95e37bed43babed18a396dca0a5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:46:25.088464 14492 raft_consensus.cc:2258] T d9a5a610f45c456a98ef62297db4926d P 984a95e37bed43babed18a396dca0a5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:46:25.088573 14496 tablet_replica.cc:330] T d9a5a610f45c456a98ef62297db4926d P 6b05ee36b7774a1eadc6845e792fbbb9: stopping tablet replica
I20260812 17:46:25.088747 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 13665
I20260812 17:46:25.088901 14495 tablet_replica.cc:330] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de: stopping tablet replica
I20260812 17:46:25.089048 14495 raft_consensus.cc:2229] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [term 1 LEADER]: Raft consensus shutting down.
I20260812 17:46:25.089622 14492 ts_tablet_manager.cc:1905] T d9a5a610f45c456a98ef62297db4926d P 984a95e37bed43babed18a396dca0a5d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:46:25.091918 14492 ts_tablet_manager.cc:1918] T d9a5a610f45c456a98ef62297db4926d P 984a95e37bed43babed18a396dca0a5d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 17:46:25.092012 14492 log.cc:1196] T d9a5a610f45c456a98ef62297db4926d P 984a95e37bed43babed18a396dca0a5d: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/wal/wals/d9a5a610f45c456a98ef62297db4926d
I20260812 17:46:25.092298 14492 ts_tablet_manager.cc:1939] T d9a5a610f45c456a98ef62297db4926d P 984a95e37bed43babed18a396dca0a5d: Deleting consensus metadata
I20260812 17:46:25.092304 14496 raft_consensus.cc:2229] T d9a5a610f45c456a98ef62297db4926d P 6b05ee36b7774a1eadc6845e792fbbb9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:46:25.092700 14496 raft_consensus.cc:2258] T d9a5a610f45c456a98ef62297db4926d P 6b05ee36b7774a1eadc6845e792fbbb9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:46:25.103372 13556 catalog_manager.cc:4841] TS 984a95e37bed43babed18a396dca0a5d (127.17.255.2:41055): tablet d9a5a610f45c456a98ef62297db4926d (table test-table [id=40791c80b55044af99737b5eeba69f6c]) successfully deleted
I20260812 17:46:25.103946 14496 ts_tablet_manager.cc:1905] T d9a5a610f45c456a98ef62297db4926d P 6b05ee36b7774a1eadc6845e792fbbb9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:46:25.107900 14496 ts_tablet_manager.cc:1918] T d9a5a610f45c456a98ef62297db4926d P 6b05ee36b7774a1eadc6845e792fbbb9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 17:46:25.108036 14496 log.cc:1196] T d9a5a610f45c456a98ef62297db4926d P 6b05ee36b7774a1eadc6845e792fbbb9: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/wal/wals/d9a5a610f45c456a98ef62297db4926d
I20260812 17:46:25.108430 14496 ts_tablet_manager.cc:1939] T d9a5a610f45c456a98ef62297db4926d P 6b05ee36b7774a1eadc6845e792fbbb9: Deleting consensus metadata
I20260812 17:46:25.110116 13553 catalog_manager.cc:4841] TS 6b05ee36b7774a1eadc6845e792fbbb9 (127.17.255.3:37193): tablet d9a5a610f45c456a98ef62297db4926d (table test-table [id=40791c80b55044af99737b5eeba69f6c]) successfully deleted
W20260812 17:46:25.110795 13556 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.255.1:33045 (error 108)
I20260812 17:46:25.111215 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 13923
I20260812 17:46:25.115263 14500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:25.114831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:33045 (local address 127.0.0.1:48168)
0812 17:46:25.115083 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:25.115169 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.1:33045: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":89,"threads_started":1}
W20260812 17:46:25.115449 13556 catalog_manager.cc:4584] TS 02ff7ae11a3348839780d12d801af0de (127.17.255.1:33045): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d9a5a610f45c456a98ef62297db4926d: Network error: Client connection negotiation failed: client connection to 127.17.255.1:33045: connect: Connection refused (error 111)
I20260812 17:46:25.121456 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 14188
I20260812 17:46:25.140488 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 13516
I20260812 17:46:45.163467 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:34829
--webserver_interface=127.17.255.62
--webserver_port=34953
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:38455
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:34829
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:46:45.284833 14502 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:46:45.285190 14502 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:46:45.285238 14502 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:46:45.289821 14502 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 17:46:45.289923 14502 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 17:46:45.289942 14502 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 17:46:45.289956 14502 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:46:45.289978 14502 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:46:45.289997 14502 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:46:45.290014 14502 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:46:45.290030 14502 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:46:45.296124 14502 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:38455
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:34829
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:34829
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=34953
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14502
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:46:45.297372 14502 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:46:45.298506 14502 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:46:45.308269 14510 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:46:45.308272 14513 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:46:45.308288 14511 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:46:45.308663 14502 server_base.cc:1034] running on GCE node
I20260812 17:46:45.309324 14502 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:46:45.310734 14502 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:46:45.311930 14502 hybrid_clock.cc:648] HybridClock initialized: now 1786556805311889 us; error 47 us; skew 500 ppm
Aug 12 17:46:45 dist-test-slave-tk9z krb5kdc[12508](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556805, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:46:45.315109 14502 init.cc:377] Logged in from keytab as kudu/127.17.255.62@KRBTEST.COM (short username kudu)
I20260812 17:46:45.316246 14502 webserver.cc:460] Webserver started at http://127.17.255.62:34953/ using document root <none> and password file <none>
I20260812 17:46:45.316896 14502 fs_manager.cc:359] Metadata directory not provided
I20260812 17:46:45.316974 14502 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:46:45.321336 14502 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260812 17:46:45.324050 14521 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:46:45.325582 14502 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 17:46:45.325755 14502 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "ba73241e720441cb8621a47ee30d8289"
format_stamp: "Formatted at 2026-08-12 17:46:02 on dist-test-slave-tk9z"
server_key: "84ac12452f5e32644bcd7fdb08eedcb4"
server_key_iv: "23fa21a9a7f5204a8e55becf9dfa8bcc"
server_key_version: "encryptionkey@0"
I20260812 17:46:45.326380 14502 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:46:45.352737 14502 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:46:45.356410 14502 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:46:45.356650 14502 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:46:45.364951 14502 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:34829
I20260812 17:46:45.365283 14631 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:34829 every 8 connection(s)
I20260812 17:46:45.366166 14502 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:46:45.371291 14633 sys_catalog.cc:263] Verifying existing consensus state
I20260812 17:46:45.372452 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 14502
I20260812 17:46:45.372925 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.1:33045
--local_ip_for_outbound_sockets=127.17.255.1
--tserver_master_addrs=127.17.255.62:34829
--webserver_port=35947
--webserver_interface=127.17.255.1
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:38455
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 17:46:45.373446 14633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289: Bootstrap starting.
I20260812 17:46:45.394057 14633 log.cc:824] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289: Log is configured to *not* fsync() on all Append() calls
I20260812 17:46:45.407063 14633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 17:46:45.407528 14633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289: Bootstrap complete.
I20260812 17:46:45.412068 14633 raft_consensus.cc:348] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba73241e720441cb8621a47ee30d8289" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 34829 } }
I20260812 17:46:45.412523 14633 raft_consensus.cc:729] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba73241e720441cb8621a47ee30d8289, State: Initialized, Role: FOLLOWER
I20260812 17:46:45.413117 14633 consensus_queue.cc:260] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba73241e720441cb8621a47ee30d8289" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 34829 } }
I20260812 17:46:45.413285 14633 raft_consensus.cc:388] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:46:45.413375 14633 raft_consensus.cc:482] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:46:45.413504 14633 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [term 2 FOLLOWER]: Advancing to term 3
I20260812 17:46:45.415675 14633 raft_consensus.cc:504] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba73241e720441cb8621a47ee30d8289" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 34829 } }
I20260812 17:46:45.416056 14633 leader_election.cc:302] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ba73241e720441cb8621a47ee30d8289; no voters:
I20260812 17:46:45.416472 14633 leader_election.cc:288] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260812 17:46:45.416546 14643 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 17:46:45.416792 14643 raft_consensus.cc:686] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [term 3 LEADER]: Becoming Leader. State: Replica: ba73241e720441cb8621a47ee30d8289, State: Running, Role: LEADER
I20260812 17:46:45.417119 14643 consensus_queue.cc:237] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba73241e720441cb8621a47ee30d8289" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 34829 } }
I20260812 17:46:45.417899 14633 sys_catalog.cc:564] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:46:45.418711 14645 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ba73241e720441cb8621a47ee30d8289. Latest consensus state: current_term: 3 leader_uuid: "ba73241e720441cb8621a47ee30d8289" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba73241e720441cb8621a47ee30d8289" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 34829 } } }
I20260812 17:46:45.418879 14645 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [sys.catalog]: This master's current role is: LEADER
I20260812 17:46:45.419314 14646 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "ba73241e720441cb8621a47ee30d8289" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba73241e720441cb8621a47ee30d8289" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 34829 } } }
I20260812 17:46:45.419481 14646 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289 [sys.catalog]: This master's current role is: LEADER
I20260812 17:46:45.419803 14657 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:46:45.425683 14657 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:46:45.426359 14657 catalog_manager.cc:1259] Loaded cluster ID: ff844b8d8c844a2db744eb9428b5b5db
I20260812 17:46:45.426450 14657 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:46:45.429071 14657 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:46:45.429840 14657 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289: Loaded TSK: 0
I20260812 17:46:45.429929 14657 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ba73241e720441cb8621a47ee30d8289: Loaded TSK: 1
F20260812 17:46:45.430881 14657 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fe67337d9ad google::LogMessage::Fail() at ??:0
@ 0x7fe67338088a google::LogMessage::SendToLog() at ??:0
@ 0x7fe67337d4de google::LogMessage::Flush() at ??:0
@ 0x7fe67337ea19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fe67604118d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fe676039f0d kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fe67dce67bb kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fe67dcc099c kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fe67dcc1178 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlvE3_clEv at ??:0
@ 0x7fe67dd02df8 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7fe67dd2182b std::function<>::operator()() at ??:0
@ 0x7fe67dcc0b4f _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7fe67dcc1f3e kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fe67dcbe579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7fe67dd02640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fe6755cf3d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fe6755cfc83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7fe6755d13f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fe6755c0512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fe676c046db start_thread at ??:0
@ 0x7fe671e7b61f clone at ??:0
W20260812 17:46:45.519315 14639 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:46:45.519614 14639 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:46:45.519661 14639 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:46:45.524125 14639 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:46:45.524178 14639 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:46:45.524240 14639 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.1
I20260812 17:46:45.530113 14639 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:38455
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.1:33045
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.255.1
--webserver_port=35947
--tserver_master_addrs=127.17.255.62:34829
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14639
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.1
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:46:45.531401 14639 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:46:45.532425 14639 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:46:45.543197 14733 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:46:45.543155 14727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:46:45.543409 14639 server_base.cc:1034] running on GCE node
W20260812 17:46:45.543176 14726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:46:45.544057 14639 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:46:45.544764 14639 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:46:45.545986 14639 hybrid_clock.cc:648] HybridClock initialized: now 1786556805545952 us; error 55 us; skew 500 ppm
Aug 12 17:46:45 dist-test-slave-tk9z krb5kdc[12508](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556805, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:46:45.549057 14639 init.cc:377] Logged in from keytab as kudu/127.17.255.1@KRBTEST.COM (short username kudu)
I20260812 17:46:45.550141 14639 webserver.cc:460] Webserver started at http://127.17.255.1:35947/ using document root <none> and password file <none>
I20260812 17:46:45.550887 14639 fs_manager.cc:359] Metadata directory not provided
I20260812 17:46:45.550959 14639 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:46:45.555328 14639 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 17:46:45.557821 14749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:46:45.559306 14639 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:46:45.559444 14639 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/wal
uuid: "02ff7ae11a3348839780d12d801af0de"
format_stamp: "Formatted at 2026-08-12 17:46:02 on dist-test-slave-tk9z"
server_key: "e4e68c3dee78aa2d3ffaf27b1e4f18e0"
server_key_iv: "65704cd40fe9d2e5325786198c55d212"
server_key_version: "encryptionkey@0"
I20260812 17:46:45.560061 14639 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:46:45.576524 14639 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:46:45.580521 14639 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:46:45.580767 14639 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:46:45.581578 14639 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:46:45.582913 14770 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 17:46:45.587370 14639 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 17:46:45.587440 14639 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260812 17:46:45.587494 14639 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 17:46:45.589319 14639 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 17:46:45.589387 14639 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260812 17:46:45.589681 14770 tablet_bootstrap.cc:492] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de: Bootstrap starting.
I20260812 17:46:45.601262 14639 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.1:33045
I20260812 17:46:45.601668 14959 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.1:33045 every 8 connection(s)
I20260812 17:46:45.602757 14639 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
I20260812 17:46:45.611917 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 14639
I20260812 17:46:45.612265 14770 log.cc:824] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de: Log is configured to *not* fsync() on all Append() calls
I20260812 17:46:45.612501 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.2:41055
--local_ip_for_outbound_sockets=127.17.255.2
--tserver_master_addrs=127.17.255.62:34829
--webserver_port=36885
--webserver_interface=127.17.255.2
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:38455
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 17:46:45.622740 14770 tablet_bootstrap.cc:492] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 17:46:45.623278 14770 tablet_bootstrap.cc:492] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de: Bootstrap complete.
I20260812 17:46:45.624974 14770 ts_tablet_manager.cc:1397] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de: Time spent bootstrapping tablet: real 0.036s user 0.028s sys 0.004s
I20260812 17:46:45.628906 14770 raft_consensus.cc:348] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b05ee36b7774a1eadc6845e792fbbb9" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 37193 } } peers { permanent_uuid: "984a95e37bed43babed18a396dca0a5d" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 41055 } } peers { permanent_uuid: "02ff7ae11a3348839780d12d801af0de" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33045 } }
I20260812 17:46:45.629549 14770 raft_consensus.cc:729] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02ff7ae11a3348839780d12d801af0de, State: Initialized, Role: FOLLOWER
I20260812 17:46:45.630362 14770 consensus_queue.cc:260] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b05ee36b7774a1eadc6845e792fbbb9" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 37193 } } peers { permanent_uuid: "984a95e37bed43babed18a396dca0a5d" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 41055 } } peers { permanent_uuid: "02ff7ae11a3348839780d12d801af0de" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33045 } }
I20260812 17:46:45.631726 14770 ts_tablet_manager.cc:1428] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
W20260812 17:46:45.687323 14966 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:46:45.605380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.1:53883)
0812 17:46:45.606047 (+ 667us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:45.606108 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0812 17:46:45.607206 (+ 1098us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:46:45.686482 (+ 79276us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":179,"threads_started":1}
W20260812 17:46:45.687914 14961 heartbeater.cc:644] Failed to heartbeat to 127.17.255.62:34829 (0 consecutive failures): Network error: Failed to ping master at 127.17.255.62:34829: Client connection negotiation failed: client connection to 127.17.255.62:34829: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 17:46:45.688791 14966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:45.688515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.1:51805)
0812 17:46:45.688657 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:45.688726 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260812 17:46:45.689530 14966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:45.689286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.1:41133)
0812 17:46:45.689399 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:45.689456 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260812 17:46:45.689728 14961 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 17:46:45.747080 14970 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:46:45.747428 14970 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:46:45.747519 14970 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:46:45.752359 14970 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:46:45.752472 14970 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:46:45.752570 14970 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.2
I20260812 17:46:45.758306 14970 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:38455
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.2:41055
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.255.2
--webserver_port=36885
--tserver_master_addrs=127.17.255.62:34829
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14970
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.2
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:46:45.759591 14970 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:46:45.760793 14970 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:46:45.771250 14983 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:46:45.771241 14981 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:46:45.771395 14970 server_base.cc:1034] running on GCE node
W20260812 17:46:45.771227 14986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:46:45.771976 14970 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:46:45.772720 14970 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:46:45.773959 14970 hybrid_clock.cc:648] HybridClock initialized: now 1786556805773925 us; error 56 us; skew 500 ppm
Aug 12 17:46:45 dist-test-slave-tk9z krb5kdc[12508](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556805, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:46:45.777055 14970 init.cc:377] Logged in from keytab as kudu/127.17.255.2@KRBTEST.COM (short username kudu)
I20260812 17:46:45.778234 14970 webserver.cc:460] Webserver started at http://127.17.255.2:36885/ using document root <none> and password file <none>
I20260812 17:46:45.778931 14970 fs_manager.cc:359] Metadata directory not provided
I20260812 17:46:45.779042 14970 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:46:45.783311 14970 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 17:46:45.785724 14997 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:46:45.787272 14970 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 17:46:45.787448 14970 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/wal
uuid: "984a95e37bed43babed18a396dca0a5d"
format_stamp: "Formatted at 2026-08-12 17:46:03 on dist-test-slave-tk9z"
server_key: "97214328b4fa8085502c521d2da319c2"
server_key_iv: "9f8b546908f41a7ba4c3600f3003853e"
server_key_version: "encryptionkey@0"
I20260812 17:46:45.788110 14970 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:46:45.817768 14970 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:46:45.821301 14970 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:46:45.821571 14970 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:46:45.822249 14970 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:46:45.823231 14970 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:46:45.823308 14970 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:46:45.823379 14970 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:46:45.823422 14970 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:46:45.833357 14970 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.2:41055
I20260812 17:46:45.833403 15214 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.2:41055 every 8 connection(s)
I20260812 17:46:45.834546 14970 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
I20260812 17:46:45.838658 15220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:45.836868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.2:40173)
0812 17:46:45.837647 (+ 779us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:45.837772 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":123,"threads_started":1}
W20260812 17:46:45.839277 15215 heartbeater.cc:644] Failed to heartbeat to 127.17.255.62:34829 (0 consecutive failures): Network error: Failed to ping master at 127.17.255.62:34829: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
I20260812 17:46:45.839962 15220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:45.839687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.2:46661)
0812 17:46:45.839844 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:45.839900 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260812 17:46:45.840682 15220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:45.840449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.2:50769)
0812 17:46:45.840580 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:45.840629 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260812 17:46:45.840931 15215 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 17:46:45.842150 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 14970
I20260812 17:46:45.842651 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.3:37193
--local_ip_for_outbound_sockets=127.17.255.3
--tserver_master_addrs=127.17.255.62:34829
--webserver_port=36289
--webserver_interface=127.17.255.3
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:38455
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:46:45.964318 15222 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:46:45.964650 15222 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:46:45.964694 15222 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:46:45.968745 15222 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:46:45.968799 15222 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:46:45.968858 15222 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.3
I20260812 17:46:45.974104 15222 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:38455
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.3:37193
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.255.3
--webserver_port=36289
--tserver_master_addrs=127.17.255.62:34829
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15222
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.3
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:46:45.975320 15222 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:46:45.976421 15222 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:46:45.986848 15233 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:46:45.986858 15238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:46:45.986876 15234 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:46:45.987257 15222 server_base.cc:1034] running on GCE node
I20260812 17:46:45.987826 15222 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:46:45.988566 15222 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:46:45.989775 15222 hybrid_clock.cc:648] HybridClock initialized: now 1786556805989736 us; error 52 us; skew 500 ppm
Aug 12 17:46:45 dist-test-slave-tk9z krb5kdc[12508](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556805, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:46:45.992872 15222 init.cc:377] Logged in from keytab as kudu/127.17.255.3@KRBTEST.COM (short username kudu)
I20260812 17:46:45.993932 15222 webserver.cc:460] Webserver started at http://127.17.255.3:36289/ using document root <none> and password file <none>
I20260812 17:46:45.994642 15222 fs_manager.cc:359] Metadata directory not provided
I20260812 17:46:45.994745 15222 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:46:45.999203 15222 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260812 17:46:46.001652 15249 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:46:46.003288 15222 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 17:46:46.003476 15222 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/wal
uuid: "6b05ee36b7774a1eadc6845e792fbbb9"
format_stamp: "Formatted at 2026-08-12 17:46:03 on dist-test-slave-tk9z"
server_key: "67c484eeea3966f3f91f8098cb888f47"
server_key_iv: "24eea2671fe2ec9f66b07f125f65424d"
server_key_version: "encryptionkey@0"
I20260812 17:46:46.004173 15222 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:46:46.023110 15222 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:46:46.026891 15222 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:46:46.027132 15222 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:46:46.027823 15222 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:46:46.028756 15222 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:46:46.028831 15222 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:46:46.028919 15222 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:46:46.028973 15222 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:46:46.038882 15222 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.3:37193
I20260812 17:46:46.038897 15473 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.3:37193 every 8 connection(s)
I20260812 17:46:46.040041 15222 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
I20260812 17:46:46.041169 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 15222
I20260812 17:46:46.044612 15483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:46.042613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.3:50547)
0812 17:46:46.043122 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:46.043236 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":120,"threads_started":1}
W20260812 17:46:46.045135 15476 heartbeater.cc:644] Failed to heartbeat to 127.17.255.62:34829 (0 consecutive failures): Network error: Failed to ping master at 127.17.255.62:34829: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
I20260812 17:46:46.045804 15483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:46.045551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.3:43269)
0812 17:46:46.045683 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:46.045740 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260812 17:46:46.046576 15483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:46.046288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.3:38589)
0812 17:46:46.046478 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:46.046524 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260812 17:46:46.046830 15476 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 17:46:46.691138 15484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:46.690586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.1:35105)
0812 17:46:46.690893 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:46.690972 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":110,"threads_started":1}
I20260812 17:46:46.842026 15488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:46.841517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.2:52667)
0812 17:46:46.841829 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:46.841892 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":84,"threads_started":1}
I20260812 17:46:47.047808 15489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:47.047390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.3:46657)
0812 17:46:47.047649 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:47.047705 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":82,"threads_started":1}
I20260812 17:46:47.276968 15490 raft_consensus.cc:482] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:46:47.277223 15490 raft_consensus.cc:504] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b05ee36b7774a1eadc6845e792fbbb9" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 37193 } } peers { permanent_uuid: "984a95e37bed43babed18a396dca0a5d" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 41055 } } peers { permanent_uuid: "02ff7ae11a3348839780d12d801af0de" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33045 } }
I20260812 17:46:47.278594 15490 leader_election.cc:288] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b05ee36b7774a1eadc6845e792fbbb9 (127.17.255.3:37193), 984a95e37bed43babed18a396dca0a5d (127.17.255.2:41055)
Aug 12 17:46:47 dist-test-slave-tk9z krb5kdc[12508](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556805, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for kudu/127.17.255.2@KRBTEST.COM
Aug 12 17:46:47 dist-test-slave-tk9z krb5kdc[12508](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556805, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for kudu/127.17.255.3@KRBTEST.COM
I20260812 17:46:47.293633 15491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:47.278917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:41055 (local address 127.17.255.1:57693)
0812 17:46:47.279434 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:47.279448 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 17:46:47.279548 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:46:47.281204 (+ 1656us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:46:47.281210 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:46:47.281748 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:46:47.282267 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:46:47.282283 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:46:47.283717 (+ 1434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:46:47.283720 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:46:47.284659 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:46:47.284669 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:46:47.285456 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:46:47.285459 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:46:47.285626 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:46:47.286326 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:46:47.286343 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:46:47.288111 (+ 1768us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:46:47.290659 (+ 2548us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:46:47.290666 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:46:47.290681 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:46:47.290956 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:46:47.291398 (+ 442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:46:47.291402 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:46:47.291404 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:46:47.291644 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:46:47.292541 (+ 897us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:46:47.292549 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:46:47.292799 (+ 250us) client_negotiation.cc:769] Sending connection context
0812 17:46:47.293017 (+ 218us) client_negotiation.cc:240] Negotiation successful
0812 17:46:47.293418 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":436,"mutex_wait_us":201,"spinlock_wait_cycles":11904,"thread_start_us":77,"threads_started":1}
I20260812 17:46:47.293634 15495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:47.278823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.3:37193 (local address 127.17.255.1:41905)
0812 17:46:47.279193 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:47.279211 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 17:46:47.279347 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:46:47.281204 (+ 1857us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:46:47.281210 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:46:47.281754 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:46:47.282267 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:46:47.282284 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:46:47.283636 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:46:47.283643 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:46:47.284653 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:46:47.284663 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:46:47.285410 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:46:47.285414 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:46:47.285613 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:46:47.286447 (+ 834us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:46:47.286463 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:46:47.288560 (+ 2097us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:46:47.291379 (+ 2819us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:46:47.291382 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:46:47.291385 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:46:47.291633 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:46:47.291994 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:46:47.291998 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:46:47.291999 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:46:47.292091 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:46:47.292922 (+ 831us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:46:47.292925 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:46:47.293022 (+ 97us) client_negotiation.cc:769] Sending connection context
0812 17:46:47.293121 (+ 99us) client_negotiation.cc:240] Negotiation successful
0812 17:46:47.293475 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"mutex_wait_us":235,"spinlock_wait_cycles":13696,"thread_start_us":92,"threads_started":1}
I20260812 17:46:47.293732 15497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:47.279014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:41905 (local address 127.17.255.3:37193)
0812 17:46:47.279365 (+ 351us) server_negotiation.cc:206] Beginning negotiation
0812 17:46:47.279396 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0812 17:46:47.279448 (+ 52us) server_negotiation.cc:407] Connection header received
0812 17:46:47.280431 (+ 983us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:46:47.280439 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:46:47.280803 (+ 364us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:46:47.281055 (+ 252us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:46:47.282482 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:47.283479 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:47.284801 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:47.285273 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:47.285457 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:46:47.288787 (+ 3330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:46:47.288798 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:46:47.288816 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:46:47.288856 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:46:47.291180 (+ 2324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:46:47.291750 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:46:47.291760 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:46:47.291768 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:46:47.291911 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:46:47.292186 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:46:47.292188 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:46:47.292189 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:46:47.292809 (+ 620us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:46:47.292919 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0812 17:46:47.293280 (+ 361us) server_negotiation.cc:299] Negotiation successful
0812 17:46:47.293532 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":80,"threads_started":1}
I20260812 17:46:47.294438 15498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:47.279115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:57693 (local address 127.17.255.2:41055)
0812 17:46:47.279602 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0812 17:46:47.279628 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0812 17:46:47.279672 (+ 44us) server_negotiation.cc:407] Connection header received
0812 17:46:47.280555 (+ 883us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:46:47.280563 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:46:47.280881 (+ 318us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:46:47.281206 (+ 325us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:46:47.282489 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:47.283521 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:47.284829 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:46:47.285304 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:46:47.285505 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:46:47.288364 (+ 2859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:46:47.288372 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:46:47.288388 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:46:47.288425 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:46:47.290530 (+ 2105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:46:47.291122 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:46:47.291130 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:46:47.291136 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:46:47.291297 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:46:47.291769 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:46:47.291772 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:46:47.291773 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:46:47.292393 (+ 620us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:46:47.292590 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0812 17:46:47.293161 (+ 571us) server_negotiation.cc:299] Negotiation successful
0812 17:46:47.293521 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":119,"threads_started":1}
W20260812 17:46:47.296723 14757 leader_election.cc:341] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 984a95e37bed43babed18a396dca0a5d (127.17.255.2:41055): Not found: Tablet not found: d9a5a610f45c456a98ef62297db4926d
W20260812 17:46:47.296880 14754 leader_election.cc:341] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6b05ee36b7774a1eadc6845e792fbbb9 (127.17.255.3:37193): Not found: Tablet not found: d9a5a610f45c456a98ef62297db4926d
I20260812 17:46:47.297035 14754 leader_election.cc:302] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02ff7ae11a3348839780d12d801af0de; no voters: 6b05ee36b7774a1eadc6845e792fbbb9, 984a95e37bed43babed18a396dca0a5d
I20260812 17:46:47.297381 15490 raft_consensus.cc:2726] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 17:46:47.692540 15495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:47.692169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.1:38325)
0812 17:46:47.692334 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:47.692415 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260812 17:46:47.843364 15499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:47.842914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.2:33403)
0812 17:46:47.843188 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:47.843249 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":79,"threads_started":1}
I20260812 17:46:48.049021 15501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:48.048582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.3:47265)
0812 17:46:48.048857 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:48.048917 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":75,"threads_started":1}
I20260812 17:46:48.693845 15502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:48.693375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.1:50755)
0812 17:46:48.693659 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:48.693721 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":82,"threads_started":1}
I20260812 17:46:48.844712 15503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:48.844247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.2:42587)
0812 17:46:48.844535 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:48.844608 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":79,"threads_started":1}
I20260812 17:46:49.050486 15504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:49.049909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.3:53367)
0812 17:46:49.050233 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:49.050313 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":107,"threads_started":1}
I20260812 17:46:49.364313 15507 raft_consensus.cc:482] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:46:49.364464 15507 raft_consensus.cc:504] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b05ee36b7774a1eadc6845e792fbbb9" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 37193 } } peers { permanent_uuid: "984a95e37bed43babed18a396dca0a5d" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 41055 } } peers { permanent_uuid: "02ff7ae11a3348839780d12d801af0de" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33045 } }
I20260812 17:46:49.365056 15507 leader_election.cc:288] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b05ee36b7774a1eadc6845e792fbbb9 (127.17.255.3:37193), 984a95e37bed43babed18a396dca0a5d (127.17.255.2:41055)
W20260812 17:46:49.366055 14754 leader_election.cc:341] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6b05ee36b7774a1eadc6845e792fbbb9 (127.17.255.3:37193): Not found: Tablet not found: d9a5a610f45c456a98ef62297db4926d
W20260812 17:46:49.366217 14757 leader_election.cc:341] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 984a95e37bed43babed18a396dca0a5d (127.17.255.2:41055): Not found: Tablet not found: d9a5a610f45c456a98ef62297db4926d
I20260812 17:46:49.366308 14757 leader_election.cc:302] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02ff7ae11a3348839780d12d801af0de; no voters: 6b05ee36b7774a1eadc6845e792fbbb9, 984a95e37bed43babed18a396dca0a5d
I20260812 17:46:49.366516 15507 raft_consensus.cc:2726] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 17:46:49.695243 15508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:49.694779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.1:38465)
0812 17:46:49.695064 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:49.695125 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":101,"threads_started":1}
I20260812 17:46:49.846206 15512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:49.845704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.2:51001)
0812 17:46:49.846039 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:49.846106 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":86,"threads_started":1}
I20260812 17:46:50.051793 15513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:50.051316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.3:55593)
0812 17:46:50.051633 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:50.051696 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":81,"threads_started":1}
I20260812 17:46:50.696731 15514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:50.696220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.1:56063)
0812 17:46:50.696576 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:50.696633 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":84,"threads_started":1}
I20260812 17:46:50.847757 15515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:50.847205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.2:36455)
0812 17:46:50.847568 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:50.847640 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":119,"threads_started":1}
I20260812 17:46:51.053013 15516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:51.052578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.3:42107)
0812 17:46:51.052838 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:51.052888 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":95,"threads_started":1}
I20260812 17:46:51.071594 15519 raft_consensus.cc:482] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:46:51.071730 15519 raft_consensus.cc:504] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b05ee36b7774a1eadc6845e792fbbb9" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 37193 } } peers { permanent_uuid: "984a95e37bed43babed18a396dca0a5d" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 41055 } } peers { permanent_uuid: "02ff7ae11a3348839780d12d801af0de" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33045 } }
I20260812 17:46:51.072145 15519 leader_election.cc:288] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b05ee36b7774a1eadc6845e792fbbb9 (127.17.255.3:37193), 984a95e37bed43babed18a396dca0a5d (127.17.255.2:41055)
W20260812 17:46:51.072968 14754 leader_election.cc:341] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6b05ee36b7774a1eadc6845e792fbbb9 (127.17.255.3:37193): Not found: Tablet not found: d9a5a610f45c456a98ef62297db4926d
W20260812 17:46:51.073101 14757 leader_election.cc:341] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 984a95e37bed43babed18a396dca0a5d (127.17.255.2:41055): Not found: Tablet not found: d9a5a610f45c456a98ef62297db4926d
I20260812 17:46:51.073173 14757 leader_election.cc:302] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02ff7ae11a3348839780d12d801af0de; no voters: 6b05ee36b7774a1eadc6845e792fbbb9, 984a95e37bed43babed18a396dca0a5d
I20260812 17:46:51.073359 15519 raft_consensus.cc:2726] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 17:46:51.698123 15520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:51.697636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.1:58829)
0812 17:46:51.697953 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:51.698017 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":80,"threads_started":1}
I20260812 17:46:51.849089 15521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:51.848638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.2:47169)
0812 17:46:51.848927 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:51.848987 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":78,"threads_started":1}
I20260812 17:46:52.054579 15523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:52.053933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.3:49075)
0812 17:46:52.054312 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:52.054467 (+ 155us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":109,"threads_started":1}
I20260812 17:46:52.699432 15526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:52.698963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.1:43213)
0812 17:46:52.699267 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:52.699333 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":95,"threads_started":1}
I20260812 17:46:52.850648 15527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:52.850010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.2:33927)
0812 17:46:52.850406 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:52.850505 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":82,"threads_started":1}
I20260812 17:46:53.056020 15531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:53.055429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.3:39625)
0812 17:46:53.055841 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:53.055909 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":84,"threads_started":1}
I20260812 17:46:53.590190 15533 raft_consensus.cc:482] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:46:53.590425 15533 raft_consensus.cc:504] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b05ee36b7774a1eadc6845e792fbbb9" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 37193 } } peers { permanent_uuid: "984a95e37bed43babed18a396dca0a5d" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 41055 } } peers { permanent_uuid: "02ff7ae11a3348839780d12d801af0de" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33045 } }
I20260812 17:46:53.590940 15533 leader_election.cc:288] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b05ee36b7774a1eadc6845e792fbbb9 (127.17.255.3:37193), 984a95e37bed43babed18a396dca0a5d (127.17.255.2:41055)
W20260812 17:46:53.591867 14757 leader_election.cc:341] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 984a95e37bed43babed18a396dca0a5d (127.17.255.2:41055): Not found: Tablet not found: d9a5a610f45c456a98ef62297db4926d
W20260812 17:46:53.591979 14754 leader_election.cc:341] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6b05ee36b7774a1eadc6845e792fbbb9 (127.17.255.3:37193): Not found: Tablet not found: d9a5a610f45c456a98ef62297db4926d
I20260812 17:46:53.592074 14754 leader_election.cc:302] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02ff7ae11a3348839780d12d801af0de; no voters: 6b05ee36b7774a1eadc6845e792fbbb9, 984a95e37bed43babed18a396dca0a5d
I20260812 17:46:53.592234 15533 raft_consensus.cc:2726] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 17:46:53.700706 15540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:53.700276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.1:44633)
0812 17:46:53.700550 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:53.700606 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":88,"threads_started":1}
I20260812 17:46:53.852034 15541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:53.851561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.2:51635)
0812 17:46:53.851855 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:53.851916 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":87,"threads_started":1}
I20260812 17:46:54.057554 15542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:54.057074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.3:45295)
0812 17:46:54.057392 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:54.057452 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":102,"threads_started":1}
I20260812 17:46:54.702101 15549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:54.701572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.1:44409)
0812 17:46:54.701916 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:54.701988 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":92,"threads_started":1}
I20260812 17:46:54.853456 15551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:54.852996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.2:42773)
0812 17:46:54.853283 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:54.853349 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":88,"threads_started":1}
I20260812 17:46:55.058956 15555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:55.058499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.3:44015)
0812 17:46:55.058774 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:55.058852 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":82,"threads_started":1}
I20260812 17:46:55.703629 15557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:55.703171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.1:57851)
0812 17:46:55.703457 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:55.703522 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":81,"threads_started":1}
I20260812 17:46:55.854892 15561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:55.854444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.2:44481)
0812 17:46:55.854727 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:55.854790 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":99,"threads_started":1}
I20260812 17:46:56.060422 15565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:56.059944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.3:44845)
0812 17:46:56.060247 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:56.060313 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":83,"threads_started":1}
I20260812 17:46:56.704949 15566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:56.704496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.1:52217)
0812 17:46:56.704776 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:56.704842 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":83,"threads_started":1}
I20260812 17:46:56.856282 15567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:56.855820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.2:60359)
0812 17:46:56.856123 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:56.856181 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":91,"threads_started":1}
I20260812 17:46:57.061862 15568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:57.061380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.3:51877)
0812 17:46:57.061690 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:57.061757 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":88,"threads_started":1}
I20260812 17:46:57.706306 15569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:57.705790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.1:41789)
0812 17:46:57.706112 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:57.706179 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":83,"threads_started":1}
I20260812 17:46:57.857633 15570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:57.857153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.2:46799)
0812 17:46:57.857438 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:57.857502 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":104,"threads_started":1}
I20260812 17:46:58.063493 15571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:58.062996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.3:34693)
0812 17:46:58.063322 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:58.063389 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":100,"threads_started":1}
I20260812 17:46:58.707720 15574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:58.707265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.1:48449)
0812 17:46:58.707547 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:58.707613 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":94,"threads_started":1}
I20260812 17:46:58.859089 15576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:58.858614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.2:57393)
0812 17:46:58.858900 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:58.858979 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":112,"threads_started":1}
I20260812 17:46:58.941156 15578 raft_consensus.cc:482] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:46:58.941349 15578 raft_consensus.cc:504] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b05ee36b7774a1eadc6845e792fbbb9" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 37193 } } peers { permanent_uuid: "984a95e37bed43babed18a396dca0a5d" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 41055 } } peers { permanent_uuid: "02ff7ae11a3348839780d12d801af0de" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33045 } }
I20260812 17:46:58.941905 15578 leader_election.cc:288] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b05ee36b7774a1eadc6845e792fbbb9 (127.17.255.3:37193), 984a95e37bed43babed18a396dca0a5d (127.17.255.2:41055)
W20260812 17:46:58.942826 14757 leader_election.cc:341] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 984a95e37bed43babed18a396dca0a5d (127.17.255.2:41055): Not found: Tablet not found: d9a5a610f45c456a98ef62297db4926d
W20260812 17:46:58.942929 14754 leader_election.cc:341] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6b05ee36b7774a1eadc6845e792fbbb9 (127.17.255.3:37193): Not found: Tablet not found: d9a5a610f45c456a98ef62297db4926d
I20260812 17:46:58.943058 14754 leader_election.cc:302] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02ff7ae11a3348839780d12d801af0de; no voters: 6b05ee36b7774a1eadc6845e792fbbb9, 984a95e37bed43babed18a396dca0a5d
I20260812 17:46:58.943202 15578 raft_consensus.cc:2726] T d9a5a610f45c456a98ef62297db4926d P 02ff7ae11a3348839780d12d801af0de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 17:46:59.065052 15579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:59.064491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.3:36217)
0812 17:46:59.064880 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:59.064948 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":84,"threads_started":1}
I20260812 17:46:59.709050 15580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:59.708494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.1:49531)
0812 17:46:59.708877 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:59.708948 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":124,"threads_started":1}
I20260812 17:46:59.860441 15581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:46:59.859942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.2:39045)
0812 17:46:59.860239 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0812 17:46:59.860339 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":127,"threads_started":1}
I20260812 17:47:00.066560 15582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:00.065944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.3:54269)
0812 17:47:00.066272 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:00.066343 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":99,"threads_started":1}
I20260812 17:47:00.711093 15584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:00.710187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.1:49491)
0812 17:47:00.710935 (+ 748us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:00.710994 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":670,"thread_start_us":538,"threads_started":1}
I20260812 17:47:00.862133 15588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:00.861569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.2:36055)
0812 17:47:00.861931 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:00.862000 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":104,"threads_started":1}
I20260812 17:47:01.050799 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 14639
I20260812 17:47:01.068296 15590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:01.067744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34829 (local address 127.17.255.3:36047)
0812 17:47:01.068083 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:01.068155 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.62:34829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":91,"threads_started":1}
I20260812 17:47:01.073311 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 14970
I20260812 17:47:01.115494 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 15222
2026-08-12T17:47:01Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (60248 ms)
[----------] 30 tests from SecurityITest (263331 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:47:01 dist-test-slave-tk9z krb5kdc[15594](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:47:01 dist-test-slave-tk9z krb5kdc[15594](info): set up 2 sockets
Aug 12 17:47:01 dist-test-slave-tk9z krb5kdc[15594](info): commencing operation
krb5kdc: starting...
W20260812 17:47:02.458041 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.307s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:47:02 dist-test-slave-tk9z krb5kdc[15594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556822, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:47:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:47:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.255.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
I20260812 17:47:02.594043 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:39209
--webserver_interface=127.17.255.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:42661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:39209
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:47:02.715801 15619 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:02.716112 15619 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:02.716187 15619 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:02.720434 15619 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:47:02.720515 15619 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:02.720536 15619 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:02.720592 15619 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:47:02.720615 15619 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:47:02.726348 15619 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:42661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:39209
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:39209
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15619
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:02.727746 15619 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:02.728996 15619 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:02.738986 15635 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:02.739089 15630 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:02.739089 15629 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:02.739321 15619 server_base.cc:1034] running on GCE node
I20260812 17:47:02.739996 15619 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:02.741276 15619 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:02.742491 15619 hybrid_clock.cc:648] HybridClock initialized: now 1786556822742438 us; error 54 us; skew 500 ppm
Aug 12 17:47:02 dist-test-slave-tk9z krb5kdc[15594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556822, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:47:02.751048 15619 init.cc:377] Logged in from keytab as kudu/127.17.255.62@KRBTEST.COM (short username kudu)
I20260812 17:47:02.752329 15619 webserver.cc:460] Webserver started at http://127.17.255.62:35923/ using document root <none> and password file <none>
I20260812 17:47:02.753058 15619 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:02.753163 15619 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:02.753438 15619 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:02.755852 15619 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "284310f9ea204ac6a5778990f0129c2c"
format_stamp: "Formatted at 2026-08-12 17:47:02 on dist-test-slave-tk9z"
server_key: "b35059399a12e1075b95538073bb4299"
server_key_iv: "17d00cba5613c32000cd64558b6ec26e"
server_key_version: "encryptionkey@0"
I20260812 17:47:02.756508 15619 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "284310f9ea204ac6a5778990f0129c2c"
format_stamp: "Formatted at 2026-08-12 17:47:02 on dist-test-slave-tk9z"
server_key: "b35059399a12e1075b95538073bb4299"
server_key_iv: "17d00cba5613c32000cd64558b6ec26e"
server_key_version: "encryptionkey@0"
I20260812 17:47:02.760924 15619 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 17:47:02.763952 15646 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:02.765586 15619 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 17:47:02.765766 15619 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "284310f9ea204ac6a5778990f0129c2c"
format_stamp: "Formatted at 2026-08-12 17:47:02 on dist-test-slave-tk9z"
server_key: "b35059399a12e1075b95538073bb4299"
server_key_iv: "17d00cba5613c32000cd64558b6ec26e"
server_key_version: "encryptionkey@0"
I20260812 17:47:02.765936 15619 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:02.824156 15619 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:02.828130 15619 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:02.828336 15619 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:02.836341 15619 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:39209
I20260812 17:47:02.836349 15751 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:39209 every 8 connection(s)
I20260812 17:47:02.837442 15619 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:47:02.840617 15758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:02.843236 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 15619
I20260812 17:47:02.843353 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:47:02.843743 18428 external_mini_cluster.cc:1428] Setting key 997a7313b038cb2d71bf79aa599168b3
I20260812 17:47:02.847811 15758 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 284310f9ea204ac6a5778990f0129c2c: Bootstrap starting.
I20260812 17:47:02.850862 15758 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 284310f9ea204ac6a5778990f0129c2c: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:02.851924 15758 log.cc:824] T 00000000000000000000000000000000 P 284310f9ea204ac6a5778990f0129c2c: Log is configured to *not* fsync() on all Append() calls
Aug 12 17:47:02 dist-test-slave-tk9z krb5kdc[15594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556822, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:47:02.854720 15758 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 284310f9ea204ac6a5778990f0129c2c: No bootstrap required, opened a new log
I20260812 17:47:02.859980 15758 raft_consensus.cc:348] T 00000000000000000000000000000000 P 284310f9ea204ac6a5778990f0129c2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "284310f9ea204ac6a5778990f0129c2c" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 39209 } }
I20260812 17:47:02.860319 15758 raft_consensus.cc:374] T 00000000000000000000000000000000 P 284310f9ea204ac6a5778990f0129c2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:47:02.860383 15758 raft_consensus.cc:729] T 00000000000000000000000000000000 P 284310f9ea204ac6a5778990f0129c2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 284310f9ea204ac6a5778990f0129c2c, State: Initialized, Role: FOLLOWER
I20260812 17:47:02.860918 15758 consensus_queue.cc:260] T 00000000000000000000000000000000 P 284310f9ea204ac6a5778990f0129c2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "284310f9ea204ac6a5778990f0129c2c" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 39209 } }
I20260812 17:47:02.861099 15758 raft_consensus.cc:388] T 00000000000000000000000000000000 P 284310f9ea204ac6a5778990f0129c2c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:47:02.861161 15758 raft_consensus.cc:482] T 00000000000000000000000000000000 P 284310f9ea204ac6a5778990f0129c2c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:47:02.861261 15758 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 284310f9ea204ac6a5778990f0129c2c [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:02.861369 15764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:02.845344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58256 (local address 127.17.255.62:39209)
0812 17:47:02.845837 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:02.845858 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:02.845904 (+ 46us) server_negotiation.cc:407] Connection header received
0812 17:47:02.846822 (+ 918us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:02.846849 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:02.847298 (+ 449us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:02.847695 (+ 397us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:02.848590 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:02.850157 (+ 1567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:02.851270 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:02.852007 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:02.852189 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:02.855191 (+ 3002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:02.855198 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:02.855218 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:02.855253 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:02.857682 (+ 2429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:02.858220 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:02.858228 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:02.858235 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:02.858439 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:02.858755 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:02.858759 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:02.858760 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:02.859387 (+ 627us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:02.859609 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:02.859923 (+ 314us) server_negotiation.cc:299] Negotiation successful
0812 17:47:02.860264 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":322,"thread_start_us":129,"threads_started":1}
I20260812 17:47:02.862350 15758 raft_consensus.cc:504] T 00000000000000000000000000000000 P 284310f9ea204ac6a5778990f0129c2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "284310f9ea204ac6a5778990f0129c2c" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 39209 } }
I20260812 17:47:02.862826 15758 leader_election.cc:302] T 00000000000000000000000000000000 P 284310f9ea204ac6a5778990f0129c2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 284310f9ea204ac6a5778990f0129c2c; no voters:
I20260812 17:47:02.863199 15758 leader_election.cc:288] T 00000000000000000000000000000000 P 284310f9ea204ac6a5778990f0129c2c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:47:02.863336 15770 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 284310f9ea204ac6a5778990f0129c2c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:47:02.863591 15770 raft_consensus.cc:686] T 00000000000000000000000000000000 P 284310f9ea204ac6a5778990f0129c2c [term 1 LEADER]: Becoming Leader. State: Replica: 284310f9ea204ac6a5778990f0129c2c, State: Running, Role: LEADER
I20260812 17:47:02.864289 15770 consensus_queue.cc:237] T 00000000000000000000000000000000 P 284310f9ea204ac6a5778990f0129c2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "284310f9ea204ac6a5778990f0129c2c" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 39209 } }
I20260812 17:47:02.864599 15758 sys_catalog.cc:564] T 00000000000000000000000000000000 P 284310f9ea204ac6a5778990f0129c2c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:47:02.865988 15775 sys_catalog.cc:455] T 00000000000000000000000000000000 P 284310f9ea204ac6a5778990f0129c2c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 284310f9ea204ac6a5778990f0129c2c. Latest consensus state: current_term: 1 leader_uuid: "284310f9ea204ac6a5778990f0129c2c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "284310f9ea204ac6a5778990f0129c2c" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 39209 } } }
I20260812 17:47:02.866137 15775 sys_catalog.cc:458] T 00000000000000000000000000000000 P 284310f9ea204ac6a5778990f0129c2c [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:02.867062 15796 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:47:02.867010 15773 sys_catalog.cc:455] T 00000000000000000000000000000000 P 284310f9ea204ac6a5778990f0129c2c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "284310f9ea204ac6a5778990f0129c2c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "284310f9ea204ac6a5778990f0129c2c" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 39209 } } }
I20260812 17:47:02.867177 15773 sys_catalog.cc:458] T 00000000000000000000000000000000 P 284310f9ea204ac6a5778990f0129c2c [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:02.870186 15796 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:47:02.875859 15796 catalog_manager.cc:1347] Generated new cluster ID: 4f139def37b640cc976063925018a9b5
I20260812 17:47:02.875972 15796 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:47:02.903499 15796 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:47:02.904994 15796 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:47:02.915505 15796 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 284310f9ea204ac6a5778990f0129c2c: Generated new TSK 0
I20260812 17:47:02.916558 15796 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.255.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab.
Entry for principal kudu/127.17.255.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab.
I20260812 17:47:02.962494 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.1:0
--local_ip_for_outbound_sockets=127.17.255.1
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:39209
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:42661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:47:03.100306 15816 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:03.100648 15816 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:03.100731 15816 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:03.104960 15816 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:03.105057 15816 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:03.105157 15816 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.1
I20260812 17:47:03.110632 15816 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:42661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:39209
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15816
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.1
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:03.111903 15816 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:03.112991 15816 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:03.122792 15831 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:03.122781 15828 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:03.122880 15825 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:03.123009 15816 server_base.cc:1034] running on GCE node
I20260812 17:47:03.123509 15816 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:03.124126 15816 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:03.125330 15816 hybrid_clock.cc:648] HybridClock initialized: now 1786556823125309 us; error 43 us; skew 500 ppm
Aug 12 17:47:03 dist-test-slave-tk9z krb5kdc[15594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556823, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:47:03.128381 15816 init.cc:377] Logged in from keytab as kudu/127.17.255.1@KRBTEST.COM (short username kudu)
I20260812 17:47:03.129263 15816 webserver.cc:460] Webserver started at http://127.17.255.1:39459/ using document root <none> and password file <none>
I20260812 17:47:03.129838 15816 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:03.129899 15816 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:03.130071 15816 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:03.132257 15816 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-0/data/instance:
uuid: "041a9f6714e04adc9c45914de0e28118"
format_stamp: "Formatted at 2026-08-12 17:47:03 on dist-test-slave-tk9z"
server_key: "4f92e63aa8c5c8de224667c62da5b98b"
server_key_iv: "f825e56128df0a913994ba11c8d18353"
server_key_version: "encryptionkey@0"
I20260812 17:47:03.132805 15816 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance:
uuid: "041a9f6714e04adc9c45914de0e28118"
format_stamp: "Formatted at 2026-08-12 17:47:03 on dist-test-slave-tk9z"
server_key: "4f92e63aa8c5c8de224667c62da5b98b"
server_key_iv: "f825e56128df0a913994ba11c8d18353"
server_key_version: "encryptionkey@0"
I20260812 17:47:03.136847 15816 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 17:47:03.139611 15842 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:03.141036 15816 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:47:03.141207 15816 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-0/wal
uuid: "041a9f6714e04adc9c45914de0e28118"
format_stamp: "Formatted at 2026-08-12 17:47:03 on dist-test-slave-tk9z"
server_key: "4f92e63aa8c5c8de224667c62da5b98b"
server_key_iv: "f825e56128df0a913994ba11c8d18353"
server_key_version: "encryptionkey@0"
I20260812 17:47:03.141347 15816 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:03.167881 15816 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:03.171680 15816 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:03.171921 15816 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:03.172614 15816 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:47:03.173668 15816 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:47:03.173746 15816 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:03.173826 15816 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:47:03.173861 15816 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:03.183902 15816 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.1:33757
I20260812 17:47:03.183986 16064 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.1:33757 every 8 connection(s)
I20260812 17:47:03.184934 15816 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
I20260812 17:47:03.193276 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 15816
I20260812 17:47:03.193468 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance
I20260812 17:47:03.193837 18428 external_mini_cluster.cc:1428] Setting key 65b8cc1082efe2f4086c4dec078f93a1
Aug 12 17:47:03 dist-test-slave-tk9z krb5kdc[15594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556823, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:47:03.200820 15764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:03.187068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:44513 (local address 127.17.255.62:39209)
0812 17:47:03.187276 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:03.187282 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:03.188697 (+ 1415us) server_negotiation.cc:407] Connection header received
0812 17:47:03.189640 (+ 943us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:03.189643 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:03.189696 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:03.189779 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:03.191161 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:03.191734 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:03.192988 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:03.193257 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:03.193413 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:03.196729 (+ 3316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:03.196733 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:03.196735 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:03.196761 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:03.198523 (+ 1762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:03.199125 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:03.199129 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:03.199131 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:03.199221 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:03.199595 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:03.199599 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:03.199601 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:03.199823 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:03.199935 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:03.200486 (+ 551us) server_negotiation.cc:299] Negotiation successful
0812 17:47:03.200643 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260812 17:47:03.201711 16069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:03.187551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:39209 (local address 127.17.255.1:44513)
0812 17:47:03.188514 (+ 963us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:03.188562 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:03.189386 (+ 824us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:03.189977 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:03.189984 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:03.190455 (+ 471us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:47:03.190993 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:03.191009 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:03.191909 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:03.191912 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:03.192834 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:03.192844 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:03.193459 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:03.193465 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:03.193702 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:03.194569 (+ 867us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:47:03.194587 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:47:03.196529 (+ 1942us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:47:03.198661 (+ 2132us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:03.198668 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:03.198688 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:03.199010 (+ 322us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:03.199323 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:03.199326 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:03.199328 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:03.199492 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:03.199944 (+ 452us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:47:03.199954 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:47:03.200230 (+ 276us) client_negotiation.cc:769] Sending connection context
0812 17:47:03.200438 (+ 208us) client_negotiation.cc:240] Negotiation successful
0812 17:47:03.200805 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":750,"thread_start_us":566,"threads_started":1}
I20260812 17:47:03.203172 16066 heartbeater.cc:347] Connected to a master server at 127.17.255.62:39209
I20260812 17:47:03.203516 16066 heartbeater.cc:464] Registering TS with master...
I20260812 17:47:03.204260 16066 heartbeater.cc:511] Master 127.17.255.62:39209 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.17.255.2@KRBTEST.COM; defaulting to no policy
I20260812 17:47:03.206528 15680 ts_manager.cc:194] Registered new tserver with Master: 041a9f6714e04adc9c45914de0e28118 (127.17.255.1:33757)
I20260812 17:47:03.207979 15680 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.1@KRBTEST.COM'} at 127.17.255.1:44513
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab.
Entry for principal kudu/127.17.255.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab.
I20260812 17:47:03.225584 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.2:0
--local_ip_for_outbound_sockets=127.17.255.2
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:39209
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:42661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:47:03.347779 16072 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:03.348109 16072 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:03.348156 16072 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:03.352880 16072 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:03.352962 16072 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:03.353109 16072 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.2
I20260812 17:47:03.359112 16072 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:42661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:39209
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16072
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.2
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:03.360414 16072 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:03.361583 16072 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:03.373669 16084 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:03.373687 16082 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:03.373755 16072 server_base.cc:1034] running on GCE node
W20260812 17:47:03.373687 16081 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:03.374504 16072 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:03.375161 16072 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:03.376354 16072 hybrid_clock.cc:648] HybridClock initialized: now 1786556823376334 us; error 29 us; skew 500 ppm
Aug 12 17:47:03 dist-test-slave-tk9z krb5kdc[15594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556823, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:47:03.379639 16072 init.cc:377] Logged in from keytab as kudu/127.17.255.2@KRBTEST.COM (short username kudu)
I20260812 17:47:03.380698 16072 webserver.cc:460] Webserver started at http://127.17.255.2:44009/ using document root <none> and password file <none>
I20260812 17:47:03.381356 16072 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:03.381459 16072 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:03.381738 16072 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:03.384181 16072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-1/data/instance:
uuid: "c98de022076e4ad5aafb627a05f4f6b0"
format_stamp: "Formatted at 2026-08-12 17:47:03 on dist-test-slave-tk9z"
server_key: "597be87f748f1f0ea49973713c4fc4a1"
server_key_iv: "a8b979dfd86c87a2f02317b96edf4da9"
server_key_version: "encryptionkey@0"
I20260812 17:47:03.384881 16072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance:
uuid: "c98de022076e4ad5aafb627a05f4f6b0"
format_stamp: "Formatted at 2026-08-12 17:47:03 on dist-test-slave-tk9z"
server_key: "597be87f748f1f0ea49973713c4fc4a1"
server_key_iv: "a8b979dfd86c87a2f02317b96edf4da9"
server_key_version: "encryptionkey@0"
I20260812 17:47:03.389214 16072 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260812 17:47:03.392189 16101 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:03.393987 16072 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 17:47:03.394191 16072 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-1/wal
uuid: "c98de022076e4ad5aafb627a05f4f6b0"
format_stamp: "Formatted at 2026-08-12 17:47:03 on dist-test-slave-tk9z"
server_key: "597be87f748f1f0ea49973713c4fc4a1"
server_key_iv: "a8b979dfd86c87a2f02317b96edf4da9"
server_key_version: "encryptionkey@0"
I20260812 17:47:03.394346 16072 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:03.406064 16072 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:03.409865 16072 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:03.410099 16072 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:03.410895 16072 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:47:03.411859 16072 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:47:03.411970 16072 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:03.412074 16072 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:47:03.412128 16072 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:03.422153 16072 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.2:43949
I20260812 17:47:03.422243 16308 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.2:43949 every 8 connection(s)
I20260812 17:47:03.423210 16072 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
I20260812 17:47:03.424021 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 16072
I20260812 17:47:03.424181 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance
I20260812 17:47:03.424479 18428 external_mini_cluster.cc:1428] Setting key 7351c2555ea535248eb3595b1665ee8b
WARNING: no policy specified for kudu/127.17.255.3@KRBTEST.COM; defaulting to no policy
Aug 12 17:47:03 dist-test-slave-tk9z krb5kdc[15594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556823, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.3@KRBTEST.COM" created.
I20260812 17:47:03.442561 15764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:03.426215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:44507 (local address 127.17.255.62:39209)
0812 17:47:03.426353 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:03.426357 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:03.427772 (+ 1415us) server_negotiation.cc:407] Connection header received
0812 17:47:03.429196 (+ 1424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:03.429199 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:03.429250 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:03.429328 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:03.430852 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:03.431807 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:03.433223 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:03.433673 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:03.433813 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:03.437106 (+ 3293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:03.437109 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:03.437111 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:03.437179 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:03.439211 (+ 2032us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:03.440116 (+ 905us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:03.440123 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:03.440128 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:03.440246 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:03.440837 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:03.440841 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:03.440842 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:03.441071 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:03.441159 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:03.442074 (+ 915us) server_negotiation.cc:299] Negotiation successful
0812 17:47:03.442278 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 17:47:03.443986 16312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:03.426877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:39209 (local address 127.17.255.2:44507)
0812 17:47:03.427625 (+ 748us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:03.427668 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:03.428883 (+ 1215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:03.429551 (+ 668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:03.429561 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:03.430048 (+ 487us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:47:03.430675 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:03.430692 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:03.432012 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:03.432015 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:03.433052 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:03.433064 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:03.433901 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:03.433905 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:03.434096 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:03.434893 (+ 797us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:47:03.434915 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:47:03.436862 (+ 1947us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:47:03.439434 (+ 2572us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:03.439447 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:03.439499 (+ 52us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:03.439956 (+ 457us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:03.440380 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:03.440386 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:03.440389 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:03.440664 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:03.441198 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:47:03.441210 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:47:03.441666 (+ 456us) client_negotiation.cc:769] Sending connection context
0812 17:47:03.441990 (+ 324us) client_negotiation.cc:240] Negotiation successful
0812 17:47:03.442851 (+ 861us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":152,"threads_started":1}
I20260812 17:47:03.445717 16310 heartbeater.cc:347] Connected to a master server at 127.17.255.62:39209
I20260812 17:47:03.446079 16310 heartbeater.cc:464] Registering TS with master...
I20260812 17:47:03.446894 16310 heartbeater.cc:511] Master 127.17.255.62:39209 requested a full tablet report, sending...
I20260812 17:47:03.448522 15680 ts_manager.cc:194] Registered new tserver with Master: c98de022076e4ad5aafb627a05f4f6b0 (127.17.255.2:43949)
I20260812 17:47:03.449401 15680 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.2@KRBTEST.COM'} at 127.17.255.2:44507
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab.
Entry for principal kudu/127.17.255.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab.
I20260812 17:47:03.462005 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.3:0
--local_ip_for_outbound_sockets=127.17.255.3
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:39209
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:42661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:47:03.583671 16315 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:03.584014 16315 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:03.584091 16315 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:03.588287 16315 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:03.588395 16315 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:03.588488 16315 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.3
I20260812 17:47:03.594198 16315 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:42661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:39209
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16315
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.3
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:03.595486 16315 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:03.596622 16315 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:03.607314 16332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:03.607406 16335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:03.607348 16333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:03.607748 16315 server_base.cc:1034] running on GCE node
I20260812 17:47:03.608279 16315 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:03.609022 16315 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:03.610262 16315 hybrid_clock.cc:648] HybridClock initialized: now 1786556823610226 us; error 87 us; skew 500 ppm
Aug 12 17:47:03 dist-test-slave-tk9z krb5kdc[15594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556823, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:47:03.613445 16315 init.cc:377] Logged in from keytab as kudu/127.17.255.3@KRBTEST.COM (short username kudu)
I20260812 17:47:03.614526 16315 webserver.cc:460] Webserver started at http://127.17.255.3:34673/ using document root <none> and password file <none>
I20260812 17:47:03.615178 16315 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:03.615278 16315 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:03.615536 16315 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:03.617754 16315 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-2/data/instance:
uuid: "d76a93cc112c4294ba15c9c9788c007e"
format_stamp: "Formatted at 2026-08-12 17:47:03 on dist-test-slave-tk9z"
server_key: "3515051c6e0c29dc0d4166a32fa5dc11"
server_key_iv: "479a4ce06a614923a9aa58ad6d41a2cf"
server_key_version: "encryptionkey@0"
I20260812 17:47:03.618444 16315 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance:
uuid: "d76a93cc112c4294ba15c9c9788c007e"
format_stamp: "Formatted at 2026-08-12 17:47:03 on dist-test-slave-tk9z"
server_key: "3515051c6e0c29dc0d4166a32fa5dc11"
server_key_iv: "479a4ce06a614923a9aa58ad6d41a2cf"
server_key_version: "encryptionkey@0"
I20260812 17:47:03.622723 16315 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260812 17:47:03.625571 16346 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:03.627048 16315 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:47:03.627226 16315 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-2/wal
uuid: "d76a93cc112c4294ba15c9c9788c007e"
format_stamp: "Formatted at 2026-08-12 17:47:03 on dist-test-slave-tk9z"
server_key: "3515051c6e0c29dc0d4166a32fa5dc11"
server_key_iv: "479a4ce06a614923a9aa58ad6d41a2cf"
server_key_version: "encryptionkey@0"
I20260812 17:47:03.627408 16315 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:03.641386 16315 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:03.644917 16315 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:03.645182 16315 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:03.645859 16315 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:47:03.646842 16315 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:47:03.646914 16315 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:03.646991 16315 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:47:03.647033 16315 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:03.658179 16315 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.3:33523
I20260812 17:47:03.658216 16557 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.3:33523 every 8 connection(s)
I20260812 17:47:03.659299 16315 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
I20260812 17:47:03.660615 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 16315
I20260812 17:47:03.660772 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance
I20260812 17:47:03.661108 18428 external_mini_cluster.cc:1428] Setting key 1f3f2f36442603f6276b4c89058ff63b
Aug 12 17:47:03 dist-test-slave-tk9z krb5kdc[15594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556823, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:47:03.675765 15764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:03.661470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:44067 (local address 127.17.255.62:39209)
0812 17:47:03.661652 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:03.661658 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:03.663117 (+ 1459us) server_negotiation.cc:407] Connection header received
0812 17:47:03.664139 (+ 1022us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:03.664142 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:03.664193 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:03.664295 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:03.665635 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:03.666334 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:03.667732 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:03.667983 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:03.668087 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:03.671511 (+ 3424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:03.671521 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:03.671523 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:03.671563 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:03.673144 (+ 1581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:03.673808 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:03.673812 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:03.673814 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:03.673905 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:03.674365 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:03.674389 (+ 24us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:03.674392 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:03.674650 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:03.674736 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:03.675449 (+ 713us) server_negotiation.cc:299] Negotiation successful
0812 17:47:03.675590 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 17:47:03.676781 16562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:03.661926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:39209 (local address 127.17.255.3:44067)
0812 17:47:03.662938 (+ 1012us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:03.663008 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:03.663929 (+ 921us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:03.664509 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:03.664521 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:03.664907 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:47:03.665444 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:03.665458 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:03.666523 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:03.666526 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:03.667586 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:03.667598 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:03.668171 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:03.668174 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:03.668392 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:03.669132 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:47:03.669152 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:47:03.671267 (+ 2115us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:47:03.673292 (+ 2025us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:03.673298 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:03.673315 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:03.673662 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:03.674033 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:03.674037 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:03.674039 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:03.674249 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:03.674782 (+ 533us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:47:03.674790 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:47:03.675140 (+ 350us) client_negotiation.cc:769] Sending connection context
0812 17:47:03.675405 (+ 265us) client_negotiation.cc:240] Negotiation successful
0812 17:47:03.675829 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":789,"thread_start_us":142,"threads_started":1}
I20260812 17:47:03.678099 16560 heartbeater.cc:347] Connected to a master server at 127.17.255.62:39209
I20260812 17:47:03.678488 16560 heartbeater.cc:464] Registering TS with master...
I20260812 17:47:03.679064 16560 heartbeater.cc:511] Master 127.17.255.62:39209 requested a full tablet report, sending...
I20260812 17:47:03.680330 15680 ts_manager.cc:194] Registered new tserver with Master: d76a93cc112c4294ba15c9c9788c007e (127.17.255.3:33523)
I20260812 17:47:03.680944 15680 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.3@KRBTEST.COM'} at 127.17.255.3:44067
I20260812 17:47:03.688491 18428 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 17:47:03.699314 15764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:03.690882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58262 (local address 127.17.255.62:39209)
0812 17:47:03.691057 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:03.691062 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:03.691201 (+ 139us) server_negotiation.cc:407] Connection header received
0812 17:47:03.691421 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:03.691431 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:03.691479 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:03.691572 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:03.692342 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:03.692901 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:03.693791 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:03.694015 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:03.694146 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:03.695698 (+ 1552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:03.695701 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:03.695703 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:03.695729 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:03.697212 (+ 1483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:03.697751 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:03.697759 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:03.697761 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:03.697856 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:03.698217 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:03.698221 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:03.698223 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:03.698557 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:03.698711 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:03.698994 (+ 283us) server_negotiation.cc:299] Negotiation successful
0812 17:47:03.699119 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 17:47:03.702859 15680 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58262:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 17:47:03.706643 15680 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 17:47:03.722766 16576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:03.716690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:43949 (local address 127.0.0.1:34278)
0812 17:47:03.717105 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:03.717166 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:03.717297 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:03.717885 (+ 588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:03.717894 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:03.717920 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:47:03.718076 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:03.718083 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:03.719573 (+ 1490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:03.719577 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:03.720902 (+ 1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:03.720912 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:03.722180 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:03.722183 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:03.722266 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:03.722302 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 17:47:03.722479 (+ 177us) client_negotiation.cc:240] Negotiation successful
0812 17:47:03.722624 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":123,"threads_started":1}
I20260812 17:47:03.722776 16580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:03.716894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34278 (local address 127.17.255.2:43949)
0812 17:47:03.717328 (+ 434us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:03.717341 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:03.717370 (+ 29us) server_negotiation.cc:407] Connection header received
0812 17:47:03.717457 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:03.717463 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:03.717705 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:03.717885 (+ 180us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:47:03.718227 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:03.719411 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:03.721213 (+ 1802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:03.722030 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:03.722172 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:03.722339 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:03.722515 (+ 176us) server_negotiation.cc:299] Negotiation successful
0812 17:47:03.722616 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":124,"threads_started":1}
I20260812 17:47:03.723501 16582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:03.717860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:33757 (local address 127.0.0.1:52222)
0812 17:47:03.718097 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:03.718111 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:03.718191 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:03.719105 (+ 914us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:03.719108 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:03.719132 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:47:03.719263 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:03.719269 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:03.720639 (+ 1370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:03.720643 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:03.721972 (+ 1329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:03.721984 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:03.723068 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:03.723072 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:03.723166 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:03.723191 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 17:47:03.723281 (+ 90us) client_negotiation.cc:240] Negotiation successful
0812 17:47:03.723358 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"mutex_wait_us":75,"thread_start_us":94,"threads_started":1}
I20260812 17:47:03.723538 16583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:03.718295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52222 (local address 127.17.255.1:33757)
0812 17:47:03.718647 (+ 352us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:03.718653 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:03.718678 (+ 25us) server_negotiation.cc:407] Connection header received
0812 17:47:03.718754 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:03.718759 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:03.718955 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:03.719099 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:47:03.719392 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:03.720541 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:03.722112 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:03.722960 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:03.723070 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:03.723210 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:03.723310 (+ 100us) server_negotiation.cc:299] Negotiation successful
0812 17:47:03.723403 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":239,"thread_start_us":154,"threads_started":1}
I20260812 17:47:03.723852 16581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:03.717492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.3:33523 (local address 127.0.0.1:49362)
0812 17:47:03.717726 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:03.717742 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:03.717840 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:03.719145 (+ 1305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:03.719148 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:03.719161 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:47:03.719463 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:03.719469 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:03.720580 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:03.720586 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:03.721981 (+ 1395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:03.721987 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:03.723452 (+ 1465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:03.723458 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:03.723583 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:03.723614 (+ 31us) client_negotiation.cc:769] Sending connection context
0812 17:47:03.723665 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 17:47:03.723731 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"mutex_wait_us":305,"thread_start_us":101,"threads_started":1}
I20260812 17:47:03.726605 16585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:03.718284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49362 (local address 127.17.255.3:33523)
0812 17:47:03.718743 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:03.718752 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:03.718771 (+ 19us) server_negotiation.cc:407] Connection header received
0812 17:47:03.718834 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:03.718838 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:03.718982 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:03.719239 (+ 257us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:47:03.719587 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:03.720448 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:03.722480 (+ 2032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:03.723307 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:03.724028 (+ 721us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:03.724170 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:03.724230 (+ 60us) server_negotiation.cc:299] Negotiation successful
0812 17:47:03.726463 (+ 2233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":177,"threads_started":1}
I20260812 17:47:03.726210 15942 tablet_service.cc:1467] Processing CreateTablet for tablet 7014ea020fed485ab4fbcaf67406e8aa (DEFAULT_TABLE table=test-table [id=52a0bda212ca419c8b5361f553063b6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:47:03.726208 16196 tablet_service.cc:1467] Processing CreateTablet for tablet 7014ea020fed485ab4fbcaf67406e8aa (DEFAULT_TABLE table=test-table [id=52a0bda212ca419c8b5361f553063b6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:47:03.727476 15942 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7014ea020fed485ab4fbcaf67406e8aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:03.727478 16196 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7014ea020fed485ab4fbcaf67406e8aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:03.729398 16442 tablet_service.cc:1467] Processing CreateTablet for tablet 7014ea020fed485ab4fbcaf67406e8aa (DEFAULT_TABLE table=test-table [id=52a0bda212ca419c8b5361f553063b6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:47:03.730460 16442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7014ea020fed485ab4fbcaf67406e8aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:03.735472 16588 tablet_bootstrap.cc:492] T 7014ea020fed485ab4fbcaf67406e8aa P c98de022076e4ad5aafb627a05f4f6b0: Bootstrap starting.
I20260812 17:47:03.737438 16590 tablet_bootstrap.cc:492] T 7014ea020fed485ab4fbcaf67406e8aa P d76a93cc112c4294ba15c9c9788c007e: Bootstrap starting.
I20260812 17:47:03.738198 16588 tablet_bootstrap.cc:654] T 7014ea020fed485ab4fbcaf67406e8aa P c98de022076e4ad5aafb627a05f4f6b0: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:03.738936 16591 tablet_bootstrap.cc:492] T 7014ea020fed485ab4fbcaf67406e8aa P 041a9f6714e04adc9c45914de0e28118: Bootstrap starting.
I20260812 17:47:03.739674 16588 log.cc:824] T 7014ea020fed485ab4fbcaf67406e8aa P c98de022076e4ad5aafb627a05f4f6b0: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:03.739830 16590 tablet_bootstrap.cc:654] T 7014ea020fed485ab4fbcaf67406e8aa P d76a93cc112c4294ba15c9c9788c007e: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:03.741093 16590 log.cc:824] T 7014ea020fed485ab4fbcaf67406e8aa P d76a93cc112c4294ba15c9c9788c007e: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:03.741142 16591 tablet_bootstrap.cc:654] T 7014ea020fed485ab4fbcaf67406e8aa P 041a9f6714e04adc9c45914de0e28118: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:03.741942 16591 log.cc:824] T 7014ea020fed485ab4fbcaf67406e8aa P 041a9f6714e04adc9c45914de0e28118: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:03.742136 16588 tablet_bootstrap.cc:492] T 7014ea020fed485ab4fbcaf67406e8aa P c98de022076e4ad5aafb627a05f4f6b0: No bootstrap required, opened a new log
I20260812 17:47:03.742353 16588 ts_tablet_manager.cc:1397] T 7014ea020fed485ab4fbcaf67406e8aa P c98de022076e4ad5aafb627a05f4f6b0: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260812 17:47:03.743294 16590 tablet_bootstrap.cc:492] T 7014ea020fed485ab4fbcaf67406e8aa P d76a93cc112c4294ba15c9c9788c007e: No bootstrap required, opened a new log
I20260812 17:47:03.743502 16590 ts_tablet_manager.cc:1397] T 7014ea020fed485ab4fbcaf67406e8aa P d76a93cc112c4294ba15c9c9788c007e: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260812 17:47:03.744067 16591 tablet_bootstrap.cc:492] T 7014ea020fed485ab4fbcaf67406e8aa P 041a9f6714e04adc9c45914de0e28118: No bootstrap required, opened a new log
I20260812 17:47:03.744261 16591 ts_tablet_manager.cc:1397] T 7014ea020fed485ab4fbcaf67406e8aa P 041a9f6714e04adc9c45914de0e28118: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 17:47:03.745805 16588 raft_consensus.cc:348] T 7014ea020fed485ab4fbcaf67406e8aa P c98de022076e4ad5aafb627a05f4f6b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98de022076e4ad5aafb627a05f4f6b0" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 43949 } } peers { permanent_uuid: "d76a93cc112c4294ba15c9c9788c007e" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 33523 } } peers { permanent_uuid: "041a9f6714e04adc9c45914de0e28118" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33757 } }
I20260812 17:47:03.746076 16588 raft_consensus.cc:374] T 7014ea020fed485ab4fbcaf67406e8aa P c98de022076e4ad5aafb627a05f4f6b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:47:03.746133 16588 raft_consensus.cc:729] T 7014ea020fed485ab4fbcaf67406e8aa P c98de022076e4ad5aafb627a05f4f6b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98de022076e4ad5aafb627a05f4f6b0, State: Initialized, Role: FOLLOWER
I20260812 17:47:03.746652 16588 consensus_queue.cc:260] T 7014ea020fed485ab4fbcaf67406e8aa P c98de022076e4ad5aafb627a05f4f6b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98de022076e4ad5aafb627a05f4f6b0" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 43949 } } peers { permanent_uuid: "d76a93cc112c4294ba15c9c9788c007e" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 33523 } } peers { permanent_uuid: "041a9f6714e04adc9c45914de0e28118" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33757 } }
I20260812 17:47:03.747402 16310 heartbeater.cc:503] Master 127.17.255.62:39209 was elected leader, sending a full tablet report...
I20260812 17:47:03.747776 16588 ts_tablet_manager.cc:1428] T 7014ea020fed485ab4fbcaf67406e8aa P c98de022076e4ad5aafb627a05f4f6b0: Time spent starting tablet: real 0.005s user 0.003s sys 0.002s
I20260812 17:47:03.747638 16590 raft_consensus.cc:348] T 7014ea020fed485ab4fbcaf67406e8aa P d76a93cc112c4294ba15c9c9788c007e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98de022076e4ad5aafb627a05f4f6b0" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 43949 } } peers { permanent_uuid: "d76a93cc112c4294ba15c9c9788c007e" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 33523 } } peers { permanent_uuid: "041a9f6714e04adc9c45914de0e28118" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33757 } }
I20260812 17:47:03.747911 16590 raft_consensus.cc:374] T 7014ea020fed485ab4fbcaf67406e8aa P d76a93cc112c4294ba15c9c9788c007e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:47:03.747985 16590 raft_consensus.cc:729] T 7014ea020fed485ab4fbcaf67406e8aa P d76a93cc112c4294ba15c9c9788c007e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d76a93cc112c4294ba15c9c9788c007e, State: Initialized, Role: FOLLOWER
I20260812 17:47:03.748462 16590 consensus_queue.cc:260] T 7014ea020fed485ab4fbcaf67406e8aa P d76a93cc112c4294ba15c9c9788c007e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98de022076e4ad5aafb627a05f4f6b0" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 43949 } } peers { permanent_uuid: "d76a93cc112c4294ba15c9c9788c007e" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 33523 } } peers { permanent_uuid: "041a9f6714e04adc9c45914de0e28118" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33757 } }
I20260812 17:47:03.749240 16591 raft_consensus.cc:348] T 7014ea020fed485ab4fbcaf67406e8aa P 041a9f6714e04adc9c45914de0e28118 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98de022076e4ad5aafb627a05f4f6b0" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 43949 } } peers { permanent_uuid: "d76a93cc112c4294ba15c9c9788c007e" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 33523 } } peers { permanent_uuid: "041a9f6714e04adc9c45914de0e28118" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33757 } }
I20260812 17:47:03.749514 16591 raft_consensus.cc:374] T 7014ea020fed485ab4fbcaf67406e8aa P 041a9f6714e04adc9c45914de0e28118 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:47:03.749567 16590 ts_tablet_manager.cc:1428] T 7014ea020fed485ab4fbcaf67406e8aa P d76a93cc112c4294ba15c9c9788c007e: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260812 17:47:03.749581 16591 raft_consensus.cc:729] T 7014ea020fed485ab4fbcaf67406e8aa P 041a9f6714e04adc9c45914de0e28118 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 041a9f6714e04adc9c45914de0e28118, State: Initialized, Role: FOLLOWER
I20260812 17:47:03.749969 16560 heartbeater.cc:503] Master 127.17.255.62:39209 was elected leader, sending a full tablet report...
I20260812 17:47:03.750034 16591 consensus_queue.cc:260] T 7014ea020fed485ab4fbcaf67406e8aa P 041a9f6714e04adc9c45914de0e28118 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98de022076e4ad5aafb627a05f4f6b0" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 43949 } } peers { permanent_uuid: "d76a93cc112c4294ba15c9c9788c007e" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 33523 } } peers { permanent_uuid: "041a9f6714e04adc9c45914de0e28118" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33757 } }
I20260812 17:47:03.750802 16066 heartbeater.cc:503] Master 127.17.255.62:39209 was elected leader, sending a full tablet report...
I20260812 17:47:03.751123 16591 ts_tablet_manager.cc:1428] T 7014ea020fed485ab4fbcaf67406e8aa P 041a9f6714e04adc9c45914de0e28118: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
W20260812 17:47:03.910540 16561 tablet.cc:2369] T 7014ea020fed485ab4fbcaf67406e8aa P d76a93cc112c4294ba15c9c9788c007e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 17:47:03.911152 16605 raft_consensus.cc:482] T 7014ea020fed485ab4fbcaf67406e8aa P 041a9f6714e04adc9c45914de0e28118 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:47:03.911396 16605 raft_consensus.cc:504] T 7014ea020fed485ab4fbcaf67406e8aa P 041a9f6714e04adc9c45914de0e28118 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98de022076e4ad5aafb627a05f4f6b0" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 43949 } } peers { permanent_uuid: "d76a93cc112c4294ba15c9c9788c007e" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 33523 } } peers { permanent_uuid: "041a9f6714e04adc9c45914de0e28118" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33757 } }
I20260812 17:47:03.912801 16605 leader_election.cc:288] T 7014ea020fed485ab4fbcaf67406e8aa P 041a9f6714e04adc9c45914de0e28118 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98de022076e4ad5aafb627a05f4f6b0 (127.17.255.2:43949), d76a93cc112c4294ba15c9c9788c007e (127.17.255.3:33523)
I20260812 17:47:03.917642 16606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:03.913163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:43949 (local address 127.17.255.1:58131)
0812 17:47:03.913595 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:03.913609 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:03.913768 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:03.914110 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:03.914113 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:03.914135 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:47:03.914332 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:03.914340 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:03.915451 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:03.915456 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:03.916432 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:03.916443 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:03.917259 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:03.917262 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:03.917345 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:03.917369 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 17:47:03.917440 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 17:47:03.917501 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":189,"threads_started":1}
I20260812 17:47:03.917714 16580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:03.913299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:58131 (local address 127.17.255.2:43949)
0812 17:47:03.913525 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:03.913532 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:03.913709 (+ 177us) server_negotiation.cc:407] Connection header received
0812 17:47:03.913908 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:03.913915 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:03.913985 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:03.914083 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:47:03.914485 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:03.915297 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:03.916586 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:03.917053 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:03.917211 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:03.917289 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:03.917485 (+ 196us) server_negotiation.cc:299] Negotiation successful
0812 17:47:03.917570 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111}
I20260812 17:47:03.918480 16609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:03.913701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.3:33523 (local address 127.17.255.1:33003)
0812 17:47:03.914126 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:03.914140 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:03.914252 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:03.914547 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:03.914550 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:03.914567 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:47:03.914683 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:03.914688 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:03.915599 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:03.915606 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:03.916972 (+ 1366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:03.917012 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:03.917963 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:03.917967 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:03.918085 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:03.918120 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 17:47:03.918192 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 17:47:03.918249 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":109,"threads_started":1}
I20260812 17:47:03.918517 16585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:03.913849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:33003 (local address 127.17.255.3:33523)
0812 17:47:03.914002 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:03.914006 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:03.914240 (+ 234us) server_negotiation.cc:407] Connection header received
0812 17:47:03.914336 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:03.914340 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:03.914442 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:03.914526 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:47:03.914862 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:03.915450 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:03.917169 (+ 1719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:03.917839 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:03.917985 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:03.918063 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:03.918242 (+ 179us) server_negotiation.cc:299] Negotiation successful
0812 17:47:03.918338 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 17:47:03.918731 16230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7014ea020fed485ab4fbcaf67406e8aa" candidate_uuid: "041a9f6714e04adc9c45914de0e28118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98de022076e4ad5aafb627a05f4f6b0" is_pre_election: true
I20260812 17:47:03.919137 16230 raft_consensus.cc:2454] T 7014ea020fed485ab4fbcaf67406e8aa P c98de022076e4ad5aafb627a05f4f6b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 041a9f6714e04adc9c45914de0e28118 in term 0.
I20260812 17:47:03.919754 15847 leader_election.cc:302] T 7014ea020fed485ab4fbcaf67406e8aa P 041a9f6714e04adc9c45914de0e28118 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 041a9f6714e04adc9c45914de0e28118, c98de022076e4ad5aafb627a05f4f6b0; no voters:
I20260812 17:47:03.919765 16470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7014ea020fed485ab4fbcaf67406e8aa" candidate_uuid: "041a9f6714e04adc9c45914de0e28118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d76a93cc112c4294ba15c9c9788c007e" is_pre_election: true
I20260812 17:47:03.920116 16470 raft_consensus.cc:2454] T 7014ea020fed485ab4fbcaf67406e8aa P d76a93cc112c4294ba15c9c9788c007e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 041a9f6714e04adc9c45914de0e28118 in term 0.
I20260812 17:47:03.920151 16605 raft_consensus.cc:2781] T 7014ea020fed485ab4fbcaf67406e8aa P 041a9f6714e04adc9c45914de0e28118 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 17:47:03.920256 16605 raft_consensus.cc:482] T 7014ea020fed485ab4fbcaf67406e8aa P 041a9f6714e04adc9c45914de0e28118 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 17:47:03.920310 16605 raft_consensus.cc:3037] T 7014ea020fed485ab4fbcaf67406e8aa P 041a9f6714e04adc9c45914de0e28118 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:03.921547 16605 raft_consensus.cc:504] T 7014ea020fed485ab4fbcaf67406e8aa P 041a9f6714e04adc9c45914de0e28118 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98de022076e4ad5aafb627a05f4f6b0" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 43949 } } peers { permanent_uuid: "d76a93cc112c4294ba15c9c9788c007e" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 33523 } } peers { permanent_uuid: "041a9f6714e04adc9c45914de0e28118" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33757 } }
I20260812 17:47:03.921950 16605 leader_election.cc:288] T 7014ea020fed485ab4fbcaf67406e8aa P 041a9f6714e04adc9c45914de0e28118 [CANDIDATE]: Term 1 election: Requested vote from peers c98de022076e4ad5aafb627a05f4f6b0 (127.17.255.2:43949), d76a93cc112c4294ba15c9c9788c007e (127.17.255.3:33523)
I20260812 17:47:03.922446 16230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7014ea020fed485ab4fbcaf67406e8aa" candidate_uuid: "041a9f6714e04adc9c45914de0e28118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98de022076e4ad5aafb627a05f4f6b0"
I20260812 17:47:03.922446 16470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7014ea020fed485ab4fbcaf67406e8aa" candidate_uuid: "041a9f6714e04adc9c45914de0e28118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d76a93cc112c4294ba15c9c9788c007e"
I20260812 17:47:03.922593 16470 raft_consensus.cc:3037] T 7014ea020fed485ab4fbcaf67406e8aa P d76a93cc112c4294ba15c9c9788c007e [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:03.922593 16230 raft_consensus.cc:3037] T 7014ea020fed485ab4fbcaf67406e8aa P c98de022076e4ad5aafb627a05f4f6b0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:03.923940 16470 raft_consensus.cc:2454] T 7014ea020fed485ab4fbcaf67406e8aa P d76a93cc112c4294ba15c9c9788c007e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 041a9f6714e04adc9c45914de0e28118 in term 1.
I20260812 17:47:03.923940 16230 raft_consensus.cc:2454] T 7014ea020fed485ab4fbcaf67406e8aa P c98de022076e4ad5aafb627a05f4f6b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 041a9f6714e04adc9c45914de0e28118 in term 1.
I20260812 17:47:03.924315 15847 leader_election.cc:302] T 7014ea020fed485ab4fbcaf67406e8aa P 041a9f6714e04adc9c45914de0e28118 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 041a9f6714e04adc9c45914de0e28118, d76a93cc112c4294ba15c9c9788c007e; no voters:
W20260812 17:47:03.924494 16311 tablet.cc:2369] T 7014ea020fed485ab4fbcaf67406e8aa P c98de022076e4ad5aafb627a05f4f6b0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 17:47:03.924589 16605 raft_consensus.cc:2781] T 7014ea020fed485ab4fbcaf67406e8aa P 041a9f6714e04adc9c45914de0e28118 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:47:03.924865 16605 raft_consensus.cc:686] T 7014ea020fed485ab4fbcaf67406e8aa P 041a9f6714e04adc9c45914de0e28118 [term 1 LEADER]: Becoming Leader. State: Replica: 041a9f6714e04adc9c45914de0e28118, State: Running, Role: LEADER
I20260812 17:47:03.925252 16605 consensus_queue.cc:237] T 7014ea020fed485ab4fbcaf67406e8aa P 041a9f6714e04adc9c45914de0e28118 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98de022076e4ad5aafb627a05f4f6b0" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 43949 } } peers { permanent_uuid: "d76a93cc112c4294ba15c9c9788c007e" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 33523 } } peers { permanent_uuid: "041a9f6714e04adc9c45914de0e28118" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33757 } }
I20260812 17:47:03.928735 15679 catalog_manager.cc:5495] T 7014ea020fed485ab4fbcaf67406e8aa P 041a9f6714e04adc9c45914de0e28118 reported cstate change: term changed from 0 to 1, leader changed from <none> to 041a9f6714e04adc9c45914de0e28118 (127.17.255.1). New cstate: current_term: 1 leader_uuid: "041a9f6714e04adc9c45914de0e28118" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98de022076e4ad5aafb627a05f4f6b0" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 43949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d76a93cc112c4294ba15c9c9788c007e" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 33523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "041a9f6714e04adc9c45914de0e28118" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 33757 } health_report { overall_health: HEALTHY } } }
W20260812 17:47:03.936429 16068 tablet.cc:2369] T 7014ea020fed485ab4fbcaf67406e8aa P 041a9f6714e04adc9c45914de0e28118: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 17:47:03.964856 16583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:03.960989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52234 (local address 127.17.255.1:33757)
0812 17:47:03.961129 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:03.961133 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:03.961148 (+ 15us) server_negotiation.cc:407] Connection header received
0812 17:47:03.961234 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:03.961237 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:03.961295 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:03.961395 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:47:03.961700 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:03.962275 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:03.963245 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:03.963497 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:03.963601 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:03.963908 (+ 307us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:47:03.964496 (+ 588us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:47:03.964602 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:03.964669 (+ 67us) server_negotiation.cc:299] Negotiation successful
0812 17:47:03.964727 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 17:47:03.971665 16230 raft_consensus.cc:1261] T 7014ea020fed485ab4fbcaf67406e8aa P c98de022076e4ad5aafb627a05f4f6b0 [term 1 FOLLOWER]: Refusing update from remote peer 041a9f6714e04adc9c45914de0e28118: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:47:03.971665 16470 raft_consensus.cc:1261] T 7014ea020fed485ab4fbcaf67406e8aa P d76a93cc112c4294ba15c9c9788c007e [term 1 FOLLOWER]: Refusing update from remote peer 041a9f6714e04adc9c45914de0e28118: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:47:03.972543 16605 consensus_queue.cc:1035] T 7014ea020fed485ab4fbcaf67406e8aa P 041a9f6714e04adc9c45914de0e28118 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d76a93cc112c4294ba15c9c9788c007e" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 33523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:47:03.972843 16611 consensus_queue.cc:1035] T 7014ea020fed485ab4fbcaf67406e8aa P 041a9f6714e04adc9c45914de0e28118 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98de022076e4ad5aafb627a05f4f6b0" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 43949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:47:03.983166 16617 mvcc.cc:205] Tried to move back new op lower bound from 7317736750978781184 to 7317736750800596992. Current Snapshot: MvccSnapshot[applied={T|T < 7317736750978781184}]
I20260812 17:47:03.983584 16618 mvcc.cc:205] Tried to move back new op lower bound from 7317736750978781184 to 7317736750800596992. Current Snapshot: MvccSnapshot[applied={T|T < 7317736750978781184}]
I20260812 17:47:03.993312 15675 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58262:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:47:03.993517 15675 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58262:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:47:03.996237 15675 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 284310f9ea204ac6a5778990f0129c2c: Sending DeleteTablet for 3 replicas of tablet 7014ea020fed485ab4fbcaf67406e8aa
I20260812 17:47:03.997169 16196 tablet_service.cc:1514] Processing DeleteTablet for tablet 7014ea020fed485ab4fbcaf67406e8aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:47:03 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:34278
I20260812 17:47:03.997253 16442 tablet_service.cc:1514] Processing DeleteTablet for tablet 7014ea020fed485ab4fbcaf67406e8aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:47:03 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:49362
I20260812 17:47:03.997251 15942 tablet_service.cc:1514] Processing DeleteTablet for tablet 7014ea020fed485ab4fbcaf67406e8aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:47:03 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:52222
I20260812 17:47:03.997794 16629 tablet_replica.cc:330] T 7014ea020fed485ab4fbcaf67406e8aa P c98de022076e4ad5aafb627a05f4f6b0: stopping tablet replica
I20260812 17:47:03.998072 16630 tablet_replica.cc:330] T 7014ea020fed485ab4fbcaf67406e8aa P d76a93cc112c4294ba15c9c9788c007e: stopping tablet replica
I20260812 17:47:03.998169 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 15816
I20260812 17:47:03.998389 16629 raft_consensus.cc:2229] T 7014ea020fed485ab4fbcaf67406e8aa P c98de022076e4ad5aafb627a05f4f6b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:47:03.998584 16630 raft_consensus.cc:2229] T 7014ea020fed485ab4fbcaf67406e8aa P d76a93cc112c4294ba15c9c9788c007e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:47:03.998867 16629 raft_consensus.cc:2258] T 7014ea020fed485ab4fbcaf67406e8aa P c98de022076e4ad5aafb627a05f4f6b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:47:03.999086 16630 raft_consensus.cc:2258] T 7014ea020fed485ab4fbcaf67406e8aa P d76a93cc112c4294ba15c9c9788c007e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:47:04.003818 16629 ts_tablet_manager.cc:1905] T 7014ea020fed485ab4fbcaf67406e8aa P c98de022076e4ad5aafb627a05f4f6b0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:47:04.006929 16630 ts_tablet_manager.cc:1905] T 7014ea020fed485ab4fbcaf67406e8aa P d76a93cc112c4294ba15c9c9788c007e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:47:04.008227 16629 ts_tablet_manager.cc:1918] T 7014ea020fed485ab4fbcaf67406e8aa P c98de022076e4ad5aafb627a05f4f6b0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 17:47:04.008446 16629 log.cc:1196] T 7014ea020fed485ab4fbcaf67406e8aa P c98de022076e4ad5aafb627a05f4f6b0: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-1/wal/wals/7014ea020fed485ab4fbcaf67406e8aa
I20260812 17:47:04.008875 16629 ts_tablet_manager.cc:1939] T 7014ea020fed485ab4fbcaf67406e8aa P c98de022076e4ad5aafb627a05f4f6b0: Deleting consensus metadata
I20260812 17:47:04.009989 16630 ts_tablet_manager.cc:1918] T 7014ea020fed485ab4fbcaf67406e8aa P d76a93cc112c4294ba15c9c9788c007e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 17:47:04.010118 16630 log.cc:1196] T 7014ea020fed485ab4fbcaf67406e8aa P d76a93cc112c4294ba15c9c9788c007e: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786556557564181-18428-0/minicluster-data/ts-2/wal/wals/7014ea020fed485ab4fbcaf67406e8aa
I20260812 17:47:04.010807 15652 catalog_manager.cc:4841] TS c98de022076e4ad5aafb627a05f4f6b0 (127.17.255.2:43949): tablet 7014ea020fed485ab4fbcaf67406e8aa (table test-table [id=52a0bda212ca419c8b5361f553063b6d]) successfully deleted
I20260812 17:47:04.010993 16630 ts_tablet_manager.cc:1939] T 7014ea020fed485ab4fbcaf67406e8aa P d76a93cc112c4294ba15c9c9788c007e: Deleting consensus metadata
I20260812 17:47:04.012310 15652 catalog_manager.cc:4841] TS d76a93cc112c4294ba15c9c9788c007e (127.17.255.3:33523): tablet 7014ea020fed485ab4fbcaf67406e8aa (table test-table [id=52a0bda212ca419c8b5361f553063b6d]) successfully deleted
W20260812 17:47:04.015988 15652 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.255.1:33757 (error 108)
I20260812 17:47:04.016286 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 16072
I20260812 17:47:04.020267 16581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:04.019846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:33757 (local address 127.0.0.1:52244)
0812 17:47:04.020102 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:04.020183 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.1:33757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150}
W20260812 17:47:04.020493 15652 catalog_manager.cc:4584] TS 041a9f6714e04adc9c45914de0e28118 (127.17.255.1:33757): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7014ea020fed485ab4fbcaf67406e8aa: Network error: Client connection negotiation failed: client connection to 127.17.255.1:33757: connect: Connection refused (error 111)
I20260812 17:47:04.030032 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 16315
I20260812 17:47:04.047749 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 15619
2026-08-12T17:47:04Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2925 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-12T17:47:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:47:04Z Disabled control of system clock
I20260812 17:47:04.086043 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:42597
--webserver_interface=127.17.255.62
--webserver_port=0
--builtin_ntp_servers=127.17.255.20:34573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:42597
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 17:47:04.208627 16638 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:04.208938 16638 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:04.208979 16638 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:04.213577 16638 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:47:04.213647 16638 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:04.213663 16638 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:04.213681 16638 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:47:04.213697 16638 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:47:04.218775 16638 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:34573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:42597
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:42597
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16638
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:04.219962 16638 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:04.221412 16638 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:04.230726 16646 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:04.230726 16651 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:04.230767 16649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:04.231118 16638 server_base.cc:1034] running on GCE node
I20260812 17:47:04.231747 16638 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:04.232999 16638 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:04.234215 16638 hybrid_clock.cc:648] HybridClock initialized: now 1786556824234162 us; error 61 us; skew 500 ppm
I20260812 17:47:04.236835 16638 webserver.cc:460] Webserver started at http://127.17.255.62:45751/ using document root <none> and password file <none>
I20260812 17:47:04.237562 16638 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:04.237639 16638 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:04.237905 16638 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:04.240403 16638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "0c94d0b2ef104c88a4a496750fc77496"
format_stamp: "Formatted at 2026-08-12 17:47:04 on dist-test-slave-tk9z"
server_key: "9d6152cb4c4e07db58e0a99cff620091"
server_key_iv: "279d9b8d7d516e90ccaa539c93f9d449"
server_key_version: "encryptionkey@0"
I20260812 17:47:04.241082 16638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "0c94d0b2ef104c88a4a496750fc77496"
format_stamp: "Formatted at 2026-08-12 17:47:04 on dist-test-slave-tk9z"
server_key: "9d6152cb4c4e07db58e0a99cff620091"
server_key_iv: "279d9b8d7d516e90ccaa539c93f9d449"
server_key_version: "encryptionkey@0"
I20260812 17:47:04.245304 16638 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.005s
I20260812 17:47:04.248344 16663 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:04.249840 16638 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 17:47:04.250033 16638 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "0c94d0b2ef104c88a4a496750fc77496"
format_stamp: "Formatted at 2026-08-12 17:47:04 on dist-test-slave-tk9z"
server_key: "9d6152cb4c4e07db58e0a99cff620091"
server_key_iv: "279d9b8d7d516e90ccaa539c93f9d449"
server_key_version: "encryptionkey@0"
I20260812 17:47:04.250178 16638 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:04.285596 16638 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:04.286580 16638 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:04.286837 16638 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:04.295179 16638 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:42597
I20260812 17:47:04.295185 16782 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:42597 every 8 connection(s)
I20260812 17:47:04.296319 16638 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:47:04.299854 16783 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:04.304078 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 16638
I20260812 17:47:04.304261 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:47:04.304564 18428 external_mini_cluster.cc:1428] Setting key b74b78e166642df172ca83b6d5482abb
I20260812 17:47:04.306320 16783 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c94d0b2ef104c88a4a496750fc77496: Bootstrap starting.
I20260812 17:47:04.308805 16783 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0c94d0b2ef104c88a4a496750fc77496: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:04.309590 16783 log.cc:824] T 00000000000000000000000000000000 P 0c94d0b2ef104c88a4a496750fc77496: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:04.312014 16783 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c94d0b2ef104c88a4a496750fc77496: No bootstrap required, opened a new log
I20260812 17:47:04.314618 16791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:04.306055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56184 (local address 127.17.255.62:42597)
0812 17:47:04.306739 (+ 684us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:04.306756 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:04.306795 (+ 39us) server_negotiation.cc:407] Connection header received
0812 17:47:04.307478 (+ 683us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:04.307498 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:04.307924 (+ 426us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:04.308221 (+ 297us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:04.308597 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:04.309651 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:04.310881 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:04.311429 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:04.311568 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:04.312570 (+ 1002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:04.312575 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:04.312590 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:47:04.313060 (+ 470us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:04.313124 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:47:04.313147 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:04.313233 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:04.313416 (+ 183us) server_negotiation.cc:299] Negotiation successful
0812 17:47:04.313744 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":321,"thread_start_us":145,"threads_started":1}
I20260812 17:47:04.316387 16783 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0c94d0b2ef104c88a4a496750fc77496 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c94d0b2ef104c88a4a496750fc77496" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 42597 } }
I20260812 17:47:04.316664 16783 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0c94d0b2ef104c88a4a496750fc77496 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:47:04.316757 16783 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0c94d0b2ef104c88a4a496750fc77496 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c94d0b2ef104c88a4a496750fc77496, State: Initialized, Role: FOLLOWER
I20260812 17:47:04.317286 16783 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0c94d0b2ef104c88a4a496750fc77496 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c94d0b2ef104c88a4a496750fc77496" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 42597 } }
I20260812 17:47:04.317485 16783 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0c94d0b2ef104c88a4a496750fc77496 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:47:04.317572 16783 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0c94d0b2ef104c88a4a496750fc77496 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:47:04.317673 16783 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0c94d0b2ef104c88a4a496750fc77496 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:04.318737 16783 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0c94d0b2ef104c88a4a496750fc77496 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c94d0b2ef104c88a4a496750fc77496" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 42597 } }
I20260812 17:47:04.319094 16783 leader_election.cc:302] T 00000000000000000000000000000000 P 0c94d0b2ef104c88a4a496750fc77496 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0c94d0b2ef104c88a4a496750fc77496; no voters:
I20260812 17:47:04.319433 16783 leader_election.cc:288] T 00000000000000000000000000000000 P 0c94d0b2ef104c88a4a496750fc77496 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:47:04.319620 16796 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0c94d0b2ef104c88a4a496750fc77496 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:47:04.319887 16796 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0c94d0b2ef104c88a4a496750fc77496 [term 1 LEADER]: Becoming Leader. State: Replica: 0c94d0b2ef104c88a4a496750fc77496, State: Running, Role: LEADER
I20260812 17:47:04.320241 16796 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0c94d0b2ef104c88a4a496750fc77496 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c94d0b2ef104c88a4a496750fc77496" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 42597 } }
I20260812 17:47:04.320813 16783 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0c94d0b2ef104c88a4a496750fc77496 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:47:04.321935 16802 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c94d0b2ef104c88a4a496750fc77496 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0c94d0b2ef104c88a4a496750fc77496" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c94d0b2ef104c88a4a496750fc77496" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 42597 } } }
I20260812 17:47:04.322072 16802 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c94d0b2ef104c88a4a496750fc77496 [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:04.322419 16807 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c94d0b2ef104c88a4a496750fc77496 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c94d0b2ef104c88a4a496750fc77496. Latest consensus state: current_term: 1 leader_uuid: "0c94d0b2ef104c88a4a496750fc77496" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c94d0b2ef104c88a4a496750fc77496" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 42597 } } }
I20260812 17:47:04.322535 16807 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c94d0b2ef104c88a4a496750fc77496 [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:04.322834 16817 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:47:04.327327 16817 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:47:04.336217 16817 catalog_manager.cc:1347] Generated new cluster ID: f248867b655e4928a25be3b105719a98
I20260812 17:47:04.336520 16817 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:47:04.356621 16817 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:47:04.358054 16817 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:47:04.369549 16817 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0c94d0b2ef104c88a4a496750fc77496: Generated new TSK 0
I20260812 17:47:04.370610 16817 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 17:47:04.382426 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.1:0
--local_ip_for_outbound_sockets=127.17.255.1
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:42597
--builtin_ntp_servers=127.17.255.20:34573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 17:47:04.505589 16829 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:04.505909 16829 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:04.505981 16829 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:04.510004 16829 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:04.510090 16829 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:04.510180 16829 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.1
I20260812 17:47:04.514961 16829 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:34573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:42597
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16829
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.1
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:04.516093 16829 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:04.517796 16829 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:04.527925 16845 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:04.527930 16842 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:04.528075 16841 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:04.528119 16829 server_base.cc:1034] running on GCE node
I20260812 17:47:04.528683 16829 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:04.529381 16829 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:04.530544 16829 hybrid_clock.cc:648] HybridClock initialized: now 1786556824530530 us; error 25 us; skew 500 ppm
I20260812 17:47:04.532413 16829 webserver.cc:460] Webserver started at http://127.17.255.1:40529/ using document root <none> and password file <none>
I20260812 17:47:04.533018 16829 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:04.533082 16829 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:04.533339 16829 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:04.535519 16829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-0/data/instance:
uuid: "dc06c2efd2634fd596e00495bcfe8363"
format_stamp: "Formatted at 2026-08-12 17:47:04 on dist-test-slave-tk9z"
server_key: "853512af60d48dd31d20778d17cc2dc4"
server_key_iv: "7b8223c173fc2b5b0967e9b5a5443f79"
server_key_version: "encryptionkey@0"
I20260812 17:47:04.536115 16829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance:
uuid: "dc06c2efd2634fd596e00495bcfe8363"
format_stamp: "Formatted at 2026-08-12 17:47:04 on dist-test-slave-tk9z"
server_key: "853512af60d48dd31d20778d17cc2dc4"
server_key_iv: "7b8223c173fc2b5b0967e9b5a5443f79"
server_key_version: "encryptionkey@0"
I20260812 17:47:04.540026 16829 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 17:47:04.542695 16861 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:04.543987 16829 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:47:04.544127 16829 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-0/wal
uuid: "dc06c2efd2634fd596e00495bcfe8363"
format_stamp: "Formatted at 2026-08-12 17:47:04 on dist-test-slave-tk9z"
server_key: "853512af60d48dd31d20778d17cc2dc4"
server_key_iv: "7b8223c173fc2b5b0967e9b5a5443f79"
server_key_version: "encryptionkey@0"
I20260812 17:47:04.544250 16829 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:04.565197 16829 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:04.566247 16829 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:04.566538 16829 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:04.567220 16829 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:47:04.568288 16829 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:47:04.568361 16829 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:04.568437 16829 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:47:04.568483 16829 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:04.577874 16829 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.1:39977
I20260812 17:47:04.577903 17073 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.1:39977 every 8 connection(s)
I20260812 17:47:04.578895 16829 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
I20260812 17:47:04.580893 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 16829
I20260812 17:47:04.581035 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance
I20260812 17:47:04.581363 18428 external_mini_cluster.cc:1428] Setting key af1f38854afea7f9370a5da73de607ee
I20260812 17:47:04.583655 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.2:0
--local_ip_for_outbound_sockets=127.17.255.2
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:42597
--builtin_ntp_servers=127.17.255.20:34573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 17:47:04.589756 16791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:04.581268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:38151 (local address 127.17.255.62:42597)
0812 17:47:04.581445 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:04.581449 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:04.582411 (+ 962us) server_negotiation.cc:407] Connection header received
0812 17:47:04.584462 (+ 2051us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:04.584470 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:04.584516 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:04.584591 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:04.585825 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:04.586431 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:04.587641 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:04.587890 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:04.588006 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:04.589230 (+ 1224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:04.589234 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:04.589240 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:47:04.589254 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:04.589272 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:47:04.589280 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:04.589367 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:04.589543 (+ 176us) server_negotiation.cc:299] Negotiation successful
0812 17:47:04.589606 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 17:47:04.591074 17077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:04.581412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:42597 (local address 127.17.255.1:38151)
0812 17:47:04.582227 (+ 815us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:04.582283 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:04.584202 (+ 1919us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:04.584790 (+ 588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:04.584802 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:04.584931 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:47:04.585669 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:04.585686 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:04.586569 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:04.586572 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:04.587502 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:04.587513 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:04.588056 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:04.588061 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:04.588258 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:04.588935 (+ 677us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 17:47:04.588937 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:47:04.588981 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 17:47:04.589048 (+ 67us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:47:04.589368 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:47:04.589381 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:47:04.589388 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 17:47:04.589532 (+ 144us) client_negotiation.cc:240] Negotiation successful
0812 17:47:04.589844 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":144,"threads_started":1}
I20260812 17:47:04.592530 17075 heartbeater.cc:347] Connected to a master server at 127.17.255.62:42597
I20260812 17:47:04.592833 17075 heartbeater.cc:464] Registering TS with master...
I20260812 17:47:04.593612 17075 heartbeater.cc:511] Master 127.17.255.62:42597 requested a full tablet report, sending...
I20260812 17:47:04.595724 16697 ts_manager.cc:194] Registered new tserver with Master: dc06c2efd2634fd596e00495bcfe8363 (127.17.255.1:39977)
I20260812 17:47:04.596990 16697 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.255.1:38151
W20260812 17:47:04.704442 17078 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:04.704726 17078 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:04.704766 17078 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:04.708755 17078 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:04.708823 17078 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:04.708881 17078 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.2
I20260812 17:47:04.714741 17078 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:34573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:42597
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17078
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.2
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:04.716149 17078 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:04.717567 17078 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:04.727953 17089 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:04.727953 17087 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:04.728022 17086 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:04.728200 17078 server_base.cc:1034] running on GCE node
I20260812 17:47:04.728721 17078 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:04.729365 17078 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:04.730558 17078 hybrid_clock.cc:648] HybridClock initialized: now 1786556824730520 us; error 53 us; skew 500 ppm
I20260812 17:47:04.732650 17078 webserver.cc:460] Webserver started at http://127.17.255.2:36171/ using document root <none> and password file <none>
I20260812 17:47:04.733320 17078 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:04.733423 17078 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:04.733688 17078 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:04.736080 17078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-1/data/instance:
uuid: "eb86e260560245588e5f6fd94684b6e4"
format_stamp: "Formatted at 2026-08-12 17:47:04 on dist-test-slave-tk9z"
server_key: "48a46218e66bc8c2d38e99179f4c05c2"
server_key_iv: "fdc38098f39e838b17ac7a04edc8e080"
server_key_version: "encryptionkey@0"
I20260812 17:47:04.736689 17078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance:
uuid: "eb86e260560245588e5f6fd94684b6e4"
format_stamp: "Formatted at 2026-08-12 17:47:04 on dist-test-slave-tk9z"
server_key: "48a46218e66bc8c2d38e99179f4c05c2"
server_key_iv: "fdc38098f39e838b17ac7a04edc8e080"
server_key_version: "encryptionkey@0"
I20260812 17:47:04.740633 17078 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260812 17:47:04.743314 17097 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:04.744740 17078 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 17:47:04.744906 17078 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-1/wal
uuid: "eb86e260560245588e5f6fd94684b6e4"
format_stamp: "Formatted at 2026-08-12 17:47:04 on dist-test-slave-tk9z"
server_key: "48a46218e66bc8c2d38e99179f4c05c2"
server_key_iv: "fdc38098f39e838b17ac7a04edc8e080"
server_key_version: "encryptionkey@0"
I20260812 17:47:04.745038 17078 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:04.769480 17078 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:04.770298 17078 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:04.770548 17078 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:04.771234 17078 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:47:04.772351 17078 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:47:04.772428 17078 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:04.772502 17078 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:47:04.772553 17078 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:04.782112 17078 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.2:42427
I20260812 17:47:04.782143 17311 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.2:42427 every 8 connection(s)
I20260812 17:47:04.783198 17078 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
I20260812 17:47:04.792102 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 17078
I20260812 17:47:04.792222 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance
I20260812 17:47:04.792603 18428 external_mini_cluster.cc:1428] Setting key 628e4832cc41e2e8f9a4b33db5662fe8
I20260812 17:47:04.793650 16791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:04.785431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:59753 (local address 127.17.255.62:42597)
0812 17:47:04.785623 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:04.785627 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:04.786866 (+ 1239us) server_negotiation.cc:407] Connection header received
0812 17:47:04.788411 (+ 1545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:04.788414 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:04.788477 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:04.788564 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:04.789579 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:04.790121 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:04.791387 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:04.791608 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:04.791696 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:04.793058 (+ 1362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:04.793064 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:04.793067 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:47:04.793086 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:04.793113 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:47:04.793131 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:04.793194 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:04.793419 (+ 225us) server_negotiation.cc:299] Negotiation successful
0812 17:47:04.793487 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260812 17:47:04.794822 17316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:04.785842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:42597 (local address 127.17.255.2:59753)
0812 17:47:04.786695 (+ 853us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:04.786740 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:04.788120 (+ 1380us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:04.788754 (+ 634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:04.788762 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:04.788853 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:47:04.789430 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:04.789444 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:04.790237 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:04.790239 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:04.791239 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:04.791249 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:04.791774 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:04.791777 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:04.791928 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:04.792700 (+ 772us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 17:47:04.792705 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:47:04.792772 (+ 67us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 17:47:04.792852 (+ 80us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:47:04.793229 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:47:04.793240 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:47:04.793248 (+ 8us) client_negotiation.cc:769] Sending connection context
0812 17:47:04.793388 (+ 140us) client_negotiation.cc:240] Negotiation successful
0812 17:47:04.793735 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":141,"threads_started":1}
I20260812 17:47:04.795082 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.3:0
--local_ip_for_outbound_sockets=127.17.255.3
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:42597
--builtin_ntp_servers=127.17.255.20:34573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 17:47:04.796043 17313 heartbeater.cc:347] Connected to a master server at 127.17.255.62:42597
I20260812 17:47:04.796337 17313 heartbeater.cc:464] Registering TS with master...
I20260812 17:47:04.797027 17313 heartbeater.cc:511] Master 127.17.255.62:42597 requested a full tablet report, sending...
I20260812 17:47:04.798236 16697 ts_manager.cc:194] Registered new tserver with Master: eb86e260560245588e5f6fd94684b6e4 (127.17.255.2:42427)
I20260812 17:47:04.798884 16697 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.255.2:59753
W20260812 17:47:04.919394 17317 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:04.919757 17317 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:04.919826 17317 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:04.924448 17317 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:04.924505 17317 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:04.924561 17317 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.3
I20260812 17:47:04.929523 17317 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:34573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:42597
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17317
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.3
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:04.930830 17317 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:04.932315 17317 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:04.942642 17327 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:04.942637 17330 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:04.942637 17325 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:04.943058 17317 server_base.cc:1034] running on GCE node
I20260812 17:47:04.943531 17317 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:04.944253 17317 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:04.945474 17317 hybrid_clock.cc:648] HybridClock initialized: now 1786556824945436 us; error 50 us; skew 500 ppm
I20260812 17:47:04.947731 17317 webserver.cc:460] Webserver started at http://127.17.255.3:40665/ using document root <none> and password file <none>
I20260812 17:47:04.948459 17317 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:04.948592 17317 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:04.948882 17317 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:04.951422 17317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-2/data/instance:
uuid: "93f3033d805147e9999a6f53ffa445b6"
format_stamp: "Formatted at 2026-08-12 17:47:04 on dist-test-slave-tk9z"
server_key: "9de7e31628b54fb917c57af1b407f72e"
server_key_iv: "854707207a0936ef0c64f0506720b961"
server_key_version: "encryptionkey@0"
I20260812 17:47:04.952059 17317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance:
uuid: "93f3033d805147e9999a6f53ffa445b6"
format_stamp: "Formatted at 2026-08-12 17:47:04 on dist-test-slave-tk9z"
server_key: "9de7e31628b54fb917c57af1b407f72e"
server_key_iv: "854707207a0936ef0c64f0506720b961"
server_key_version: "encryptionkey@0"
I20260812 17:47:04.956516 17317 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 17:47:04.959230 17345 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:04.960600 17317 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:47:04.960750 17317 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-2/wal
uuid: "93f3033d805147e9999a6f53ffa445b6"
format_stamp: "Formatted at 2026-08-12 17:47:04 on dist-test-slave-tk9z"
server_key: "9de7e31628b54fb917c57af1b407f72e"
server_key_iv: "854707207a0936ef0c64f0506720b961"
server_key_version: "encryptionkey@0"
I20260812 17:47:04.960879 17317 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:04.972728 17317 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:04.973531 17317 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:04.973737 17317 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:04.974409 17317 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:47:04.975508 17317 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:47:04.975582 17317 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:04.975654 17317 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:47:04.975705 17317 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:04.984831 17317 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.3:46499
I20260812 17:47:04.984867 17532 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.3:46499 every 8 connection(s)
I20260812 17:47:04.985810 17317 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
I20260812 17:47:04.993798 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 17317
I20260812 17:47:04.993901 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance
I20260812 17:47:04.994170 18428 external_mini_cluster.cc:1428] Setting key b7cdc93c029f65933def50db9e2ddd04
I20260812 17:47:04.996460 16791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:04.987974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:54301 (local address 127.17.255.62:42597)
0812 17:47:04.988125 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:04.988129 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:04.989141 (+ 1012us) server_negotiation.cc:407] Connection header received
0812 17:47:04.990880 (+ 1739us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:04.990884 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:04.990953 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:04.991075 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:04.992100 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:04.992704 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:04.994061 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:04.994421 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:04.994556 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:04.995891 (+ 1335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:04.995895 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:04.995898 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:47:04.995911 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:04.995942 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:47:04.995951 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:04.996036 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:04.996226 (+ 190us) server_negotiation.cc:299] Negotiation successful
0812 17:47:04.996305 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 17:47:04.997437 17536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:04.988210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:42597 (local address 127.17.255.3:54301)
0812 17:47:04.988959 (+ 749us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:04.989003 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:04.990621 (+ 1618us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:04.991275 (+ 654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:04.991283 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:04.991380 (+ 97us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:47:04.991926 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:04.991941 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:04.992882 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:04.992885 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:04.993904 (+ 1019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:04.993917 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:04.994607 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:04.994612 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:04.994849 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:04.995554 (+ 705us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 17:47:04.995556 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:47:04.995627 (+ 71us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 17:47:04.995723 (+ 96us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:47:04.996038 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:47:04.996052 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:47:04.996061 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 17:47:04.996221 (+ 160us) client_negotiation.cc:240] Negotiation successful
0812 17:47:04.996545 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":126,"threads_started":1}
I20260812 17:47:04.998692 17534 heartbeater.cc:347] Connected to a master server at 127.17.255.62:42597
I20260812 17:47:04.998941 17534 heartbeater.cc:464] Registering TS with master...
I20260812 17:47:04.999467 17534 heartbeater.cc:511] Master 127.17.255.62:42597 requested a full tablet report, sending...
I20260812 17:47:05.000562 16697 ts_manager.cc:194] Registered new tserver with Master: 93f3033d805147e9999a6f53ffa445b6 (127.17.255.3:46499)
I20260812 17:47:05.001148 16697 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.255.3:54301
I20260812 17:47:05.008659 18428 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 17:47:05.014700 16791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:05.010958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56188 (local address 127.17.255.62:42597)
0812 17:47:05.011150 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:05.011155 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:05.011261 (+ 106us) server_negotiation.cc:407] Connection header received
0812 17:47:05.011395 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:05.011398 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:05.011444 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:05.011517 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:05.011832 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:05.012380 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:05.013166 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:05.013381 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:05.013458 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:05.014189 (+ 731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:05.014192 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:05.014194 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:47:05.014206 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:05.014226 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:47:05.014234 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:05.014295 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:05.014435 (+ 140us) server_negotiation.cc:299] Negotiation successful
0812 17:47:05.014490 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260812 17:47:05.017910 16697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56188:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 17:47:05.021131 16697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 17:47:05.037112 17556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:05.031218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.3:46499 (local address 127.0.0.1:41974)
0812 17:47:05.032040 (+ 822us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:05.032053 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:05.032145 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:05.032851 (+ 706us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:05.032855 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:05.032873 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:47:05.032980 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:05.032985 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:05.034231 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:05.034234 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:05.035541 (+ 1307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:05.035551 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:05.036526 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:05.036530 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:05.036644 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:05.036694 (+ 50us) client_negotiation.cc:769] Sending connection context
0812 17:47:05.036804 (+ 110us) client_negotiation.cc:240] Negotiation successful
0812 17:47:05.036931 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":742,"mutex_wait_us":131,"thread_start_us":91,"threads_started":1}
I20260812 17:47:05.037313 17559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:05.031898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52664 (local address 127.17.255.2:42427)
0812 17:47:05.032323 (+ 425us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:05.032335 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:05.032526 (+ 191us) server_negotiation.cc:407] Connection header received
0812 17:47:05.032675 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:05.032680 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:05.032903 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:05.033071 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:47:05.033252 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:05.034513 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:05.036054 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:05.036658 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:05.036768 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:05.036969 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:05.037025 (+ 56us) server_negotiation.cc:299] Negotiation successful
0812 17:47:05.037122 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":238,"threads_started":1}
I20260812 17:47:05.037742 17558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:05.031560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41974 (local address 127.17.255.3:46499)
0812 17:47:05.032439 (+ 879us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:05.032450 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:05.032471 (+ 21us) server_negotiation.cc:407] Connection header received
0812 17:47:05.032538 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:05.032542 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:05.032693 (+ 151us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:05.033163 (+ 470us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:47:05.033327 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:05.034090 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:05.035673 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:05.036389 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:05.036503 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:05.036708 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:05.037199 (+ 491us) server_negotiation.cc:299] Negotiation successful
0812 17:47:05.037305 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":775,"thread_start_us":127,"threads_started":1}
I20260812 17:47:05.037911 17551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:05.030731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:39977 (local address 127.0.0.1:58482)
0812 17:47:05.031916 (+ 1185us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:05.031973 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:05.032118 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:05.032775 (+ 657us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:05.032782 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:05.032805 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:47:05.032956 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:05.032969 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:05.034444 (+ 1475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:05.034448 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:05.035894 (+ 1446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:05.035906 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:05.037175 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:05.037178 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:05.037464 (+ 286us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:05.037490 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 17:47:05.037575 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 17:47:05.037763 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":979,"mutex_wait_us":120,"thread_start_us":88,"threads_started":1}
I20260812 17:47:05.037940 17555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:05.030960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58482 (local address 127.17.255.1:39977)
0812 17:47:05.031354 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:05.031367 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:05.032276 (+ 909us) server_negotiation.cc:407] Connection header received
0812 17:47:05.032385 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:05.032392 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:05.032612 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:05.032784 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:47:05.033111 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:05.034301 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:05.036037 (+ 1736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:05.036811 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:05.036924 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:05.037109 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:05.037623 (+ 514us) server_negotiation.cc:299] Negotiation successful
0812 17:47:05.037728 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":146,"threads_started":1}
I20260812 17:47:05.038779 17557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:05.031516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:42427 (local address 127.0.0.1:52664)
0812 17:47:05.032412 (+ 896us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:05.032431 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:05.032556 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:05.033062 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:05.033065 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:05.033088 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:47:05.033160 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:05.033165 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:05.034638 (+ 1473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:05.034641 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:05.035894 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:05.035906 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:05.036799 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:05.036802 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:05.036911 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:05.036936 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 17:47:05.036997 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 17:47:05.037067 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":836,"mutex_wait_us":45,"thread_start_us":105,"threads_started":1}
I20260812 17:47:05.041003 16948 tablet_service.cc:1467] Processing CreateTablet for tablet f25208e39378423f8d63c4e9cf64ef6e (DEFAULT_TABLE table=test-table [id=8d77699fba77490dbae467439054f097]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:47:05.041002 17425 tablet_service.cc:1467] Processing CreateTablet for tablet f25208e39378423f8d63c4e9cf64ef6e (DEFAULT_TABLE table=test-table [id=8d77699fba77490dbae467439054f097]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:47:05.042246 17425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f25208e39378423f8d63c4e9cf64ef6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:05.042301 16948 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f25208e39378423f8d63c4e9cf64ef6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:05.044812 17192 tablet_service.cc:1467] Processing CreateTablet for tablet f25208e39378423f8d63c4e9cf64ef6e (DEFAULT_TABLE table=test-table [id=8d77699fba77490dbae467439054f097]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:47:05.045974 17192 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f25208e39378423f8d63c4e9cf64ef6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:05.050318 17560 tablet_bootstrap.cc:492] T f25208e39378423f8d63c4e9cf64ef6e P dc06c2efd2634fd596e00495bcfe8363: Bootstrap starting.
I20260812 17:47:05.052239 17563 tablet_bootstrap.cc:492] T f25208e39378423f8d63c4e9cf64ef6e P 93f3033d805147e9999a6f53ffa445b6: Bootstrap starting.
I20260812 17:47:05.054113 17564 tablet_bootstrap.cc:492] T f25208e39378423f8d63c4e9cf64ef6e P eb86e260560245588e5f6fd94684b6e4: Bootstrap starting.
I20260812 17:47:05.054625 17563 tablet_bootstrap.cc:654] T f25208e39378423f8d63c4e9cf64ef6e P 93f3033d805147e9999a6f53ffa445b6: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:05.054629 17560 tablet_bootstrap.cc:654] T f25208e39378423f8d63c4e9cf64ef6e P dc06c2efd2634fd596e00495bcfe8363: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:05.055516 17560 log.cc:824] T f25208e39378423f8d63c4e9cf64ef6e P dc06c2efd2634fd596e00495bcfe8363: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:05.055557 17563 log.cc:824] T f25208e39378423f8d63c4e9cf64ef6e P 93f3033d805147e9999a6f53ffa445b6: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:05.056440 17564 tablet_bootstrap.cc:654] T f25208e39378423f8d63c4e9cf64ef6e P eb86e260560245588e5f6fd94684b6e4: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:05.057138 17564 log.cc:824] T f25208e39378423f8d63c4e9cf64ef6e P eb86e260560245588e5f6fd94684b6e4: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:05.057734 17560 tablet_bootstrap.cc:492] T f25208e39378423f8d63c4e9cf64ef6e P dc06c2efd2634fd596e00495bcfe8363: No bootstrap required, opened a new log
I20260812 17:47:05.057734 17563 tablet_bootstrap.cc:492] T f25208e39378423f8d63c4e9cf64ef6e P 93f3033d805147e9999a6f53ffa445b6: No bootstrap required, opened a new log
I20260812 17:47:05.057952 17560 ts_tablet_manager.cc:1397] T f25208e39378423f8d63c4e9cf64ef6e P dc06c2efd2634fd596e00495bcfe8363: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260812 17:47:05.057952 17563 ts_tablet_manager.cc:1397] T f25208e39378423f8d63c4e9cf64ef6e P 93f3033d805147e9999a6f53ffa445b6: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 17:47:05.059032 17564 tablet_bootstrap.cc:492] T f25208e39378423f8d63c4e9cf64ef6e P eb86e260560245588e5f6fd94684b6e4: No bootstrap required, opened a new log
I20260812 17:47:05.059239 17564 ts_tablet_manager.cc:1397] T f25208e39378423f8d63c4e9cf64ef6e P eb86e260560245588e5f6fd94684b6e4: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 17:47:05.062572 17560 raft_consensus.cc:348] T f25208e39378423f8d63c4e9cf64ef6e P dc06c2efd2634fd596e00495bcfe8363 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc06c2efd2634fd596e00495bcfe8363" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 39977 } } peers { permanent_uuid: "eb86e260560245588e5f6fd94684b6e4" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 42427 } } peers { permanent_uuid: "93f3033d805147e9999a6f53ffa445b6" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46499 } }
I20260812 17:47:05.062572 17563 raft_consensus.cc:348] T f25208e39378423f8d63c4e9cf64ef6e P 93f3033d805147e9999a6f53ffa445b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc06c2efd2634fd596e00495bcfe8363" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 39977 } } peers { permanent_uuid: "eb86e260560245588e5f6fd94684b6e4" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 42427 } } peers { permanent_uuid: "93f3033d805147e9999a6f53ffa445b6" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46499 } }
I20260812 17:47:05.062881 17563 raft_consensus.cc:374] T f25208e39378423f8d63c4e9cf64ef6e P 93f3033d805147e9999a6f53ffa445b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:47:05.062881 17560 raft_consensus.cc:374] T f25208e39378423f8d63c4e9cf64ef6e P dc06c2efd2634fd596e00495bcfe8363 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:47:05.062740 17564 raft_consensus.cc:348] T f25208e39378423f8d63c4e9cf64ef6e P eb86e260560245588e5f6fd94684b6e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc06c2efd2634fd596e00495bcfe8363" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 39977 } } peers { permanent_uuid: "eb86e260560245588e5f6fd94684b6e4" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 42427 } } peers { permanent_uuid: "93f3033d805147e9999a6f53ffa445b6" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46499 } }
I20260812 17:47:05.062942 17560 raft_consensus.cc:729] T f25208e39378423f8d63c4e9cf64ef6e P dc06c2efd2634fd596e00495bcfe8363 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc06c2efd2634fd596e00495bcfe8363, State: Initialized, Role: FOLLOWER
I20260812 17:47:05.062942 17563 raft_consensus.cc:729] T f25208e39378423f8d63c4e9cf64ef6e P 93f3033d805147e9999a6f53ffa445b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93f3033d805147e9999a6f53ffa445b6, State: Initialized, Role: FOLLOWER
I20260812 17:47:05.063009 17564 raft_consensus.cc:374] T f25208e39378423f8d63c4e9cf64ef6e P eb86e260560245588e5f6fd94684b6e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:47:05.063069 17564 raft_consensus.cc:729] T f25208e39378423f8d63c4e9cf64ef6e P eb86e260560245588e5f6fd94684b6e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb86e260560245588e5f6fd94684b6e4, State: Initialized, Role: FOLLOWER
I20260812 17:47:05.063449 17560 consensus_queue.cc:260] T f25208e39378423f8d63c4e9cf64ef6e P dc06c2efd2634fd596e00495bcfe8363 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc06c2efd2634fd596e00495bcfe8363" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 39977 } } peers { permanent_uuid: "eb86e260560245588e5f6fd94684b6e4" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 42427 } } peers { permanent_uuid: "93f3033d805147e9999a6f53ffa445b6" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46499 } }
I20260812 17:47:05.063449 17563 consensus_queue.cc:260] T f25208e39378423f8d63c4e9cf64ef6e P 93f3033d805147e9999a6f53ffa445b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc06c2efd2634fd596e00495bcfe8363" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 39977 } } peers { permanent_uuid: "eb86e260560245588e5f6fd94684b6e4" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 42427 } } peers { permanent_uuid: "93f3033d805147e9999a6f53ffa445b6" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46499 } }
I20260812 17:47:05.063524 17564 consensus_queue.cc:260] T f25208e39378423f8d63c4e9cf64ef6e P eb86e260560245588e5f6fd94684b6e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc06c2efd2634fd596e00495bcfe8363" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 39977 } } peers { permanent_uuid: "eb86e260560245588e5f6fd94684b6e4" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 42427 } } peers { permanent_uuid: "93f3033d805147e9999a6f53ffa445b6" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46499 } }
I20260812 17:47:05.064235 17075 heartbeater.cc:503] Master 127.17.255.62:42597 was elected leader, sending a full tablet report...
I20260812 17:47:05.064570 17534 heartbeater.cc:503] Master 127.17.255.62:42597 was elected leader, sending a full tablet report...
I20260812 17:47:05.064582 17563 ts_tablet_manager.cc:1428] T f25208e39378423f8d63c4e9cf64ef6e P 93f3033d805147e9999a6f53ffa445b6: Time spent starting tablet: real 0.007s user 0.004s sys 0.004s
I20260812 17:47:05.065642 17564 ts_tablet_manager.cc:1428] T f25208e39378423f8d63c4e9cf64ef6e P eb86e260560245588e5f6fd94684b6e4: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260812 17:47:05.065740 17560 ts_tablet_manager.cc:1428] T f25208e39378423f8d63c4e9cf64ef6e P dc06c2efd2634fd596e00495bcfe8363: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260812 17:47:05.065982 17313 heartbeater.cc:503] Master 127.17.255.62:42597 was elected leader, sending a full tablet report...
W20260812 17:47:05.080255 17076 tablet.cc:2369] T f25208e39378423f8d63c4e9cf64ef6e P dc06c2efd2634fd596e00495bcfe8363: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 17:47:05.204550 17574 raft_consensus.cc:482] T f25208e39378423f8d63c4e9cf64ef6e P 93f3033d805147e9999a6f53ffa445b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:47:05.204895 17574 raft_consensus.cc:504] T f25208e39378423f8d63c4e9cf64ef6e P 93f3033d805147e9999a6f53ffa445b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc06c2efd2634fd596e00495bcfe8363" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 39977 } } peers { permanent_uuid: "eb86e260560245588e5f6fd94684b6e4" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 42427 } } peers { permanent_uuid: "93f3033d805147e9999a6f53ffa445b6" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46499 } }
I20260812 17:47:05.206210 17574 leader_election.cc:288] T f25208e39378423f8d63c4e9cf64ef6e P 93f3033d805147e9999a6f53ffa445b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc06c2efd2634fd596e00495bcfe8363 (127.17.255.1:39977), eb86e260560245588e5f6fd94684b6e4 (127.17.255.2:42427)
I20260812 17:47:05.211040 17536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:05.206683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:39977 (local address 127.17.255.3:57005)
0812 17:47:05.206872 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:05.206893 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:05.206998 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:05.207365 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:05.207370 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:05.207399 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:47:05.207584 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:05.207593 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:05.208609 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:05.208613 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:05.209748 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:05.209760 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:05.210660 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:05.210664 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:05.210751 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:05.210775 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 17:47:05.210852 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 17:47:05.210918 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260812 17:47:05.211136 17555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:05.206842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:57005 (local address 127.17.255.1:39977)
0812 17:47:05.207036 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:05.207042 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:05.207063 (+ 21us) server_negotiation.cc:407] Connection header received
0812 17:47:05.207140 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:05.207143 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:05.207224 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:05.207347 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:47:05.207752 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:05.208458 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:05.209901 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:05.210486 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:05.210626 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:05.210683 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:05.210893 (+ 210us) server_negotiation.cc:299] Negotiation successful
0812 17:47:05.210984 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260812 17:47:05.211846 17559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:05.207204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:46525 (local address 127.17.255.2:42427)
0812 17:47:05.207354 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:05.207359 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:05.207491 (+ 132us) server_negotiation.cc:407] Connection header received
0812 17:47:05.207603 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:05.207607 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:05.207674 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:05.207767 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:47:05.208145 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:05.208852 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:05.210395 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:05.211033 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:05.211186 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:05.211248 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:05.211667 (+ 419us) server_negotiation.cc:299] Negotiation successful
0812 17:47:05.211745 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 17:47:05.211855 17580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:05.206997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:42427 (local address 127.17.255.3:46525)
0812 17:47:05.207374 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:05.207392 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:05.207510 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:05.207805 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:05.207808 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:05.207830 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:47:05.207986 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:05.207993 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:05.208988 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:05.208991 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:05.210197 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:05.210209 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:05.211371 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:05.211375 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:05.211475 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:05.211516 (+ 41us) client_negotiation.cc:769] Sending connection context
0812 17:47:05.211625 (+ 109us) client_negotiation.cc:240] Negotiation successful
0812 17:47:05.211704 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":152,"threads_started":1}
I20260812 17:47:05.211980 16988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f25208e39378423f8d63c4e9cf64ef6e" candidate_uuid: "93f3033d805147e9999a6f53ffa445b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc06c2efd2634fd596e00495bcfe8363" is_pre_election: true
I20260812 17:47:05.212385 16988 raft_consensus.cc:2454] T f25208e39378423f8d63c4e9cf64ef6e P dc06c2efd2634fd596e00495bcfe8363 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93f3033d805147e9999a6f53ffa445b6 in term 0.
I20260812 17:47:05.212743 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f25208e39378423f8d63c4e9cf64ef6e" candidate_uuid: "93f3033d805147e9999a6f53ffa445b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb86e260560245588e5f6fd94684b6e4" is_pre_election: true
I20260812 17:47:05.212963 17351 leader_election.cc:302] T f25208e39378423f8d63c4e9cf64ef6e P 93f3033d805147e9999a6f53ffa445b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93f3033d805147e9999a6f53ffa445b6, dc06c2efd2634fd596e00495bcfe8363; no voters:
I20260812 17:47:05.213120 17236 raft_consensus.cc:2454] T f25208e39378423f8d63c4e9cf64ef6e P eb86e260560245588e5f6fd94684b6e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93f3033d805147e9999a6f53ffa445b6 in term 0.
I20260812 17:47:05.213261 17574 raft_consensus.cc:2781] T f25208e39378423f8d63c4e9cf64ef6e P 93f3033d805147e9999a6f53ffa445b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 17:47:05.213353 17574 raft_consensus.cc:482] T f25208e39378423f8d63c4e9cf64ef6e P 93f3033d805147e9999a6f53ffa445b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 17:47:05.213433 17574 raft_consensus.cc:3037] T f25208e39378423f8d63c4e9cf64ef6e P 93f3033d805147e9999a6f53ffa445b6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:05.214771 17574 raft_consensus.cc:504] T f25208e39378423f8d63c4e9cf64ef6e P 93f3033d805147e9999a6f53ffa445b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc06c2efd2634fd596e00495bcfe8363" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 39977 } } peers { permanent_uuid: "eb86e260560245588e5f6fd94684b6e4" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 42427 } } peers { permanent_uuid: "93f3033d805147e9999a6f53ffa445b6" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46499 } }
I20260812 17:47:05.215152 17574 leader_election.cc:288] T f25208e39378423f8d63c4e9cf64ef6e P 93f3033d805147e9999a6f53ffa445b6 [CANDIDATE]: Term 1 election: Requested vote from peers dc06c2efd2634fd596e00495bcfe8363 (127.17.255.1:39977), eb86e260560245588e5f6fd94684b6e4 (127.17.255.2:42427)
I20260812 17:47:05.215580 16988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f25208e39378423f8d63c4e9cf64ef6e" candidate_uuid: "93f3033d805147e9999a6f53ffa445b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc06c2efd2634fd596e00495bcfe8363"
I20260812 17:47:05.215613 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f25208e39378423f8d63c4e9cf64ef6e" candidate_uuid: "93f3033d805147e9999a6f53ffa445b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb86e260560245588e5f6fd94684b6e4"
I20260812 17:47:05.215699 16988 raft_consensus.cc:3037] T f25208e39378423f8d63c4e9cf64ef6e P dc06c2efd2634fd596e00495bcfe8363 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:05.215796 17236 raft_consensus.cc:3037] T f25208e39378423f8d63c4e9cf64ef6e P eb86e260560245588e5f6fd94684b6e4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:05.216912 16988 raft_consensus.cc:2454] T f25208e39378423f8d63c4e9cf64ef6e P dc06c2efd2634fd596e00495bcfe8363 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93f3033d805147e9999a6f53ffa445b6 in term 1.
I20260812 17:47:05.217051 17236 raft_consensus.cc:2454] T f25208e39378423f8d63c4e9cf64ef6e P eb86e260560245588e5f6fd94684b6e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93f3033d805147e9999a6f53ffa445b6 in term 1.
I20260812 17:47:05.217401 17351 leader_election.cc:302] T f25208e39378423f8d63c4e9cf64ef6e P 93f3033d805147e9999a6f53ffa445b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93f3033d805147e9999a6f53ffa445b6, dc06c2efd2634fd596e00495bcfe8363; no voters:
I20260812 17:47:05.217613 17574 raft_consensus.cc:2781] T f25208e39378423f8d63c4e9cf64ef6e P 93f3033d805147e9999a6f53ffa445b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:47:05.217876 17574 raft_consensus.cc:686] T f25208e39378423f8d63c4e9cf64ef6e P 93f3033d805147e9999a6f53ffa445b6 [term 1 LEADER]: Becoming Leader. State: Replica: 93f3033d805147e9999a6f53ffa445b6, State: Running, Role: LEADER
I20260812 17:47:05.218247 17574 consensus_queue.cc:237] T f25208e39378423f8d63c4e9cf64ef6e P 93f3033d805147e9999a6f53ffa445b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc06c2efd2634fd596e00495bcfe8363" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 39977 } } peers { permanent_uuid: "eb86e260560245588e5f6fd94684b6e4" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 42427 } } peers { permanent_uuid: "93f3033d805147e9999a6f53ffa445b6" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46499 } }
I20260812 17:47:05.221939 16691 catalog_manager.cc:5495] T f25208e39378423f8d63c4e9cf64ef6e P 93f3033d805147e9999a6f53ffa445b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93f3033d805147e9999a6f53ffa445b6 (127.17.255.3). New cstate: current_term: 1 leader_uuid: "93f3033d805147e9999a6f53ffa445b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc06c2efd2634fd596e00495bcfe8363" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 39977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb86e260560245588e5f6fd94684b6e4" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 42427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93f3033d805147e9999a6f53ffa445b6" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 46499 } health_report { overall_health: HEALTHY } } }
W20260812 17:47:05.236884 17535 tablet.cc:2369] T f25208e39378423f8d63c4e9cf64ef6e P 93f3033d805147e9999a6f53ffa445b6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 17:47:05.275508 17558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:05.271739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41976 (local address 127.17.255.3:46499)
0812 17:47:05.271891 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:05.271895 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:05.271910 (+ 15us) server_negotiation.cc:407] Connection header received
0812 17:47:05.271998 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:05.272000 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:05.272058 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:05.272152 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:47:05.272437 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:05.272950 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:05.273871 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:05.274087 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:05.274170 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:05.274528 (+ 358us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:47:05.274974 (+ 446us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:47:05.275072 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:05.275238 (+ 166us) server_negotiation.cc:299] Negotiation successful
0812 17:47:05.275317 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 17:47:05.282300 16988 raft_consensus.cc:1261] T f25208e39378423f8d63c4e9cf64ef6e P dc06c2efd2634fd596e00495bcfe8363 [term 1 FOLLOWER]: Refusing update from remote peer 93f3033d805147e9999a6f53ffa445b6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:47:05.282299 17236 raft_consensus.cc:1261] T f25208e39378423f8d63c4e9cf64ef6e P eb86e260560245588e5f6fd94684b6e4 [term 1 FOLLOWER]: Refusing update from remote peer 93f3033d805147e9999a6f53ffa445b6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:47:05.283255 17574 consensus_queue.cc:1035] T f25208e39378423f8d63c4e9cf64ef6e P 93f3033d805147e9999a6f53ffa445b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb86e260560245588e5f6fd94684b6e4" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 42427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:47:05.283587 17581 consensus_queue.cc:1035] T f25208e39378423f8d63c4e9cf64ef6e P 93f3033d805147e9999a6f53ffa445b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc06c2efd2634fd596e00495bcfe8363" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 39977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 17:47:05.284469 17314 tablet.cc:2369] T f25208e39378423f8d63c4e9cf64ef6e P eb86e260560245588e5f6fd94684b6e4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 17:47:05.291936 17588 mvcc.cc:205] Tried to move back new op lower bound from 7317736756347109376 to 7317736756097220608. Current Snapshot: MvccSnapshot[applied={T|T < 7317736756347109376}]
I20260812 17:47:05.303391 16697 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56188:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:47:05.303596 16697 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56188:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:47:05.306574 16697 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0c94d0b2ef104c88a4a496750fc77496: Sending DeleteTablet for 3 replicas of tablet f25208e39378423f8d63c4e9cf64ef6e
I20260812 17:47:05.307551 16948 tablet_service.cc:1514] Processing DeleteTablet for tablet f25208e39378423f8d63c4e9cf64ef6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:47:05 UTC) from {username='slave'} at 127.0.0.1:58482
I20260812 17:47:05.307659 17192 tablet_service.cc:1514] Processing DeleteTablet for tablet f25208e39378423f8d63c4e9cf64ef6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:47:05 UTC) from {username='slave'} at 127.0.0.1:52664
I20260812 17:47:05.308581 17425 tablet_service.cc:1514] Processing DeleteTablet for tablet f25208e39378423f8d63c4e9cf64ef6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:47:05 UTC) from {username='slave'} at 127.0.0.1:41974
I20260812 17:47:05.309116 17608 tablet_replica.cc:330] T f25208e39378423f8d63c4e9cf64ef6e P dc06c2efd2634fd596e00495bcfe8363: stopping tablet replica
I20260812 17:47:05.309430 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 16829
I20260812 17:47:05.310173 17605 tablet_replica.cc:330] T f25208e39378423f8d63c4e9cf64ef6e P eb86e260560245588e5f6fd94684b6e4: stopping tablet replica
I20260812 17:47:05.310580 17605 raft_consensus.cc:2229] T f25208e39378423f8d63c4e9cf64ef6e P eb86e260560245588e5f6fd94684b6e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:47:05.310945 17605 raft_consensus.cc:2258] T f25208e39378423f8d63c4e9cf64ef6e P eb86e260560245588e5f6fd94684b6e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:47:05.316509 17605 ts_tablet_manager.cc:1905] T f25208e39378423f8d63c4e9cf64ef6e P eb86e260560245588e5f6fd94684b6e4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:47:05.320115 17605 ts_tablet_manager.cc:1918] T f25208e39378423f8d63c4e9cf64ef6e P eb86e260560245588e5f6fd94684b6e4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 17:47:05.320228 17605 log.cc:1196] T f25208e39378423f8d63c4e9cf64ef6e P eb86e260560245588e5f6fd94684b6e4: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-1/wal/wals/f25208e39378423f8d63c4e9cf64ef6e
I20260812 17:47:05.320729 17610 tablet_replica.cc:330] T f25208e39378423f8d63c4e9cf64ef6e P 93f3033d805147e9999a6f53ffa445b6: stopping tablet replica
I20260812 17:47:05.321110 17610 raft_consensus.cc:2229] T f25208e39378423f8d63c4e9cf64ef6e P 93f3033d805147e9999a6f53ffa445b6 [term 1 LEADER]: Raft consensus shutting down.
I20260812 17:47:05.321647 17610 raft_consensus.cc:2258] T f25208e39378423f8d63c4e9cf64ef6e P 93f3033d805147e9999a6f53ffa445b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:47:05.327508 17610 ts_tablet_manager.cc:1905] T f25208e39378423f8d63c4e9cf64ef6e P 93f3033d805147e9999a6f53ffa445b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:47:05.330082 17610 ts_tablet_manager.cc:1918] T f25208e39378423f8d63c4e9cf64ef6e P 93f3033d805147e9999a6f53ffa445b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 17:47:05.330220 17610 log.cc:1196] T f25208e39378423f8d63c4e9cf64ef6e P 93f3033d805147e9999a6f53ffa445b6: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786556557564181-18428-0/minicluster-data/ts-2/wal/wals/f25208e39378423f8d63c4e9cf64ef6e
I20260812 17:47:05.330586 17605 ts_tablet_manager.cc:1939] T f25208e39378423f8d63c4e9cf64ef6e P eb86e260560245588e5f6fd94684b6e4: Deleting consensus metadata
I20260812 17:47:05.332329 16672 catalog_manager.cc:4841] TS eb86e260560245588e5f6fd94684b6e4 (127.17.255.2:42427): tablet f25208e39378423f8d63c4e9cf64ef6e (table test-table [id=8d77699fba77490dbae467439054f097]) successfully deleted
I20260812 17:47:05.332897 17610 ts_tablet_manager.cc:1939] T f25208e39378423f8d63c4e9cf64ef6e P 93f3033d805147e9999a6f53ffa445b6: Deleting consensus metadata
I20260812 17:47:05.334575 16670 catalog_manager.cc:4841] TS 93f3033d805147e9999a6f53ffa445b6 (127.17.255.3:46499): tablet f25208e39378423f8d63c4e9cf64ef6e (table test-table [id=8d77699fba77490dbae467439054f097]) successfully deleted
W20260812 17:47:05.342391 16672 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.255.1:39977 (error 108)
I20260812 17:47:05.343174 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 17078
I20260812 17:47:05.352736 17557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:05.343384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:39977 (local address 127.0.0.1:58494)
0812 17:47:05.352496 (+ 9112us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:05.352616 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.1:39977: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":8958}
W20260812 17:47:05.362425 16672 catalog_manager.cc:4584] TS dc06c2efd2634fd596e00495bcfe8363 (127.17.255.1:39977): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f25208e39378423f8d63c4e9cf64ef6e: Network error: Client connection negotiation failed: client connection to 127.17.255.1:39977: connect: Connection refused (error 111)
I20260812 17:47:05.368664 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 17317
I20260812 17:47:05.387028 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 16638
2026-08-12T17:47:05Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1350 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:47:05 dist-test-slave-tk9z krb5kdc[17616](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:47:05 dist-test-slave-tk9z krb5kdc[17616](info): set up 2 sockets
Aug 12 17:47:05 dist-test-slave-tk9z krb5kdc[17616](info): commencing operation
krb5kdc: starting...
W20260812 17:47:06.723917 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.297s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:47:06 dist-test-slave-tk9z krb5kdc[17616](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556826, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:47:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:47:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.255.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
I20260812 17:47:06.861824 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:46337
--webserver_interface=127.17.255.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:33115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:46337
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:47:06.985471 17642 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:06.985795 17642 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:06.985838 17642 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:06.990022 17642 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:47:06.990100 17642 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:06.990121 17642 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:06.990140 17642 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:47:06.990202 17642 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:47:06.995886 17642 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:33115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:46337
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:46337
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17642
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:06.997149 17642 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:06.998327 17642 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:07.007233 17653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:07.007295 17651 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:07.007426 17649 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:07.007685 17642 server_base.cc:1034] running on GCE node
I20260812 17:47:07.008318 17642 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:07.009516 17642 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:07.010743 17642 hybrid_clock.cc:648] HybridClock initialized: now 1786556827010724 us; error 38 us; skew 500 ppm
Aug 12 17:47:07 dist-test-slave-tk9z krb5kdc[17616](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556827, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:47:07.018486 17642 init.cc:377] Logged in from keytab as kudu/127.17.255.62@KRBTEST.COM (short username kudu)
I20260812 17:47:07.019621 17642 webserver.cc:460] Webserver started at http://127.17.255.62:41113/ using document root <none> and password file <none>
I20260812 17:47:07.020285 17642 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:07.020387 17642 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:07.020650 17642 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:07.023046 17642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "c22f459072db4ee288a266bd09eb9841"
format_stamp: "Formatted at 2026-08-12 17:47:07 on dist-test-slave-tk9z"
server_key: "00c77ae9d9ec4dfa63201ec6fbb0bb33"
server_key_iv: "82644ebf484945b38e8dd4e8c96a012b"
server_key_version: "encryptionkey@0"
I20260812 17:47:07.023682 17642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "c22f459072db4ee288a266bd09eb9841"
format_stamp: "Formatted at 2026-08-12 17:47:07 on dist-test-slave-tk9z"
server_key: "00c77ae9d9ec4dfa63201ec6fbb0bb33"
server_key_iv: "82644ebf484945b38e8dd4e8c96a012b"
server_key_version: "encryptionkey@0"
I20260812 17:47:07.027876 17642 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 17:47:07.030738 17662 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:07.032050 17642 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:47:07.032203 17642 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "c22f459072db4ee288a266bd09eb9841"
format_stamp: "Formatted at 2026-08-12 17:47:07 on dist-test-slave-tk9z"
server_key: "00c77ae9d9ec4dfa63201ec6fbb0bb33"
server_key_iv: "82644ebf484945b38e8dd4e8c96a012b"
server_key_version: "encryptionkey@0"
I20260812 17:47:07.032361 17642 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:07.042611 17642 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:07.045454 17642 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:07.045660 17642 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:07.053191 17642 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:46337
I20260812 17:47:07.053215 17749 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:46337 every 8 connection(s)
I20260812 17:47:07.054184 17642 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:47:07.057094 17752 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:07.060189 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 17642
I20260812 17:47:07.060400 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:47:07.060721 18428 external_mini_cluster.cc:1428] Setting key 2aed50c3f3c667d0490a34ecd19a9119
I20260812 17:47:07.063714 17752 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c22f459072db4ee288a266bd09eb9841: Bootstrap starting.
I20260812 17:47:07.066620 17752 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c22f459072db4ee288a266bd09eb9841: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:07.067476 17752 log.cc:824] T 00000000000000000000000000000000 P c22f459072db4ee288a266bd09eb9841: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:07.069614 17752 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c22f459072db4ee288a266bd09eb9841: No bootstrap required, opened a new log
Aug 12 17:47:07 dist-test-slave-tk9z krb5kdc[17616](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556826, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:47:07.073241 17752 raft_consensus.cc:348] T 00000000000000000000000000000000 P c22f459072db4ee288a266bd09eb9841 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c22f459072db4ee288a266bd09eb9841" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 46337 } }
I20260812 17:47:07.073493 17752 raft_consensus.cc:374] T 00000000000000000000000000000000 P c22f459072db4ee288a266bd09eb9841 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:47:07.073554 17752 raft_consensus.cc:729] T 00000000000000000000000000000000 P c22f459072db4ee288a266bd09eb9841 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c22f459072db4ee288a266bd09eb9841, State: Initialized, Role: FOLLOWER
I20260812 17:47:07.074080 17752 consensus_queue.cc:260] T 00000000000000000000000000000000 P c22f459072db4ee288a266bd09eb9841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c22f459072db4ee288a266bd09eb9841" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 46337 } }
I20260812 17:47:07.074268 17752 raft_consensus.cc:388] T 00000000000000000000000000000000 P c22f459072db4ee288a266bd09eb9841 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:47:07.074362 17752 raft_consensus.cc:482] T 00000000000000000000000000000000 P c22f459072db4ee288a266bd09eb9841 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:47:07.074527 17752 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c22f459072db4ee288a266bd09eb9841 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:07.075700 17752 raft_consensus.cc:504] T 00000000000000000000000000000000 P c22f459072db4ee288a266bd09eb9841 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c22f459072db4ee288a266bd09eb9841" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 46337 } }
I20260812 17:47:07.076129 17752 leader_election.cc:302] T 00000000000000000000000000000000 P c22f459072db4ee288a266bd09eb9841 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c22f459072db4ee288a266bd09eb9841; no voters:
I20260812 17:47:07.076534 17752 leader_election.cc:288] T 00000000000000000000000000000000 P c22f459072db4ee288a266bd09eb9841 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:47:07.076622 17762 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c22f459072db4ee288a266bd09eb9841 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:47:07.076846 17762 raft_consensus.cc:686] T 00000000000000000000000000000000 P c22f459072db4ee288a266bd09eb9841 [term 1 LEADER]: Becoming Leader. State: Replica: c22f459072db4ee288a266bd09eb9841, State: Running, Role: LEADER
I20260812 17:47:07.077173 17762 consensus_queue.cc:237] T 00000000000000000000000000000000 P c22f459072db4ee288a266bd09eb9841 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c22f459072db4ee288a266bd09eb9841" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 46337 } }
I20260812 17:47:07.077354 17759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:07.062301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46474 (local address 127.17.255.62:46337)
0812 17:47:07.062816 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:07.062837 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:07.062882 (+ 45us) server_negotiation.cc:407] Connection header received
0812 17:47:07.063715 (+ 833us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:07.063741 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:07.064185 (+ 444us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:07.064580 (+ 395us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:07.065305 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:07.066848 (+ 1543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:07.067782 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:07.068373 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:07.068537 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:07.071363 (+ 2826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:07.071369 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:07.071384 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:07.071413 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:07.073834 (+ 2421us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:07.074428 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:07.074434 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:07.074445 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:07.074639 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:07.074956 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:07.074959 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:07.074960 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:07.075366 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:07.075538 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:07.075931 (+ 393us) server_negotiation.cc:299] Negotiation successful
0812 17:47:07.076272 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":136,"threads_started":1}
I20260812 17:47:07.077943 17752 sys_catalog.cc:564] T 00000000000000000000000000000000 P c22f459072db4ee288a266bd09eb9841 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:47:07.078931 17764 sys_catalog.cc:455] T 00000000000000000000000000000000 P c22f459072db4ee288a266bd09eb9841 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c22f459072db4ee288a266bd09eb9841" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c22f459072db4ee288a266bd09eb9841" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 46337 } } }
I20260812 17:47:07.079074 17764 sys_catalog.cc:458] T 00000000000000000000000000000000 P c22f459072db4ee288a266bd09eb9841 [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:07.079309 17764 sys_catalog.cc:455] T 00000000000000000000000000000000 P c22f459072db4ee288a266bd09eb9841 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c22f459072db4ee288a266bd09eb9841. Latest consensus state: current_term: 1 leader_uuid: "c22f459072db4ee288a266bd09eb9841" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c22f459072db4ee288a266bd09eb9841" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 46337 } } }
I20260812 17:47:07.079401 17764 sys_catalog.cc:458] T 00000000000000000000000000000000 P c22f459072db4ee288a266bd09eb9841 [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:07.080067 17774 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:47:07.083166 17774 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:47:07.089241 17774 catalog_manager.cc:1347] Generated new cluster ID: b422f2f7fdcc497cb3a3769a29c39be8
I20260812 17:47:07.089342 17774 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:47:07.107870 17774 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:47:07.108928 17774 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:47:07.117537 17774 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c22f459072db4ee288a266bd09eb9841: Generated new TSK 0
I20260812 17:47:07.118268 17774 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.255.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab.
Entry for principal kudu/127.17.255.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab.
I20260812 17:47:07.153645 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.1:0
--local_ip_for_outbound_sockets=127.17.255.1
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:46337
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:33115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:47:07.276539 17803 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:07.276911 17803 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:07.276991 17803 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:07.281893 17803 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:07.281993 17803 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:07.282087 17803 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.1
I20260812 17:47:07.287907 17803 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:33115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:46337
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17803
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.1
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:07.289142 17803 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:07.290282 17803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 17:47:07.300714 17803 server_base.cc:1034] running on GCE node
W20260812 17:47:07.300673 17816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:07.300673 17814 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:07.300673 17813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:07.301409 17803 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:07.302122 17803 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:07.303311 17803 hybrid_clock.cc:648] HybridClock initialized: now 1786556827303294 us; error 39 us; skew 500 ppm
Aug 12 17:47:07 dist-test-slave-tk9z krb5kdc[17616](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556827, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:47:07.306217 17803 init.cc:377] Logged in from keytab as kudu/127.17.255.1@KRBTEST.COM (short username kudu)
I20260812 17:47:07.307224 17803 webserver.cc:460] Webserver started at http://127.17.255.1:41979/ using document root <none> and password file <none>
I20260812 17:47:07.307860 17803 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:07.307957 17803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:07.308207 17803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:07.310806 17803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-0/data/instance:
uuid: "23355e142f454ff5b07cbda108a8312d"
format_stamp: "Formatted at 2026-08-12 17:47:07 on dist-test-slave-tk9z"
server_key: "7d474b945e9b6810fc4df4caae6380e1"
server_key_iv: "9da9d89ff6dca7a60e3f8c3b751f3a9a"
server_key_version: "encryptionkey@0"
I20260812 17:47:07.311509 17803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance:
uuid: "23355e142f454ff5b07cbda108a8312d"
format_stamp: "Formatted at 2026-08-12 17:47:07 on dist-test-slave-tk9z"
server_key: "7d474b945e9b6810fc4df4caae6380e1"
server_key_iv: "9da9d89ff6dca7a60e3f8c3b751f3a9a"
server_key_version: "encryptionkey@0"
I20260812 17:47:07.315642 17803 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260812 17:47:07.318329 17828 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:07.319782 17803 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:47:07.319959 17803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-0/wal
uuid: "23355e142f454ff5b07cbda108a8312d"
format_stamp: "Formatted at 2026-08-12 17:47:07 on dist-test-slave-tk9z"
server_key: "7d474b945e9b6810fc4df4caae6380e1"
server_key_iv: "9da9d89ff6dca7a60e3f8c3b751f3a9a"
server_key_version: "encryptionkey@0"
I20260812 17:47:07.320092 17803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:07.338187 17803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:07.341528 17803 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:07.341749 17803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:07.342446 17803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:47:07.343349 17803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:47:07.343432 17803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:07.343526 17803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:47:07.343571 17803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:07.353111 17803 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.1:32855
I20260812 17:47:07.353132 18054 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.1:32855 every 8 connection(s)
I20260812 17:47:07.354121 17803 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
I20260812 17:47:07.362350 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 17803
I20260812 17:47:07.362625 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance
I20260812 17:47:07.362999 18428 external_mini_cluster.cc:1428] Setting key 576d61be74b1423ad667dee08449aacb
Aug 12 17:47:07 dist-test-slave-tk9z krb5kdc[17616](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556827, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:47:07.369674 17759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:07.356217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:43373 (local address 127.17.255.62:46337)
0812 17:47:07.356366 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:07.356371 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:07.357273 (+ 902us) server_negotiation.cc:407] Connection header received
0812 17:47:07.358804 (+ 1531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:07.358808 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:07.358880 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:07.358975 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:07.360265 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:07.360816 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:07.362139 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:07.362458 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:07.362577 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:07.365762 (+ 3185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:07.365766 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:07.365769 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:07.365795 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:07.367327 (+ 1532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:07.367904 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:07.367909 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:07.367911 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:07.368004 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:07.368434 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:07.368438 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:07.368439 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:07.368644 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:07.368741 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:07.369427 (+ 686us) server_negotiation.cc:299] Negotiation successful
0812 17:47:07.369547 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 17:47:07.371197 18058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:07.356561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:46337 (local address 127.17.255.1:43373)
0812 17:47:07.357082 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:07.357130 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:07.358535 (+ 1405us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:07.359174 (+ 639us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:07.359182 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:07.359573 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:47:07.360093 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:07.360107 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:07.360953 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:07.360962 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:07.361987 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:07.361998 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:07.362666 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:07.362671 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:07.362939 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:07.363778 (+ 839us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:47:07.363800 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:47:07.365573 (+ 1773us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:47:07.367460 (+ 1887us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:07.367493 (+ 33us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:07.367513 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:07.367797 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:07.368107 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:07.368113 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:07.368118 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:07.368324 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:07.368768 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:47:07.368779 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:47:07.369152 (+ 373us) client_negotiation.cc:769] Sending connection context
0812 17:47:07.369382 (+ 230us) client_negotiation.cc:240] Negotiation successful
0812 17:47:07.369928 (+ 546us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":139,"threads_started":1}
I20260812 17:47:07.372670 18056 heartbeater.cc:347] Connected to a master server at 127.17.255.62:46337
I20260812 17:47:07.372934 18056 heartbeater.cc:464] Registering TS with master...
I20260812 17:47:07.373486 18056 heartbeater.cc:511] Master 127.17.255.62:46337 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.17.255.2@KRBTEST.COM; defaulting to no policy
I20260812 17:47:07.375219 17692 ts_manager.cc:194] Registered new tserver with Master: 23355e142f454ff5b07cbda108a8312d (127.17.255.1:32855)
I20260812 17:47:07.376667 17692 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.1@KRBTEST.COM'} at 127.17.255.1:43373
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab.
Entry for principal kudu/127.17.255.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab.
I20260812 17:47:07.394279 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.2:0
--local_ip_for_outbound_sockets=127.17.255.2
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:46337
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:33115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:47:07.513001 18065 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:07.513355 18065 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:07.513453 18065 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:07.517990 18065 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:07.518105 18065 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:07.518210 18065 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.2
I20260812 17:47:07.524308 18065 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:33115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:46337
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18065
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.2
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:07.525516 18065 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:07.526634 18065 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:07.536676 18081 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:07.536676 18076 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:07.536674 18077 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:07.537046 18065 server_base.cc:1034] running on GCE node
I20260812 17:47:07.537518 18065 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:07.538249 18065 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:07.539448 18065 hybrid_clock.cc:648] HybridClock initialized: now 1786556827539408 us; error 56 us; skew 500 ppm
Aug 12 17:47:07 dist-test-slave-tk9z krb5kdc[17616](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556827, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:47:07.542481 18065 init.cc:377] Logged in from keytab as kudu/127.17.255.2@KRBTEST.COM (short username kudu)
I20260812 17:47:07.543442 18065 webserver.cc:460] Webserver started at http://127.17.255.2:33457/ using document root <none> and password file <none>
I20260812 17:47:07.544056 18065 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:07.544121 18065 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:07.544371 18065 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:07.546622 18065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-1/data/instance:
uuid: "6c618e8cf14243ccbba9d53b6e8c2552"
format_stamp: "Formatted at 2026-08-12 17:47:07 on dist-test-slave-tk9z"
server_key: "cab430470b4a48c3de47b3c24ff17b41"
server_key_iv: "9b13b18e1e3a752d26e8fac6ef31cb3c"
server_key_version: "encryptionkey@0"
I20260812 17:47:07.547210 18065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance:
uuid: "6c618e8cf14243ccbba9d53b6e8c2552"
format_stamp: "Formatted at 2026-08-12 17:47:07 on dist-test-slave-tk9z"
server_key: "cab430470b4a48c3de47b3c24ff17b41"
server_key_iv: "9b13b18e1e3a752d26e8fac6ef31cb3c"
server_key_version: "encryptionkey@0"
I20260812 17:47:07.551226 18065 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 17:47:07.553839 18091 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:07.555127 18065 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 17:47:07.555254 18065 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-1/wal
uuid: "6c618e8cf14243ccbba9d53b6e8c2552"
format_stamp: "Formatted at 2026-08-12 17:47:07 on dist-test-slave-tk9z"
server_key: "cab430470b4a48c3de47b3c24ff17b41"
server_key_iv: "9b13b18e1e3a752d26e8fac6ef31cb3c"
server_key_version: "encryptionkey@0"
I20260812 17:47:07.555373 18065 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:07.588488 18065 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:07.592236 18065 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:07.592474 18065 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:07.593182 18065 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:47:07.594198 18065 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:47:07.594254 18065 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:07.594336 18065 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:47:07.594409 18065 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260812 17:47:07.604734 18065 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.2:35697
I20260812 17:47:07.604759 18289 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.2:35697 every 8 connection(s)
I20260812 17:47:07.605885 18065 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
I20260812 17:47:07.612488 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 18065
I20260812 17:47:07.612612 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance
I20260812 17:47:07.613046 18428 external_mini_cluster.cc:1428] Setting key e09e1a6d216062e9f46d99e865db516b
Aug 12 17:47:07 dist-test-slave-tk9z krb5kdc[17616](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556827, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:47:07.621963 17759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:07.607958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:34121 (local address 127.17.255.62:46337)
0812 17:47:07.608114 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:07.608119 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:07.609021 (+ 902us) server_negotiation.cc:407] Connection header received
0812 17:47:07.610549 (+ 1528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:07.610560 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:07.610615 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:07.610696 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:07.612063 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:07.612694 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:07.614304 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:07.614591 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:07.614697 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:07.617815 (+ 3118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:07.617821 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:07.617826 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:07.617862 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:07.619645 (+ 1783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:07.620159 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:07.620166 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:07.620171 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:07.620275 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:07.620636 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:07.620642 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:07.620647 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:07.620926 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:07.621048 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:07.621555 (+ 507us) server_negotiation.cc:299] Negotiation successful
0812 17:47:07.621709 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 17:47:07.622777 18294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:07.608352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:46337 (local address 127.17.255.2:34121)
0812 17:47:07.608848 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:07.608898 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:07.610230 (+ 1332us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:07.610919 (+ 689us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:07.610927 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:07.611331 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:47:07.611895 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:07.611911 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:07.612853 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:07.612859 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:07.614176 (+ 1317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:07.614188 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:07.614791 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:07.614796 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:07.615002 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:07.615701 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:47:07.615719 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:47:07.617582 (+ 1863us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:47:07.619765 (+ 2183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:07.619770 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:07.619783 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:07.620055 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:07.620385 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:07.620387 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:07.620389 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:07.620532 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:07.621041 (+ 509us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:47:07.621047 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:47:07.621299 (+ 252us) client_negotiation.cc:769] Sending connection context
0812 17:47:07.621462 (+ 163us) client_negotiation.cc:240] Negotiation successful
0812 17:47:07.621760 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":113,"threads_started":1}
I20260812 17:47:07.624162 18290 heartbeater.cc:347] Connected to a master server at 127.17.255.62:46337
I20260812 17:47:07.624468 18290 heartbeater.cc:464] Registering TS with master...
I20260812 17:47:07.625214 18290 heartbeater.cc:511] Master 127.17.255.62:46337 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.17.255.3@KRBTEST.COM; defaulting to no policy
I20260812 17:47:07.626488 17692 ts_manager.cc:194] Registered new tserver with Master: 6c618e8cf14243ccbba9d53b6e8c2552 (127.17.255.2:35697)
I20260812 17:47:07.627084 17692 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.2@KRBTEST.COM'} at 127.17.255.2:34121
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab.
Entry for principal kudu/127.17.255.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab.
I20260812 17:47:07.645601 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.3:0
--local_ip_for_outbound_sockets=127.17.255.3
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:46337
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:33115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:47:07.771004 18299 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:07.771322 18299 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:07.771366 18299 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:07.775619 18299 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:07.775698 18299 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:07.775763 18299 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.3
I20260812 17:47:07.781625 18299 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:33115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:46337
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18299
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.3
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:07.782889 18299 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:07.783982 18299 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:07.794660 18311 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:07.794708 18307 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:07.794659 18305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:07.794659 18299 server_base.cc:1034] running on GCE node
I20260812 17:47:07.795454 18299 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:07.796191 18299 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:07.797399 18299 hybrid_clock.cc:648] HybridClock initialized: now 1786556827797380 us; error 35 us; skew 500 ppm
Aug 12 17:47:07 dist-test-slave-tk9z krb5kdc[17616](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556827, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:47:07.800647 18299 init.cc:377] Logged in from keytab as kudu/127.17.255.3@KRBTEST.COM (short username kudu)
I20260812 17:47:07.801679 18299 webserver.cc:460] Webserver started at http://127.17.255.3:46865/ using document root <none> and password file <none>
I20260812 17:47:07.802327 18299 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:07.802464 18299 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:07.802718 18299 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:07.805027 18299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-2/data/instance:
uuid: "cd2371f18ed54f07b8e2fe4d246989ed"
format_stamp: "Formatted at 2026-08-12 17:47:07 on dist-test-slave-tk9z"
server_key: "6b79b09831108e5eed2b99fe17c7b18e"
server_key_iv: "1f834a185bfa00028087c10b25906aed"
server_key_version: "encryptionkey@0"
I20260812 17:47:07.805660 18299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance:
uuid: "cd2371f18ed54f07b8e2fe4d246989ed"
format_stamp: "Formatted at 2026-08-12 17:47:07 on dist-test-slave-tk9z"
server_key: "6b79b09831108e5eed2b99fe17c7b18e"
server_key_iv: "1f834a185bfa00028087c10b25906aed"
server_key_version: "encryptionkey@0"
I20260812 17:47:07.809767 18299 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260812 17:47:07.812608 18318 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:07.814170 18299 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 17:47:07.814330 18299 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-2/wal
uuid: "cd2371f18ed54f07b8e2fe4d246989ed"
format_stamp: "Formatted at 2026-08-12 17:47:07 on dist-test-slave-tk9z"
server_key: "6b79b09831108e5eed2b99fe17c7b18e"
server_key_iv: "1f834a185bfa00028087c10b25906aed"
server_key_version: "encryptionkey@0"
I20260812 17:47:07.814486 18299 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:07.829488 18299 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:07.832741 18299 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:07.832971 18299 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:07.833635 18299 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:47:07.834610 18299 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:47:07.834681 18299 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:07.834748 18299 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:47:07.834789 18299 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:07.844264 18299 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.3:36313
I20260812 17:47:07.844290 18541 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.3:36313 every 8 connection(s)
I20260812 17:47:07.845229 18299 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
I20260812 17:47:07.854336 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 18299
I20260812 17:47:07.854545 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance
I20260812 17:47:07.854912 18428 external_mini_cluster.cc:1428] Setting key 41539ab21b3aa474c701b3d43ded9ba4
Aug 12 17:47:07 dist-test-slave-tk9z krb5kdc[17616](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556827, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:47:07.859862 17759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:07.847263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:41927 (local address 127.17.255.62:46337)
0812 17:47:07.847418 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:07.847422 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:07.848310 (+ 888us) server_negotiation.cc:407] Connection header received
0812 17:47:07.849642 (+ 1332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:07.849645 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:07.849697 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:07.849773 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:07.851092 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:07.851621 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:07.852800 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:07.853018 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:07.853101 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:07.856071 (+ 2970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:07.856075 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:07.856078 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:07.856106 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:07.857603 (+ 1497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:07.858159 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:07.858163 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:07.858164 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:07.858244 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:07.858646 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:07.858651 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:07.858652 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:07.858908 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:07.859016 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:07.859571 (+ 555us) server_negotiation.cc:299] Negotiation successful
0812 17:47:07.859702 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 17:47:07.860746 18544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:07.847658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:46337 (local address 127.17.255.3:41927)
0812 17:47:07.848144 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:07.848189 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:07.849432 (+ 1243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:07.849969 (+ 537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:07.849976 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:07.850363 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:47:07.850958 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:07.850974 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:07.851737 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:07.851740 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:07.852675 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:07.852685 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:07.853152 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:07.853154 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:07.853299 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:07.853887 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:47:07.853905 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:47:07.855904 (+ 1999us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:47:07.857729 (+ 1825us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:07.857736 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:07.857754 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:07.858042 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:07.858336 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:07.858339 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:07.858341 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:07.858546 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:07.859023 (+ 477us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:47:07.859032 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:47:07.859307 (+ 275us) client_negotiation.cc:769] Sending connection context
0812 17:47:07.859503 (+ 196us) client_negotiation.cc:240] Negotiation successful
0812 17:47:07.859864 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":126,"threads_started":1}
I20260812 17:47:07.861900 18542 heartbeater.cc:347] Connected to a master server at 127.17.255.62:46337
I20260812 17:47:07.862128 18542 heartbeater.cc:464] Registering TS with master...
I20260812 17:47:07.862752 18542 heartbeater.cc:511] Master 127.17.255.62:46337 requested a full tablet report, sending...
I20260812 17:47:07.863783 17692 ts_manager.cc:194] Registered new tserver with Master: cd2371f18ed54f07b8e2fe4d246989ed (127.17.255.3:36313)
I20260812 17:47:07.864409 17692 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.3@KRBTEST.COM'} at 127.17.255.3:41927
I20260812 17:47:07.869108 18428 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 17:47:07.879071 17759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:07.871254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46490 (local address 127.17.255.62:46337)
0812 17:47:07.871413 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:07.871423 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:07.871529 (+ 106us) server_negotiation.cc:407] Connection header received
0812 17:47:07.871682 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:07.871686 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:07.871733 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:07.871811 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:07.872544 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:07.873079 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:07.873960 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:07.874167 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:07.874242 (+ 75us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:07.875840 (+ 1598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:07.875843 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:07.875845 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:07.875868 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:07.877291 (+ 1423us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:07.877809 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:07.877812 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:07.877813 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:07.877886 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:07.878145 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:07.878147 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:07.878148 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:07.878330 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:07.878522 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:07.878757 (+ 235us) server_negotiation.cc:299] Negotiation successful
0812 17:47:07.878880 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 17:47:07.882555 17692 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46490:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 17:47:07.885707 17692 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 17:47:07.900990 18568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:07.895159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39248 (local address 127.17.255.1:32855)
0812 17:47:07.896029 (+ 870us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:07.896037 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:07.896063 (+ 26us) server_negotiation.cc:407] Connection header received
0812 17:47:07.896145 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:07.896152 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:07.896372 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:07.896539 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:47:07.896887 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:07.898073 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:07.899478 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:07.900303 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:07.900399 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:07.900562 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:07.900730 (+ 168us) server_negotiation.cc:299] Negotiation successful
0812 17:47:07.900837 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":737,"thread_start_us":107,"threads_started":1}
I20260812 17:47:07.900980 18572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:07.894992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:32855 (local address 127.0.0.1:39248)
0812 17:47:07.895703 (+ 711us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:07.895782 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:07.895924 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:07.896542 (+ 618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:07.896549 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:07.896579 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:47:07.896749 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:07.896758 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:07.898191 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:07.898194 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:07.899328 (+ 1134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:07.899341 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:07.900396 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:07.900399 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:07.900514 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:07.900554 (+ 40us) client_negotiation.cc:769] Sending connection context
0812 17:47:07.900692 (+ 138us) client_negotiation.cc:240] Negotiation successful
0812 17:47:07.900825 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":97,"threads_started":1}
I20260812 17:47:07.901863 18573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:07.895394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.3:36313 (local address 127.0.0.1:50798)
0812 17:47:07.896780 (+ 1386us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:07.896795 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:07.896886 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:07.897353 (+ 467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:07.897356 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:07.897374 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:47:07.897480 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:07.897489 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:07.898992 (+ 1503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:07.898995 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:07.900170 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:07.900182 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:07.901344 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:07.901348 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:07.901490 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:07.901543 (+ 53us) client_negotiation.cc:769] Sending connection context
0812 17:47:07.901613 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 17:47:07.901706 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1323,"mutex_wait_us":61,"thread_start_us":85,"threads_started":1}
I20260812 17:47:07.901918 18574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:07.895837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58544 (local address 127.17.255.2:35697)
0812 17:47:07.896406 (+ 569us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:07.896416 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:07.896642 (+ 226us) server_negotiation.cc:407] Connection header received
0812 17:47:07.896886 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:07.896892 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:07.897094 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:07.897221 (+ 127us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:47:07.897652 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:07.898829 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:07.900182 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:07.901025 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:07.901139 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:07.901275 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:07.901668 (+ 393us) server_negotiation.cc:299] Negotiation successful
0812 17:47:07.901778 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":453,"thread_start_us":124,"threads_started":1}
I20260812 17:47:07.901863 18564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:07.895155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:35697 (local address 127.0.0.1:58544)
0812 17:47:07.896552 (+ 1397us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:07.896565 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:07.896710 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:07.897431 (+ 721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:07.897434 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:07.897453 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:47:07.897545 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:07.897551 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:07.899023 (+ 1472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:07.899026 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:07.900058 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:07.900068 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:07.901344 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:07.901348 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:07.901494 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:07.901533 (+ 39us) client_negotiation.cc:769] Sending connection context
0812 17:47:07.901613 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 17:47:07.901706 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1334,"mutex_wait_us":61,"thread_start_us":163,"threads_started":1}
I20260812 17:47:07.902418 18575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:07.895821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50798 (local address 127.17.255.3:36313)
0812 17:47:07.896286 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:07.896296 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:07.897004 (+ 708us) server_negotiation.cc:407] Connection header received
0812 17:47:07.897077 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:07.897081 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:07.897225 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:07.897376 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:47:07.897597 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:07.898829 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:07.900293 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:07.901051 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:07.901143 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:07.901275 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:07.902120 (+ 845us) server_negotiation.cc:299] Negotiation successful
0812 17:47:07.902230 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":152,"threads_started":1}
I20260812 17:47:07.904966 18420 tablet_service.cc:1467] Processing CreateTablet for tablet 84b7a851da234782bc4739b6093b7f22 (DEFAULT_TABLE table=test-table [id=32c6053a57774f4bad56cde8b48ff15b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:47:07.904793 17924 tablet_service.cc:1467] Processing CreateTablet for tablet 84b7a851da234782bc4739b6093b7f22 (DEFAULT_TABLE table=test-table [id=32c6053a57774f4bad56cde8b48ff15b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:47:07.905148 18176 tablet_service.cc:1467] Processing CreateTablet for tablet 84b7a851da234782bc4739b6093b7f22 (DEFAULT_TABLE table=test-table [id=32c6053a57774f4bad56cde8b48ff15b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:47:07.906006 18420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84b7a851da234782bc4739b6093b7f22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:07.906011 17924 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84b7a851da234782bc4739b6093b7f22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:07.906010 18176 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84b7a851da234782bc4739b6093b7f22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:07.913441 18582 tablet_bootstrap.cc:492] T 84b7a851da234782bc4739b6093b7f22 P 6c618e8cf14243ccbba9d53b6e8c2552: Bootstrap starting.
I20260812 17:47:07.914765 18578 tablet_bootstrap.cc:492] T 84b7a851da234782bc4739b6093b7f22 P cd2371f18ed54f07b8e2fe4d246989ed: Bootstrap starting.
I20260812 17:47:07.916661 18582 tablet_bootstrap.cc:654] T 84b7a851da234782bc4739b6093b7f22 P 6c618e8cf14243ccbba9d53b6e8c2552: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:07.917049 18578 tablet_bootstrap.cc:654] T 84b7a851da234782bc4739b6093b7f22 P cd2371f18ed54f07b8e2fe4d246989ed: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:07.917151 18580 tablet_bootstrap.cc:492] T 84b7a851da234782bc4739b6093b7f22 P 23355e142f454ff5b07cbda108a8312d: Bootstrap starting.
I20260812 17:47:07.917721 18582 log.cc:824] T 84b7a851da234782bc4739b6093b7f22 P 6c618e8cf14243ccbba9d53b6e8c2552: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:07.918385 18578 log.cc:824] T 84b7a851da234782bc4739b6093b7f22 P cd2371f18ed54f07b8e2fe4d246989ed: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:07.919335 18580 tablet_bootstrap.cc:654] T 84b7a851da234782bc4739b6093b7f22 P 23355e142f454ff5b07cbda108a8312d: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:07.920221 18580 log.cc:824] T 84b7a851da234782bc4739b6093b7f22 P 23355e142f454ff5b07cbda108a8312d: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:07.920536 18578 tablet_bootstrap.cc:492] T 84b7a851da234782bc4739b6093b7f22 P cd2371f18ed54f07b8e2fe4d246989ed: No bootstrap required, opened a new log
I20260812 17:47:07.920599 18582 tablet_bootstrap.cc:492] T 84b7a851da234782bc4739b6093b7f22 P 6c618e8cf14243ccbba9d53b6e8c2552: No bootstrap required, opened a new log
I20260812 17:47:07.920780 18578 ts_tablet_manager.cc:1397] T 84b7a851da234782bc4739b6093b7f22 P cd2371f18ed54f07b8e2fe4d246989ed: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 17:47:07.920799 18582 ts_tablet_manager.cc:1397] T 84b7a851da234782bc4739b6093b7f22 P 6c618e8cf14243ccbba9d53b6e8c2552: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260812 17:47:07.922314 18580 tablet_bootstrap.cc:492] T 84b7a851da234782bc4739b6093b7f22 P 23355e142f454ff5b07cbda108a8312d: No bootstrap required, opened a new log
I20260812 17:47:07.922564 18580 ts_tablet_manager.cc:1397] T 84b7a851da234782bc4739b6093b7f22 P 23355e142f454ff5b07cbda108a8312d: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.001s
I20260812 17:47:07.924433 18578 raft_consensus.cc:348] T 84b7a851da234782bc4739b6093b7f22 P cd2371f18ed54f07b8e2fe4d246989ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23355e142f454ff5b07cbda108a8312d" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 32855 } } peers { permanent_uuid: "6c618e8cf14243ccbba9d53b6e8c2552" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 35697 } } peers { permanent_uuid: "cd2371f18ed54f07b8e2fe4d246989ed" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36313 } }
I20260812 17:47:07.924829 18578 raft_consensus.cc:374] T 84b7a851da234782bc4739b6093b7f22 P cd2371f18ed54f07b8e2fe4d246989ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:47:07.924918 18578 raft_consensus.cc:729] T 84b7a851da234782bc4739b6093b7f22 P cd2371f18ed54f07b8e2fe4d246989ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd2371f18ed54f07b8e2fe4d246989ed, State: Initialized, Role: FOLLOWER
I20260812 17:47:07.925504 18578 consensus_queue.cc:260] T 84b7a851da234782bc4739b6093b7f22 P cd2371f18ed54f07b8e2fe4d246989ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23355e142f454ff5b07cbda108a8312d" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 32855 } } peers { permanent_uuid: "6c618e8cf14243ccbba9d53b6e8c2552" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 35697 } } peers { permanent_uuid: "cd2371f18ed54f07b8e2fe4d246989ed" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36313 } }
I20260812 17:47:07.926128 18582 raft_consensus.cc:348] T 84b7a851da234782bc4739b6093b7f22 P 6c618e8cf14243ccbba9d53b6e8c2552 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23355e142f454ff5b07cbda108a8312d" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 32855 } } peers { permanent_uuid: "6c618e8cf14243ccbba9d53b6e8c2552" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 35697 } } peers { permanent_uuid: "cd2371f18ed54f07b8e2fe4d246989ed" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36313 } }
I20260812 17:47:07.926515 18582 raft_consensus.cc:374] T 84b7a851da234782bc4739b6093b7f22 P 6c618e8cf14243ccbba9d53b6e8c2552 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:47:07.926625 18582 raft_consensus.cc:729] T 84b7a851da234782bc4739b6093b7f22 P 6c618e8cf14243ccbba9d53b6e8c2552 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c618e8cf14243ccbba9d53b6e8c2552, State: Initialized, Role: FOLLOWER
I20260812 17:47:07.926811 18578 ts_tablet_manager.cc:1428] T 84b7a851da234782bc4739b6093b7f22 P cd2371f18ed54f07b8e2fe4d246989ed: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260812 17:47:07.927253 18542 heartbeater.cc:503] Master 127.17.255.62:46337 was elected leader, sending a full tablet report...
I20260812 17:47:07.927182 18582 consensus_queue.cc:260] T 84b7a851da234782bc4739b6093b7f22 P 6c618e8cf14243ccbba9d53b6e8c2552 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23355e142f454ff5b07cbda108a8312d" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 32855 } } peers { permanent_uuid: "6c618e8cf14243ccbba9d53b6e8c2552" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 35697 } } peers { permanent_uuid: "cd2371f18ed54f07b8e2fe4d246989ed" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36313 } }
I20260812 17:47:07.928020 18290 heartbeater.cc:503] Master 127.17.255.62:46337 was elected leader, sending a full tablet report...
I20260812 17:47:07.928279 18582 ts_tablet_manager.cc:1428] T 84b7a851da234782bc4739b6093b7f22 P 6c618e8cf14243ccbba9d53b6e8c2552: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260812 17:47:07.928143 18580 raft_consensus.cc:348] T 84b7a851da234782bc4739b6093b7f22 P 23355e142f454ff5b07cbda108a8312d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23355e142f454ff5b07cbda108a8312d" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 32855 } } peers { permanent_uuid: "6c618e8cf14243ccbba9d53b6e8c2552" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 35697 } } peers { permanent_uuid: "cd2371f18ed54f07b8e2fe4d246989ed" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36313 } }
I20260812 17:47:07.928413 18580 raft_consensus.cc:374] T 84b7a851da234782bc4739b6093b7f22 P 23355e142f454ff5b07cbda108a8312d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:47:07.928498 18580 raft_consensus.cc:729] T 84b7a851da234782bc4739b6093b7f22 P 23355e142f454ff5b07cbda108a8312d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23355e142f454ff5b07cbda108a8312d, State: Initialized, Role: FOLLOWER
I20260812 17:47:07.928987 18580 consensus_queue.cc:260] T 84b7a851da234782bc4739b6093b7f22 P 23355e142f454ff5b07cbda108a8312d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23355e142f454ff5b07cbda108a8312d" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 32855 } } peers { permanent_uuid: "6c618e8cf14243ccbba9d53b6e8c2552" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 35697 } } peers { permanent_uuid: "cd2371f18ed54f07b8e2fe4d246989ed" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36313 } }
I20260812 17:47:07.929684 18056 heartbeater.cc:503] Master 127.17.255.62:46337 was elected leader, sending a full tablet report...
I20260812 17:47:07.929981 18580 ts_tablet_manager.cc:1428] T 84b7a851da234782bc4739b6093b7f22 P 23355e142f454ff5b07cbda108a8312d: Time spent starting tablet: real 0.007s user 0.000s sys 0.006s
I20260812 17:47:07.937722 18591 raft_consensus.cc:482] T 84b7a851da234782bc4739b6093b7f22 P cd2371f18ed54f07b8e2fe4d246989ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:47:07.937991 18591 raft_consensus.cc:504] T 84b7a851da234782bc4739b6093b7f22 P cd2371f18ed54f07b8e2fe4d246989ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23355e142f454ff5b07cbda108a8312d" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 32855 } } peers { permanent_uuid: "6c618e8cf14243ccbba9d53b6e8c2552" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 35697 } } peers { permanent_uuid: "cd2371f18ed54f07b8e2fe4d246989ed" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36313 } }
I20260812 17:47:07.939263 18591 leader_election.cc:288] T 84b7a851da234782bc4739b6093b7f22 P cd2371f18ed54f07b8e2fe4d246989ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23355e142f454ff5b07cbda108a8312d (127.17.255.1:32855), 6c618e8cf14243ccbba9d53b6e8c2552 (127.17.255.2:35697)
I20260812 17:47:07.943277 18568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:07.939778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:36271 (local address 127.17.255.1:32855)
0812 17:47:07.939901 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:07.939906 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:07.939921 (+ 15us) server_negotiation.cc:407] Connection header received
0812 17:47:07.939972 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:07.939976 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:07.940038 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:07.940122 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:47:07.940517 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:07.941072 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:07.942198 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:07.942647 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:07.942764 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:07.942821 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:07.943064 (+ 243us) server_negotiation.cc:299] Negotiation successful
0812 17:47:07.943142 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 17:47:07.943277 18574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:07.939795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:43761 (local address 127.17.255.2:35697)
0812 17:47:07.939913 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:07.939917 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:07.940141 (+ 224us) server_negotiation.cc:407] Connection header received
0812 17:47:07.940203 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:07.940206 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:07.940268 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:07.940363 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:47:07.940643 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:07.941133 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:07.942193 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:07.942669 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:07.942802 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:07.942857 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:07.943058 (+ 201us) server_negotiation.cc:299] Negotiation successful
0812 17:47:07.943142 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 17:47:07.943285 18544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:07.939459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:32855 (local address 127.17.255.3:36271)
0812 17:47:07.939590 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:07.939609 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:07.939716 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:07.940179 (+ 463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:07.940182 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:07.940206 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:47:07.940359 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:07.940367 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:07.941190 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:07.941196 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:07.942061 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:07.942071 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:07.942769 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:07.942773 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:07.942891 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:07.942953 (+ 62us) client_negotiation.cc:769] Sending connection context
0812 17:47:07.943042 (+ 89us) client_negotiation.cc:240] Negotiation successful
0812 17:47:07.943155 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":67}
I20260812 17:47:07.943295 18594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:07.939527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:35697 (local address 127.17.255.3:43761)
0812 17:47:07.939963 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:07.939996 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:07.940109 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:07.940379 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:07.940381 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:07.940396 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:47:07.940545 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:07.940551 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:07.941246 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:07.941249 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:07.942063 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:07.942072 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:07.942807 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:07.942810 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:07.942924 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:07.942948 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 17:47:07.943041 (+ 93us) client_negotiation.cc:240] Negotiation successful
0812 17:47:07.943142 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":369,"mutex_wait_us":19,"thread_start_us":134,"threads_started":1}
I20260812 17:47:07.943976 18211 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84b7a851da234782bc4739b6093b7f22" candidate_uuid: "cd2371f18ed54f07b8e2fe4d246989ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c618e8cf14243ccbba9d53b6e8c2552" is_pre_election: true
I20260812 17:47:07.944159 17963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84b7a851da234782bc4739b6093b7f22" candidate_uuid: "cd2371f18ed54f07b8e2fe4d246989ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23355e142f454ff5b07cbda108a8312d" is_pre_election: true
I20260812 17:47:07.944322 18211 raft_consensus.cc:2454] T 84b7a851da234782bc4739b6093b7f22 P 6c618e8cf14243ccbba9d53b6e8c2552 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd2371f18ed54f07b8e2fe4d246989ed in term 0.
I20260812 17:47:07.944509 17963 raft_consensus.cc:2454] T 84b7a851da234782bc4739b6093b7f22 P 23355e142f454ff5b07cbda108a8312d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd2371f18ed54f07b8e2fe4d246989ed in term 0.
I20260812 17:47:07.944933 18321 leader_election.cc:302] T 84b7a851da234782bc4739b6093b7f22 P cd2371f18ed54f07b8e2fe4d246989ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c618e8cf14243ccbba9d53b6e8c2552, cd2371f18ed54f07b8e2fe4d246989ed; no voters:
I20260812 17:47:07.945226 18591 raft_consensus.cc:2781] T 84b7a851da234782bc4739b6093b7f22 P cd2371f18ed54f07b8e2fe4d246989ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 17:47:07.945319 18591 raft_consensus.cc:482] T 84b7a851da234782bc4739b6093b7f22 P cd2371f18ed54f07b8e2fe4d246989ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 17:47:07.945379 18591 raft_consensus.cc:3037] T 84b7a851da234782bc4739b6093b7f22 P cd2371f18ed54f07b8e2fe4d246989ed [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:07.946476 18591 raft_consensus.cc:504] T 84b7a851da234782bc4739b6093b7f22 P cd2371f18ed54f07b8e2fe4d246989ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23355e142f454ff5b07cbda108a8312d" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 32855 } } peers { permanent_uuid: "6c618e8cf14243ccbba9d53b6e8c2552" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 35697 } } peers { permanent_uuid: "cd2371f18ed54f07b8e2fe4d246989ed" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36313 } }
I20260812 17:47:07.946848 18591 leader_election.cc:288] T 84b7a851da234782bc4739b6093b7f22 P cd2371f18ed54f07b8e2fe4d246989ed [CANDIDATE]: Term 1 election: Requested vote from peers 23355e142f454ff5b07cbda108a8312d (127.17.255.1:32855), 6c618e8cf14243ccbba9d53b6e8c2552 (127.17.255.2:35697)
I20260812 17:47:07.947192 17963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84b7a851da234782bc4739b6093b7f22" candidate_uuid: "cd2371f18ed54f07b8e2fe4d246989ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23355e142f454ff5b07cbda108a8312d"
I20260812 17:47:07.947232 18211 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84b7a851da234782bc4739b6093b7f22" candidate_uuid: "cd2371f18ed54f07b8e2fe4d246989ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c618e8cf14243ccbba9d53b6e8c2552"
I20260812 17:47:07.947369 18211 raft_consensus.cc:3037] T 84b7a851da234782bc4739b6093b7f22 P 6c618e8cf14243ccbba9d53b6e8c2552 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:07.947324 17963 raft_consensus.cc:3037] T 84b7a851da234782bc4739b6093b7f22 P 23355e142f454ff5b07cbda108a8312d [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:07.948449 18211 raft_consensus.cc:2454] T 84b7a851da234782bc4739b6093b7f22 P 6c618e8cf14243ccbba9d53b6e8c2552 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd2371f18ed54f07b8e2fe4d246989ed in term 1.
I20260812 17:47:07.948455 17963 raft_consensus.cc:2454] T 84b7a851da234782bc4739b6093b7f22 P 23355e142f454ff5b07cbda108a8312d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd2371f18ed54f07b8e2fe4d246989ed in term 1.
I20260812 17:47:07.948777 18321 leader_election.cc:302] T 84b7a851da234782bc4739b6093b7f22 P cd2371f18ed54f07b8e2fe4d246989ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c618e8cf14243ccbba9d53b6e8c2552, cd2371f18ed54f07b8e2fe4d246989ed; no voters:
I20260812 17:47:07.948977 18591 raft_consensus.cc:2781] T 84b7a851da234782bc4739b6093b7f22 P cd2371f18ed54f07b8e2fe4d246989ed [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:47:07.949182 18591 raft_consensus.cc:686] T 84b7a851da234782bc4739b6093b7f22 P cd2371f18ed54f07b8e2fe4d246989ed [term 1 LEADER]: Becoming Leader. State: Replica: cd2371f18ed54f07b8e2fe4d246989ed, State: Running, Role: LEADER
I20260812 17:47:07.949558 18591 consensus_queue.cc:237] T 84b7a851da234782bc4739b6093b7f22 P cd2371f18ed54f07b8e2fe4d246989ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23355e142f454ff5b07cbda108a8312d" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 32855 } } peers { permanent_uuid: "6c618e8cf14243ccbba9d53b6e8c2552" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 35697 } } peers { permanent_uuid: "cd2371f18ed54f07b8e2fe4d246989ed" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36313 } }
I20260812 17:47:07.953148 17692 catalog_manager.cc:5495] T 84b7a851da234782bc4739b6093b7f22 P cd2371f18ed54f07b8e2fe4d246989ed reported cstate change: term changed from 0 to 1, leader changed from <none> to cd2371f18ed54f07b8e2fe4d246989ed (127.17.255.3). New cstate: current_term: 1 leader_uuid: "cd2371f18ed54f07b8e2fe4d246989ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23355e142f454ff5b07cbda108a8312d" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 32855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c618e8cf14243ccbba9d53b6e8c2552" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 35697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd2371f18ed54f07b8e2fe4d246989ed" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 36313 } health_report { overall_health: HEALTHY } } }
I20260812 17:47:07.967820 18575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:07.964069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50808 (local address 127.17.255.3:36313)
0812 17:47:07.964238 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:07.964243 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:07.964264 (+ 21us) server_negotiation.cc:407] Connection header received
0812 17:47:07.964379 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:07.964381 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:07.964443 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:07.964536 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:47:07.964779 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:07.965313 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:07.966142 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:07.966356 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:07.966503 (+ 147us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:07.966907 (+ 404us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:47:07.967353 (+ 446us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:47:07.967470 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:07.967579 (+ 109us) server_negotiation.cc:299] Negotiation successful
0812 17:47:07.967616 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 17:47:07.974831 17963 raft_consensus.cc:1261] T 84b7a851da234782bc4739b6093b7f22 P 23355e142f454ff5b07cbda108a8312d [term 1 FOLLOWER]: Refusing update from remote peer cd2371f18ed54f07b8e2fe4d246989ed: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:47:07.974831 18211 raft_consensus.cc:1261] T 84b7a851da234782bc4739b6093b7f22 P 6c618e8cf14243ccbba9d53b6e8c2552 [term 1 FOLLOWER]: Refusing update from remote peer cd2371f18ed54f07b8e2fe4d246989ed: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:47:07.975575 18591 consensus_queue.cc:1035] T 84b7a851da234782bc4739b6093b7f22 P cd2371f18ed54f07b8e2fe4d246989ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c618e8cf14243ccbba9d53b6e8c2552" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 35697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:47:07.975782 18595 consensus_queue.cc:1035] T 84b7a851da234782bc4739b6093b7f22 P cd2371f18ed54f07b8e2fe4d246989ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "23355e142f454ff5b07cbda108a8312d" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 32855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:47:07.987085 18605 mvcc.cc:205] Tried to move back new op lower bound from 7317736767376527360 to 7317736767285338112. Current Snapshot: MvccSnapshot[applied={T|T < 7317736767376527360 or (T in {7317736767376527360})}]
I20260812 17:47:07.993798 17692 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46490:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:47:07.993995 17692 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46490:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:47:07.996553 17692 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c22f459072db4ee288a266bd09eb9841: Sending DeleteTablet for 3 replicas of tablet 84b7a851da234782bc4739b6093b7f22
I20260812 17:47:07.997428 17924 tablet_service.cc:1514] Processing DeleteTablet for tablet 84b7a851da234782bc4739b6093b7f22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:47:07 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:39248
I20260812 17:47:07.997541 18176 tablet_service.cc:1514] Processing DeleteTablet for tablet 84b7a851da234782bc4739b6093b7f22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:47:07 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:58544
I20260812 17:47:07.997545 18420 tablet_service.cc:1514] Processing DeleteTablet for tablet 84b7a851da234782bc4739b6093b7f22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:47:07 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:50798
I20260812 17:47:07.997996 18618 tablet_replica.cc:330] T 84b7a851da234782bc4739b6093b7f22 P 6c618e8cf14243ccbba9d53b6e8c2552: stopping tablet replica
I20260812 17:47:07.998274 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 17803
I20260812 17:47:07.998353 18618 raft_consensus.cc:2229] T 84b7a851da234782bc4739b6093b7f22 P 6c618e8cf14243ccbba9d53b6e8c2552 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:47:07.998740 18618 raft_consensus.cc:2258] T 84b7a851da234782bc4739b6093b7f22 P 6c618e8cf14243ccbba9d53b6e8c2552 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:47:08.003423 18620 tablet_replica.cc:330] T 84b7a851da234782bc4739b6093b7f22 P cd2371f18ed54f07b8e2fe4d246989ed: stopping tablet replica
I20260812 17:47:08.003839 18620 raft_consensus.cc:2229] T 84b7a851da234782bc4739b6093b7f22 P cd2371f18ed54f07b8e2fe4d246989ed [term 1 LEADER]: Raft consensus shutting down.
I20260812 17:47:08.004316 18620 raft_consensus.cc:2258] T 84b7a851da234782bc4739b6093b7f22 P cd2371f18ed54f07b8e2fe4d246989ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:47:08.009964 18620 ts_tablet_manager.cc:1905] T 84b7a851da234782bc4739b6093b7f22 P cd2371f18ed54f07b8e2fe4d246989ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:47:08.012969 18618 ts_tablet_manager.cc:1905] T 84b7a851da234782bc4739b6093b7f22 P 6c618e8cf14243ccbba9d53b6e8c2552: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:47:08.013042 18620 ts_tablet_manager.cc:1918] T 84b7a851da234782bc4739b6093b7f22 P cd2371f18ed54f07b8e2fe4d246989ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 17:47:08.013139 18620 log.cc:1196] T 84b7a851da234782bc4739b6093b7f22 P cd2371f18ed54f07b8e2fe4d246989ed: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-2/wal/wals/84b7a851da234782bc4739b6093b7f22
I20260812 17:47:08.013494 18620 ts_tablet_manager.cc:1939] T 84b7a851da234782bc4739b6093b7f22 P cd2371f18ed54f07b8e2fe4d246989ed: Deleting consensus metadata
I20260812 17:47:08.015955 17665 catalog_manager.cc:4841] TS cd2371f18ed54f07b8e2fe4d246989ed (127.17.255.3:36313): tablet 84b7a851da234782bc4739b6093b7f22 (table test-table [id=32c6053a57774f4bad56cde8b48ff15b]) successfully deleted
I20260812 17:47:08.017638 18618 ts_tablet_manager.cc:1918] T 84b7a851da234782bc4739b6093b7f22 P 6c618e8cf14243ccbba9d53b6e8c2552: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 17:47:08.017861 18618 log.cc:1196] T 84b7a851da234782bc4739b6093b7f22 P 6c618e8cf14243ccbba9d53b6e8c2552: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786556557564181-18428-0/minicluster-data/ts-1/wal/wals/84b7a851da234782bc4739b6093b7f22
I20260812 17:47:08.018430 18618 ts_tablet_manager.cc:1939] T 84b7a851da234782bc4739b6093b7f22 P 6c618e8cf14243ccbba9d53b6e8c2552: Deleting consensus metadata
I20260812 17:47:08.019955 17663 catalog_manager.cc:4841] TS 6c618e8cf14243ccbba9d53b6e8c2552 (127.17.255.2:35697): tablet 84b7a851da234782bc4739b6093b7f22 (table test-table [id=32c6053a57774f4bad56cde8b48ff15b]) successfully deleted
W20260812 17:47:08.023429 17668 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.255.1:32855 (error 108)
I20260812 17:47:08.023672 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 18065
I20260812 17:47:08.031821 18564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:08.031239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:32855 (local address 127.0.0.1:39264)
0812 17:47:08.031562 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:08.031680 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.1:32855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195}
W20260812 17:47:08.032186 17668 catalog_manager.cc:4584] TS 23355e142f454ff5b07cbda108a8312d (127.17.255.1:32855): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 84b7a851da234782bc4739b6093b7f22: Network error: Client connection negotiation failed: client connection to 127.17.255.1:32855: connect: Connection refused (error 111)
I20260812 17:47:08.049110 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 18299
I20260812 17:47:08.079313 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 17642
2026-08-12T17:47:08Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2690 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-12T17:47:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:47:08Z Disabled control of system clock
I20260812 17:47:08.127429 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:34297
--webserver_interface=127.17.255.62
--webserver_port=0
--builtin_ntp_servers=127.17.255.20:41315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:34297
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 17:47:08.247622 18627 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:08.247910 18627 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:08.247951 18627 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:08.251971 18627 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:47:08.252034 18627 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:08.252050 18627 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:08.252067 18627 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:47:08.252082 18627 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:47:08.256965 18627 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:41315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:34297
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:34297
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18627
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:08.258102 18627 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:08.259644 18627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:08.268887 18634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:08.268896 18638 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:08.268966 18643 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:08.268990 18627 server_base.cc:1034] running on GCE node
I20260812 17:47:08.269703 18627 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:08.270970 18627 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:08.272130 18627 hybrid_clock.cc:648] HybridClock initialized: now 1786556828272098 us; error 45 us; skew 500 ppm
I20260812 17:47:08.274080 18627 webserver.cc:460] Webserver started at http://127.17.255.62:36341/ using document root <none> and password file <none>
I20260812 17:47:08.274816 18627 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:08.274883 18627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:08.275115 18627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:08.277268 18627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "fe024e25008643dc9917fc41d4ea0b2a"
format_stamp: "Formatted at 2026-08-12 17:47:08 on dist-test-slave-tk9z"
server_key: "d62b8e6dee27099826cbc9fa3b30ce39"
server_key_iv: "abe8e7e85c7f96fd667cd31898103c5a"
server_key_version: "encryptionkey@0"
I20260812 17:47:08.277878 18627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "fe024e25008643dc9917fc41d4ea0b2a"
format_stamp: "Formatted at 2026-08-12 17:47:08 on dist-test-slave-tk9z"
server_key: "d62b8e6dee27099826cbc9fa3b30ce39"
server_key_iv: "abe8e7e85c7f96fd667cd31898103c5a"
server_key_version: "encryptionkey@0"
I20260812 17:47:08.281778 18627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.004s
I20260812 17:47:08.284664 18654 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:08.286212 18627 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 17:47:08.286456 18627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "fe024e25008643dc9917fc41d4ea0b2a"
format_stamp: "Formatted at 2026-08-12 17:47:08 on dist-test-slave-tk9z"
server_key: "d62b8e6dee27099826cbc9fa3b30ce39"
server_key_iv: "abe8e7e85c7f96fd667cd31898103c5a"
server_key_version: "encryptionkey@0"
I20260812 17:47:08.286598 18627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:08.297514 18627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:08.298339 18627 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:08.298609 18627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:08.306597 18627 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:34297
I20260812 17:47:08.306619 18750 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:34297 every 8 connection(s)
I20260812 17:47:08.307719 18627 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:47:08.311069 18751 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:08.314502 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 18627
I20260812 17:47:08.314666 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:47:08.314988 18428 external_mini_cluster.cc:1428] Setting key fc01a447c40d23b20ce1e3d0111ae413
I20260812 17:47:08.317596 18751 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe024e25008643dc9917fc41d4ea0b2a: Bootstrap starting.
I20260812 17:47:08.319960 18751 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fe024e25008643dc9917fc41d4ea0b2a: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:08.320744 18751 log.cc:824] T 00000000000000000000000000000000 P fe024e25008643dc9917fc41d4ea0b2a: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:08.322824 18751 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe024e25008643dc9917fc41d4ea0b2a: No bootstrap required, opened a new log
I20260812 17:47:08.324849 18759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:08.316507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35776 (local address 127.17.255.62:34297)
0812 17:47:08.317231 (+ 724us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:08.317247 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:08.317286 (+ 39us) server_negotiation.cc:407] Connection header received
0812 17:47:08.318016 (+ 730us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:08.318036 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:08.318519 (+ 483us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:08.318864 (+ 345us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:08.319342 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:08.320398 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:08.321357 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:08.321832 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:08.322023 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:08.323055 (+ 1032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:08.323061 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:08.323075 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:47:08.323479 (+ 404us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:08.323546 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:47:08.323567 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:08.323684 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:08.323827 (+ 143us) server_negotiation.cc:299] Negotiation successful
0812 17:47:08.324096 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":135,"threads_started":1}
I20260812 17:47:08.326778 18751 raft_consensus.cc:348] T 00000000000000000000000000000000 P fe024e25008643dc9917fc41d4ea0b2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe024e25008643dc9917fc41d4ea0b2a" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 34297 } }
I20260812 17:47:08.327064 18751 raft_consensus.cc:374] T 00000000000000000000000000000000 P fe024e25008643dc9917fc41d4ea0b2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:47:08.327154 18751 raft_consensus.cc:729] T 00000000000000000000000000000000 P fe024e25008643dc9917fc41d4ea0b2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe024e25008643dc9917fc41d4ea0b2a, State: Initialized, Role: FOLLOWER
I20260812 17:47:08.327584 18751 consensus_queue.cc:260] T 00000000000000000000000000000000 P fe024e25008643dc9917fc41d4ea0b2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe024e25008643dc9917fc41d4ea0b2a" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 34297 } }
I20260812 17:47:08.327711 18751 raft_consensus.cc:388] T 00000000000000000000000000000000 P fe024e25008643dc9917fc41d4ea0b2a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:47:08.327759 18751 raft_consensus.cc:482] T 00000000000000000000000000000000 P fe024e25008643dc9917fc41d4ea0b2a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:47:08.327831 18751 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fe024e25008643dc9917fc41d4ea0b2a [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:08.328715 18751 raft_consensus.cc:504] T 00000000000000000000000000000000 P fe024e25008643dc9917fc41d4ea0b2a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe024e25008643dc9917fc41d4ea0b2a" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 34297 } }
I20260812 17:47:08.329015 18751 leader_election.cc:302] T 00000000000000000000000000000000 P fe024e25008643dc9917fc41d4ea0b2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fe024e25008643dc9917fc41d4ea0b2a; no voters:
I20260812 17:47:08.329272 18751 leader_election.cc:288] T 00000000000000000000000000000000 P fe024e25008643dc9917fc41d4ea0b2a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:47:08.329428 18765 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fe024e25008643dc9917fc41d4ea0b2a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:47:08.329962 18765 raft_consensus.cc:686] T 00000000000000000000000000000000 P fe024e25008643dc9917fc41d4ea0b2a [term 1 LEADER]: Becoming Leader. State: Replica: fe024e25008643dc9917fc41d4ea0b2a, State: Running, Role: LEADER
I20260812 17:47:08.330317 18765 consensus_queue.cc:237] T 00000000000000000000000000000000 P fe024e25008643dc9917fc41d4ea0b2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe024e25008643dc9917fc41d4ea0b2a" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 34297 } }
I20260812 17:47:08.330659 18751 sys_catalog.cc:564] T 00000000000000000000000000000000 P fe024e25008643dc9917fc41d4ea0b2a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:47:08.331977 18766 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe024e25008643dc9917fc41d4ea0b2a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fe024e25008643dc9917fc41d4ea0b2a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe024e25008643dc9917fc41d4ea0b2a" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 34297 } } }
I20260812 17:47:08.332108 18766 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe024e25008643dc9917fc41d4ea0b2a [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:08.332450 18767 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe024e25008643dc9917fc41d4ea0b2a [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe024e25008643dc9917fc41d4ea0b2a. Latest consensus state: current_term: 1 leader_uuid: "fe024e25008643dc9917fc41d4ea0b2a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe024e25008643dc9917fc41d4ea0b2a" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 34297 } } }
I20260812 17:47:08.333005 18767 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe024e25008643dc9917fc41d4ea0b2a [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:08.332511 18789 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:47:08.336149 18789 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:47:08.341542 18789 catalog_manager.cc:1347] Generated new cluster ID: fda599bce17e459baac381a4cdae937f
I20260812 17:47:08.341616 18789 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:47:08.347858 18789 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:47:08.348889 18789 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:47:08.356791 18789 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fe024e25008643dc9917fc41d4ea0b2a: Generated new TSK 0
I20260812 17:47:08.357661 18789 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 17:47:08.368848 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.1:0
--local_ip_for_outbound_sockets=127.17.255.1
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:34297
--builtin_ntp_servers=127.17.255.20:41315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 17:47:08.496606 18801 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:08.496876 18801 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:08.496915 18801 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:08.500923 18801 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:08.500983 18801 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:08.501037 18801 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.1
I20260812 17:47:08.505741 18801 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:41315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:34297
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18801
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.1
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:08.506970 18801 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:08.508344 18801 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:08.518294 18808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:08.518297 18807 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:08.518288 18815 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:08.518743 18801 server_base.cc:1034] running on GCE node
I20260812 17:47:08.519187 18801 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:08.519863 18801 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:08.521070 18801 hybrid_clock.cc:648] HybridClock initialized: now 1786556828521048 us; error 32 us; skew 500 ppm
I20260812 17:47:08.523244 18801 webserver.cc:460] Webserver started at http://127.17.255.1:38857/ using document root <none> and password file <none>
I20260812 17:47:08.523898 18801 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:08.524003 18801 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:08.524235 18801 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:08.526525 18801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-0/data/instance:
uuid: "61394aade1084f35a3fdece0a1d0b2cd"
format_stamp: "Formatted at 2026-08-12 17:47:08 on dist-test-slave-tk9z"
server_key: "0bb83d9bf35441786ed77ce803487f1a"
server_key_iv: "0d581f876b198deb5003be063ddc1b61"
server_key_version: "encryptionkey@0"
I20260812 17:47:08.527165 18801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance:
uuid: "61394aade1084f35a3fdece0a1d0b2cd"
format_stamp: "Formatted at 2026-08-12 17:47:08 on dist-test-slave-tk9z"
server_key: "0bb83d9bf35441786ed77ce803487f1a"
server_key_iv: "0d581f876b198deb5003be063ddc1b61"
server_key_version: "encryptionkey@0"
I20260812 17:47:08.531826 18801 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 17:47:08.534554 18827 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:08.535861 18801 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 17:47:08.536001 18801 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-0/wal
uuid: "61394aade1084f35a3fdece0a1d0b2cd"
format_stamp: "Formatted at 2026-08-12 17:47:08 on dist-test-slave-tk9z"
server_key: "0bb83d9bf35441786ed77ce803487f1a"
server_key_iv: "0d581f876b198deb5003be063ddc1b61"
server_key_version: "encryptionkey@0"
I20260812 17:47:08.536128 18801 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:08.567791 18801 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:08.568640 18801 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:08.568881 18801 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:08.569605 18801 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:47:08.570791 18801 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:47:08.570849 18801 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:08.570917 18801 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:47:08.570957 18801 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:08.581128 18801 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.1:35607
I20260812 17:47:08.581163 19012 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.1:35607 every 8 connection(s)
I20260812 17:47:08.582204 18801 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
I20260812 17:47:08.588058 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 18801
I20260812 17:47:08.588200 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance
I20260812 17:47:08.588481 18428 external_mini_cluster.cc:1428] Setting key 219217b1d97e6b5244fd56c229625530
I20260812 17:47:08.590569 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.2:0
--local_ip_for_outbound_sockets=127.17.255.2
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:34297
--builtin_ntp_servers=127.17.255.20:41315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 17:47:08.593199 18759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:08.584414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:33023 (local address 127.17.255.62:34297)
0812 17:47:08.584561 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:08.584566 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:08.585765 (+ 1199us) server_negotiation.cc:407] Connection header received
0812 17:47:08.587620 (+ 1855us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:08.587623 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:08.587685 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:08.587815 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:08.588891 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:08.589543 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:08.590839 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:08.591281 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:08.591429 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:08.592700 (+ 1271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:08.592703 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:08.592705 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:47:08.592718 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:08.592739 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:47:08.592748 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:08.592806 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:08.593014 (+ 208us) server_negotiation.cc:299] Negotiation successful
0812 17:47:08.593069 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 17:47:08.594349 19022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:08.584841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34297 (local address 127.17.255.1:33023)
0812 17:47:08.585598 (+ 757us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:08.585642 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:08.587384 (+ 1742us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:08.588004 (+ 620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:08.588011 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:08.588104 (+ 93us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:47:08.588745 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:08.588761 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:08.589681 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:08.589684 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:08.590703 (+ 1019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:08.590719 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:08.591457 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:08.591460 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:08.591623 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:08.592340 (+ 717us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 17:47:08.592343 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:47:08.592415 (+ 72us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 17:47:08.592514 (+ 99us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:47:08.592842 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:47:08.592855 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:47:08.592862 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 17:47:08.592997 (+ 135us) client_negotiation.cc:240] Negotiation successful
0812 17:47:08.593336 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":121,"threads_started":1}
I20260812 17:47:08.595738 19013 heartbeater.cc:347] Connected to a master server at 127.17.255.62:34297
I20260812 17:47:08.596036 19013 heartbeater.cc:464] Registering TS with master...
I20260812 17:47:08.596793 19013 heartbeater.cc:511] Master 127.17.255.62:34297 requested a full tablet report, sending...
I20260812 17:47:08.598714 18693 ts_manager.cc:194] Registered new tserver with Master: 61394aade1084f35a3fdece0a1d0b2cd (127.17.255.1:35607)
I20260812 17:47:08.599924 18693 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.255.1:33023
W20260812 17:47:08.714133 19023 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:08.714548 19023 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:08.714648 19023 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:08.719076 19023 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:08.719162 19023 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:08.719255 19023 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.2
I20260812 17:47:08.724406 19023 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:41315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:34297
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19023
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.2
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:08.725802 19023 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:08.727444 19023 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:08.739228 19036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:08.739307 19037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:08.739337 19023 server_base.cc:1034] running on GCE node
W20260812 17:47:08.739249 19039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:08.740000 19023 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:08.740743 19023 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:08.741907 19023 hybrid_clock.cc:648] HybridClock initialized: now 1786556828741889 us; error 31 us; skew 500 ppm
I20260812 17:47:08.743922 19023 webserver.cc:460] Webserver started at http://127.17.255.2:44543/ using document root <none> and password file <none>
I20260812 17:47:08.744539 19023 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:08.744608 19023 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:08.744829 19023 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:08.747006 19023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-1/data/instance:
uuid: "7a9927186d644040bfde94952f7432ec"
format_stamp: "Formatted at 2026-08-12 17:47:08 on dist-test-slave-tk9z"
server_key: "5722bb3991521057d47029450e6eff3c"
server_key_iv: "6b97669b0f52f675a6792ee15b6e4c51"
server_key_version: "encryptionkey@0"
I20260812 17:47:08.747596 19023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance:
uuid: "7a9927186d644040bfde94952f7432ec"
format_stamp: "Formatted at 2026-08-12 17:47:08 on dist-test-slave-tk9z"
server_key: "5722bb3991521057d47029450e6eff3c"
server_key_iv: "6b97669b0f52f675a6792ee15b6e4c51"
server_key_version: "encryptionkey@0"
I20260812 17:47:08.751607 19023 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 17:47:08.754468 19046 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:08.755878 19023 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:47:08.756024 19023 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-1/wal
uuid: "7a9927186d644040bfde94952f7432ec"
format_stamp: "Formatted at 2026-08-12 17:47:08 on dist-test-slave-tk9z"
server_key: "5722bb3991521057d47029450e6eff3c"
server_key_iv: "6b97669b0f52f675a6792ee15b6e4c51"
server_key_version: "encryptionkey@0"
I20260812 17:47:08.756162 19023 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:08.773780 19023 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:08.774677 19023 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:08.774899 19023 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:08.775619 19023 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:47:08.776736 19023 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:47:08.776790 19023 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:08.776834 19023 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:47:08.776882 19023 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:08.787016 19023 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.2:45699
I20260812 17:47:08.787045 19247 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.2:45699 every 8 connection(s)
I20260812 17:47:08.788017 19023 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
I20260812 17:47:08.789475 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 19023
I20260812 17:47:08.789601 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance
I20260812 17:47:08.789927 18428 external_mini_cluster.cc:1428] Setting key 7d089113bb783a7dfe5a036f2444d516
I20260812 17:47:08.792136 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.3:0
--local_ip_for_outbound_sockets=127.17.255.3
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:34297
--builtin_ntp_servers=127.17.255.20:41315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 17:47:08.799829 18759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:08.790049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:40833 (local address 127.17.255.62:34297)
0812 17:47:08.790201 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:08.790206 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:08.791729 (+ 1523us) server_negotiation.cc:407] Connection header received
0812 17:47:08.793311 (+ 1582us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:08.793317 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:08.793386 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:08.793485 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:08.794789 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:08.795324 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:08.797239 (+ 1915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:08.797532 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:08.797635 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:08.799227 (+ 1592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:08.799231 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:08.799233 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:47:08.799247 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:08.799271 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:47:08.799281 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:08.799368 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:08.799632 (+ 264us) server_negotiation.cc:299] Negotiation successful
0812 17:47:08.799699 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 17:47:08.801272 19257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:08.790659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34297 (local address 127.17.255.2:40833)
0812 17:47:08.791555 (+ 896us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:08.791613 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:08.793083 (+ 1470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:08.793665 (+ 582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:08.793677 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:08.793820 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:47:08.794624 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:08.794649 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:08.795453 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:08.795459 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:08.797051 (+ 1592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:08.797067 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:08.797736 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:08.797744 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:08.798022 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:08.798826 (+ 804us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 17:47:08.798830 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:47:08.798899 (+ 69us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 17:47:08.799023 (+ 124us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:47:08.799395 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:47:08.799409 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:47:08.799420 (+ 11us) client_negotiation.cc:769] Sending connection context
0812 17:47:08.799578 (+ 158us) client_negotiation.cc:240] Negotiation successful
0812 17:47:08.799983 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":159,"threads_started":1}
I20260812 17:47:08.803062 19252 heartbeater.cc:347] Connected to a master server at 127.17.255.62:34297
I20260812 17:47:08.803413 19252 heartbeater.cc:464] Registering TS with master...
I20260812 17:47:08.804054 19252 heartbeater.cc:511] Master 127.17.255.62:34297 requested a full tablet report, sending...
I20260812 17:47:08.805406 18693 ts_manager.cc:194] Registered new tserver with Master: 7a9927186d644040bfde94952f7432ec (127.17.255.2:45699)
I20260812 17:47:08.806068 18693 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.255.2:40833
W20260812 17:47:08.918612 19258 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:08.918908 19258 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:08.918948 19258 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:08.923193 19258 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:08.923261 19258 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:08.923336 19258 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.3
I20260812 17:47:08.928334 19258 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:41315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:34297
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19258
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.3
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:08.929560 19258 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:08.931280 19258 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:08.941988 19267 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:08.942056 19258 server_base.cc:1034] running on GCE node
W20260812 17:47:08.942014 19268 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:08.942003 19270 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:08.942775 19258 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:08.943467 19258 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:08.944656 19258 hybrid_clock.cc:648] HybridClock initialized: now 1786556828944623 us; error 51 us; skew 500 ppm
I20260812 17:47:08.946815 19258 webserver.cc:460] Webserver started at http://127.17.255.3:46463/ using document root <none> and password file <none>
I20260812 17:47:08.947510 19258 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:08.947606 19258 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:08.947856 19258 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:08.950117 19258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-2/data/instance:
uuid: "9a427f7b7f694cc5b94d68967155cca4"
format_stamp: "Formatted at 2026-08-12 17:47:08 on dist-test-slave-tk9z"
server_key: "8645aa7a01c5abc4c69130e45da7574e"
server_key_iv: "3db30f65ccf3fb607c613c0303d93396"
server_key_version: "encryptionkey@0"
I20260812 17:47:08.950794 19258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance:
uuid: "9a427f7b7f694cc5b94d68967155cca4"
format_stamp: "Formatted at 2026-08-12 17:47:08 on dist-test-slave-tk9z"
server_key: "8645aa7a01c5abc4c69130e45da7574e"
server_key_iv: "3db30f65ccf3fb607c613c0303d93396"
server_key_version: "encryptionkey@0"
I20260812 17:47:08.954703 19258 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 17:47:08.957387 19280 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:08.958784 19258 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:47:08.958940 19258 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-2/wal
uuid: "9a427f7b7f694cc5b94d68967155cca4"
format_stamp: "Formatted at 2026-08-12 17:47:08 on dist-test-slave-tk9z"
server_key: "8645aa7a01c5abc4c69130e45da7574e"
server_key_iv: "3db30f65ccf3fb607c613c0303d93396"
server_key_version: "encryptionkey@0"
I20260812 17:47:08.959064 19258 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:08.972119 19258 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:08.972880 19258 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:08.973100 19258 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:08.973742 19258 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:47:08.974818 19258 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:47:08.974900 19258 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:08.974998 19258 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:47:08.975044 19258 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:08.984195 19258 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.3:41955
I20260812 17:47:08.984220 19482 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.3:41955 every 8 connection(s)
I20260812 17:47:08.985199 19258 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
I20260812 17:47:08.991020 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 19258
I20260812 17:47:08.991148 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance
I20260812 17:47:08.991460 18428 external_mini_cluster.cc:1428] Setting key ac6f80502bef81eeecbb1ace778d7d64
I20260812 17:47:08.995898 18759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:08.987328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:36595 (local address 127.17.255.62:34297)
0812 17:47:08.987489 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:08.987493 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:08.988671 (+ 1178us) server_negotiation.cc:407] Connection header received
0812 17:47:08.990234 (+ 1563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:08.990237 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:08.990312 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:08.990449 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:08.991738 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:08.992508 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:08.993830 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:08.994107 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:08.994194 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:08.995468 (+ 1274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:08.995472 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:08.995474 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:47:08.995486 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:08.995508 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:47:08.995516 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:08.995574 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:08.995718 (+ 144us) server_negotiation.cc:299] Negotiation successful
0812 17:47:08.995778 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 17:47:08.996873 19492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:08.987759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34297 (local address 127.17.255.3:36595)
0812 17:47:08.988482 (+ 723us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:08.988534 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:08.989989 (+ 1455us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:08.990643 (+ 654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:08.990650 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:08.990773 (+ 123us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:47:08.991543 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:08.991566 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:08.992676 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:08.992680 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:08.993710 (+ 1030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:08.993722 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:08.994261 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:08.994264 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:08.994506 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:08.995147 (+ 641us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 17:47:08.995148 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:47:08.995192 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 17:47:08.995266 (+ 74us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:47:08.995588 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:47:08.995596 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:47:08.995601 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 17:47:08.995707 (+ 106us) client_negotiation.cc:240] Negotiation successful
0812 17:47:08.995967 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":120,"threads_started":1}
I20260812 17:47:08.998140 19485 heartbeater.cc:347] Connected to a master server at 127.17.255.62:34297
I20260812 17:47:08.998504 19485 heartbeater.cc:464] Registering TS with master...
I20260812 17:47:08.999153 19485 heartbeater.cc:511] Master 127.17.255.62:34297 requested a full tablet report, sending...
I20260812 17:47:09.000389 18693 ts_manager.cc:194] Registered new tserver with Master: 9a427f7b7f694cc5b94d68967155cca4 (127.17.255.3:41955)
I20260812 17:47:09.000950 18693 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.255.3:36595
I20260812 17:47:09.005801 18428 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 17:47:09.011759 18759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:09.008033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35786 (local address 127.17.255.62:34297)
0812 17:47:09.008194 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:09.008199 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:09.008342 (+ 143us) server_negotiation.cc:407] Connection header received
0812 17:47:09.008483 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:09.008485 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:09.008524 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:09.008592 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:09.008841 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:09.009342 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:09.010139 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:09.010354 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:09.010503 (+ 149us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:09.011243 (+ 740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:09.011246 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:09.011248 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:47:09.011260 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:09.011280 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:47:09.011288 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:09.011393 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:09.011542 (+ 149us) server_negotiation.cc:299] Negotiation successful
0812 17:47:09.011587 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 17:47:09.014870 18693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35786:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 17:47:09.017995 18693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 17:47:09.033588 19506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:09.027087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.3:41955 (local address 127.0.0.1:55240)
0812 17:47:09.027951 (+ 864us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:09.028029 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:09.028173 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:09.028954 (+ 781us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:09.028963 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:09.028987 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:47:09.029127 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:09.029133 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:09.030561 (+ 1428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:09.030564 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:09.032058 (+ 1494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:09.032069 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:09.033152 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:09.033155 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:09.033246 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:09.033279 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 17:47:09.033372 (+ 93us) client_negotiation.cc:240] Negotiation successful
0812 17:47:09.033464 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":674,"mutex_wait_us":114,"thread_start_us":82,"threads_started":1}
I20260812 17:47:09.033641 19516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:09.027697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55240 (local address 127.17.255.3:41955)
0812 17:47:09.028199 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:09.028211 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:09.028240 (+ 29us) server_negotiation.cc:407] Connection header received
0812 17:47:09.028344 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:09.028352 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:09.028600 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:09.028765 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:47:09.029262 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:09.030410 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:09.032187 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:09.033040 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:09.033152 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:09.033359 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:09.033418 (+ 59us) server_negotiation.cc:299] Negotiation successful
0812 17:47:09.033508 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":390,"thread_start_us":153,"threads_started":1}
I20260812 17:47:09.034224 19507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:09.027403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:45699 (local address 127.0.0.1:46698)
0812 17:47:09.028693 (+ 1290us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:09.028707 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:09.028862 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:09.029542 (+ 680us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:09.029544 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:09.029563 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:47:09.029637 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:09.029642 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:09.030946 (+ 1304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:09.030952 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:09.032098 (+ 1146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:09.032108 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:09.033816 (+ 1708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:09.033821 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:09.033912 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:09.033935 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 17:47:09.034003 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 17:47:09.034068 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1214,"mutex_wait_us":5,"thread_start_us":94,"threads_started":1}
I20260812 17:47:09.034801 19517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:09.027938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46698 (local address 127.17.255.2:45699)
0812 17:47:09.028260 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:09.028274 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:09.028785 (+ 511us) server_negotiation.cc:407] Connection header received
0812 17:47:09.029019 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:09.029025 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:09.029216 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:09.029337 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:47:09.029766 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:09.030840 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:09.032253 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:09.033038 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:09.033152 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:09.033359 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:09.034484 (+ 1125us) server_negotiation.cc:299] Negotiation successful
0812 17:47:09.034608 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":228,"thread_start_us":132,"threads_started":1}
I20260812 17:47:09.035626 19509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:09.027084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:35607 (local address 127.0.0.1:56470)
0812 17:47:09.028396 (+ 1312us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:09.028410 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:09.028499 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:09.029170 (+ 671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:09.029172 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:09.029208 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:47:09.029311 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:09.029320 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:09.030515 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:09.030522 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:09.032061 (+ 1539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:09.032069 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:09.035217 (+ 3148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:09.035221 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:09.035309 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:09.035337 (+ 28us) client_negotiation.cc:769] Sending connection context
0812 17:47:09.035429 (+ 92us) client_negotiation.cc:240] Negotiation successful
0812 17:47:09.035500 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1251,"mutex_wait_us":208,"thread_start_us":114,"threads_started":1}
I20260812 17:47:09.035737 19508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:09.027230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56470 (local address 127.17.255.1:35607)
0812 17:47:09.028505 (+ 1275us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:09.028519 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:09.028572 (+ 53us) server_negotiation.cc:407] Connection header received
0812 17:47:09.028652 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:09.028658 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:09.028864 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:09.029040 (+ 176us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:47:09.029456 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:09.030362 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:09.033850 (+ 3488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:09.035023 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:09.035133 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:09.035316 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:09.035471 (+ 155us) server_negotiation.cc:299] Negotiation successful
0812 17:47:09.035577 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1161,"thread_start_us":148,"threads_started":1}
I20260812 17:47:09.037019 19362 tablet_service.cc:1467] Processing CreateTablet for tablet 3b051e7a50fa4a4bb1d41d56d8c4918d (DEFAULT_TABLE table=test-table [id=0797006931c94485b48d50a8371f7747]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:47:09.038054 19362 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b051e7a50fa4a4bb1d41d56d8c4918d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:09.038035 18904 tablet_service.cc:1467] Processing CreateTablet for tablet 3b051e7a50fa4a4bb1d41d56d8c4918d (DEFAULT_TABLE table=test-table [id=0797006931c94485b48d50a8371f7747]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:47:09.039113 18904 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b051e7a50fa4a4bb1d41d56d8c4918d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:09.040825 19128 tablet_service.cc:1467] Processing CreateTablet for tablet 3b051e7a50fa4a4bb1d41d56d8c4918d (DEFAULT_TABLE table=test-table [id=0797006931c94485b48d50a8371f7747]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:47:09.041808 19128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b051e7a50fa4a4bb1d41d56d8c4918d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:09.045471 19518 tablet_bootstrap.cc:492] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 61394aade1084f35a3fdece0a1d0b2cd: Bootstrap starting.
I20260812 17:47:09.047811 19518 tablet_bootstrap.cc:654] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 61394aade1084f35a3fdece0a1d0b2cd: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:09.048486 19525 tablet_bootstrap.cc:492] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 7a9927186d644040bfde94952f7432ec: Bootstrap starting.
I20260812 17:47:09.048542 19518 log.cc:824] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 61394aade1084f35a3fdece0a1d0b2cd: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:09.049078 19519 tablet_bootstrap.cc:492] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 9a427f7b7f694cc5b94d68967155cca4: Bootstrap starting.
I20260812 17:47:09.050685 19525 tablet_bootstrap.cc:654] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 7a9927186d644040bfde94952f7432ec: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:09.051223 19518 tablet_bootstrap.cc:492] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 61394aade1084f35a3fdece0a1d0b2cd: No bootstrap required, opened a new log
I20260812 17:47:09.051213 19519 tablet_bootstrap.cc:654] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 9a427f7b7f694cc5b94d68967155cca4: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:09.051450 19518 ts_tablet_manager.cc:1397] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 61394aade1084f35a3fdece0a1d0b2cd: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 17:47:09.051527 19525 log.cc:824] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 7a9927186d644040bfde94952f7432ec: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:09.052052 19519 log.cc:824] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 9a427f7b7f694cc5b94d68967155cca4: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:09.053519 19525 tablet_bootstrap.cc:492] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 7a9927186d644040bfde94952f7432ec: No bootstrap required, opened a new log
I20260812 17:47:09.053712 19525 ts_tablet_manager.cc:1397] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 7a9927186d644040bfde94952f7432ec: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 17:47:09.054039 19519 tablet_bootstrap.cc:492] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 9a427f7b7f694cc5b94d68967155cca4: No bootstrap required, opened a new log
I20260812 17:47:09.054243 19519 ts_tablet_manager.cc:1397] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 9a427f7b7f694cc5b94d68967155cca4: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 17:47:09.055187 19518 raft_consensus.cc:348] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 61394aade1084f35a3fdece0a1d0b2cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61394aade1084f35a3fdece0a1d0b2cd" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35607 } } peers { permanent_uuid: "9a427f7b7f694cc5b94d68967155cca4" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41955 } } peers { permanent_uuid: "7a9927186d644040bfde94952f7432ec" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 45699 } }
I20260812 17:47:09.055434 19518 raft_consensus.cc:374] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 61394aade1084f35a3fdece0a1d0b2cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:47:09.055490 19518 raft_consensus.cc:729] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 61394aade1084f35a3fdece0a1d0b2cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61394aade1084f35a3fdece0a1d0b2cd, State: Initialized, Role: FOLLOWER
I20260812 17:47:09.055984 19518 consensus_queue.cc:260] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 61394aade1084f35a3fdece0a1d0b2cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61394aade1084f35a3fdece0a1d0b2cd" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35607 } } peers { permanent_uuid: "9a427f7b7f694cc5b94d68967155cca4" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41955 } } peers { permanent_uuid: "7a9927186d644040bfde94952f7432ec" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 45699 } }
I20260812 17:47:09.057114 19518 ts_tablet_manager.cc:1428] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 61394aade1084f35a3fdece0a1d0b2cd: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260812 17:47:09.057493 19013 heartbeater.cc:503] Master 127.17.255.62:34297 was elected leader, sending a full tablet report...
I20260812 17:47:09.058465 19519 raft_consensus.cc:348] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 9a427f7b7f694cc5b94d68967155cca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61394aade1084f35a3fdece0a1d0b2cd" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35607 } } peers { permanent_uuid: "9a427f7b7f694cc5b94d68967155cca4" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41955 } } peers { permanent_uuid: "7a9927186d644040bfde94952f7432ec" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 45699 } }
I20260812 17:47:09.058751 19519 raft_consensus.cc:374] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 9a427f7b7f694cc5b94d68967155cca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:47:09.058809 19519 raft_consensus.cc:729] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 9a427f7b7f694cc5b94d68967155cca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a427f7b7f694cc5b94d68967155cca4, State: Initialized, Role: FOLLOWER
I20260812 17:47:09.059262 19519 consensus_queue.cc:260] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 9a427f7b7f694cc5b94d68967155cca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61394aade1084f35a3fdece0a1d0b2cd" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35607 } } peers { permanent_uuid: "9a427f7b7f694cc5b94d68967155cca4" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41955 } } peers { permanent_uuid: "7a9927186d644040bfde94952f7432ec" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 45699 } }
I20260812 17:47:09.059296 19525 raft_consensus.cc:348] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 7a9927186d644040bfde94952f7432ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61394aade1084f35a3fdece0a1d0b2cd" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35607 } } peers { permanent_uuid: "9a427f7b7f694cc5b94d68967155cca4" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41955 } } peers { permanent_uuid: "7a9927186d644040bfde94952f7432ec" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 45699 } }
I20260812 17:47:09.059549 19525 raft_consensus.cc:374] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 7a9927186d644040bfde94952f7432ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:47:09.059614 19525 raft_consensus.cc:729] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 7a9927186d644040bfde94952f7432ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a9927186d644040bfde94952f7432ec, State: Initialized, Role: FOLLOWER
I20260812 17:47:09.060072 19485 heartbeater.cc:503] Master 127.17.255.62:34297 was elected leader, sending a full tablet report...
I20260812 17:47:09.060089 19525 consensus_queue.cc:260] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 7a9927186d644040bfde94952f7432ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61394aade1084f35a3fdece0a1d0b2cd" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35607 } } peers { permanent_uuid: "9a427f7b7f694cc5b94d68967155cca4" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41955 } } peers { permanent_uuid: "7a9927186d644040bfde94952f7432ec" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 45699 } }
I20260812 17:47:09.060271 19519 ts_tablet_manager.cc:1428] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 9a427f7b7f694cc5b94d68967155cca4: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260812 17:47:09.061306 19525 ts_tablet_manager.cc:1428] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 7a9927186d644040bfde94952f7432ec: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260812 17:47:09.061695 19252 heartbeater.cc:503] Master 127.17.255.62:34297 was elected leader, sending a full tablet report...
I20260812 17:47:09.064359 19537 raft_consensus.cc:482] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 7a9927186d644040bfde94952f7432ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:47:09.064530 19537 raft_consensus.cc:504] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 7a9927186d644040bfde94952f7432ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61394aade1084f35a3fdece0a1d0b2cd" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35607 } } peers { permanent_uuid: "9a427f7b7f694cc5b94d68967155cca4" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41955 } } peers { permanent_uuid: "7a9927186d644040bfde94952f7432ec" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 45699 } }
I20260812 17:47:09.066041 19537 leader_election.cc:288] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 7a9927186d644040bfde94952f7432ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61394aade1084f35a3fdece0a1d0b2cd (127.17.255.1:35607), 9a427f7b7f694cc5b94d68967155cca4 (127.17.255.3:41955)
I20260812 17:47:09.069626 19257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:09.066231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:35607 (local address 127.17.255.2:54003)
0812 17:47:09.066369 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:09.066415 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:09.066516 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:09.066869 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:09.066872 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:09.066890 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:47:09.067008 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:09.067014 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:09.067746 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:09.067751 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:09.068587 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:09.068597 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:09.069211 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:09.069215 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:09.069312 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:09.069334 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 17:47:09.069424 (+ 90us) client_negotiation.cc:240] Negotiation successful
0812 17:47:09.069497 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45,"mutex_wait_us":30}
I20260812 17:47:09.069626 19508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:09.066520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:54003 (local address 127.17.255.1:35607)
0812 17:47:09.066647 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:09.066651 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:09.066665 (+ 14us) server_negotiation.cc:407] Connection header received
0812 17:47:09.066713 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:09.066716 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:09.066761 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:09.066856 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:47:09.067120 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:09.067641 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:09.068706 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:09.069095 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:09.069218 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:09.069269 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:09.069442 (+ 173us) server_negotiation.cc:299] Negotiation successful
0812 17:47:09.069509 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 17:47:09.069769 19516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:09.066424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:47649 (local address 127.17.255.3:41955)
0812 17:47:09.066547 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:09.066554 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:09.066840 (+ 286us) server_negotiation.cc:407] Connection header received
0812 17:47:09.066954 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:09.066957 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:09.067005 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:09.067087 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:47:09.067343 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:09.067822 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:09.068861 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:09.069245 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:09.069364 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:09.069409 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:09.069599 (+ 190us) server_negotiation.cc:299] Negotiation successful
0812 17:47:09.069660 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 17:47:09.069788 19539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:09.066231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.3:41955 (local address 127.17.255.2:47649)
0812 17:47:09.066760 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:09.066770 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:09.066873 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:09.067096 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:09.067099 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:09.067114 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:47:09.067242 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:09.067247 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:09.067925 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:09.067930 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:09.068743 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:09.068752 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:09.069365 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:09.069368 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:09.069476 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:09.069501 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 17:47:09.069582 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 17:47:09.069646 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":476,"mutex_wait_us":245,"thread_start_us":126,"threads_started":1}
I20260812 17:47:09.070216 18937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b051e7a50fa4a4bb1d41d56d8c4918d" candidate_uuid: "7a9927186d644040bfde94952f7432ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61394aade1084f35a3fdece0a1d0b2cd" is_pre_election: true
I20260812 17:47:09.070600 18937 raft_consensus.cc:2454] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 61394aade1084f35a3fdece0a1d0b2cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a9927186d644040bfde94952f7432ec in term 0.
I20260812 17:47:09.070580 19396 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b051e7a50fa4a4bb1d41d56d8c4918d" candidate_uuid: "7a9927186d644040bfde94952f7432ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a427f7b7f694cc5b94d68967155cca4" is_pre_election: true
I20260812 17:47:09.070855 19396 raft_consensus.cc:2454] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 9a427f7b7f694cc5b94d68967155cca4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a9927186d644040bfde94952f7432ec in term 0.
I20260812 17:47:09.071115 19050 leader_election.cc:302] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 7a9927186d644040bfde94952f7432ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61394aade1084f35a3fdece0a1d0b2cd, 7a9927186d644040bfde94952f7432ec; no voters:
I20260812 17:47:09.071388 19537 raft_consensus.cc:2781] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 7a9927186d644040bfde94952f7432ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 17:47:09.071508 19537 raft_consensus.cc:482] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 7a9927186d644040bfde94952f7432ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 17:47:09.071571 19537 raft_consensus.cc:3037] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 7a9927186d644040bfde94952f7432ec [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:09.072606 19537 raft_consensus.cc:504] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 7a9927186d644040bfde94952f7432ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61394aade1084f35a3fdece0a1d0b2cd" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35607 } } peers { permanent_uuid: "9a427f7b7f694cc5b94d68967155cca4" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41955 } } peers { permanent_uuid: "7a9927186d644040bfde94952f7432ec" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 45699 } }
I20260812 17:47:09.072942 19537 leader_election.cc:288] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 7a9927186d644040bfde94952f7432ec [CANDIDATE]: Term 1 election: Requested vote from peers 61394aade1084f35a3fdece0a1d0b2cd (127.17.255.1:35607), 9a427f7b7f694cc5b94d68967155cca4 (127.17.255.3:41955)
I20260812 17:47:09.073342 18937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b051e7a50fa4a4bb1d41d56d8c4918d" candidate_uuid: "7a9927186d644040bfde94952f7432ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61394aade1084f35a3fdece0a1d0b2cd"
I20260812 17:47:09.073342 19396 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b051e7a50fa4a4bb1d41d56d8c4918d" candidate_uuid: "7a9927186d644040bfde94952f7432ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a427f7b7f694cc5b94d68967155cca4"
I20260812 17:47:09.073493 19396 raft_consensus.cc:3037] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 9a427f7b7f694cc5b94d68967155cca4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:09.073485 18937 raft_consensus.cc:3037] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 61394aade1084f35a3fdece0a1d0b2cd [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:09.074867 19396 raft_consensus.cc:2454] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 9a427f7b7f694cc5b94d68967155cca4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a9927186d644040bfde94952f7432ec in term 1.
I20260812 17:47:09.074867 18937 raft_consensus.cc:2454] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 61394aade1084f35a3fdece0a1d0b2cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a9927186d644040bfde94952f7432ec in term 1.
I20260812 17:47:09.075217 19051 leader_election.cc:302] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 7a9927186d644040bfde94952f7432ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a9927186d644040bfde94952f7432ec, 9a427f7b7f694cc5b94d68967155cca4; no voters:
I20260812 17:47:09.075390 19537 raft_consensus.cc:2781] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 7a9927186d644040bfde94952f7432ec [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:47:09.075675 19537 raft_consensus.cc:686] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 7a9927186d644040bfde94952f7432ec [term 1 LEADER]: Becoming Leader. State: Replica: 7a9927186d644040bfde94952f7432ec, State: Running, Role: LEADER
I20260812 17:47:09.076057 19537 consensus_queue.cc:237] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 7a9927186d644040bfde94952f7432ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61394aade1084f35a3fdece0a1d0b2cd" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35607 } } peers { permanent_uuid: "9a427f7b7f694cc5b94d68967155cca4" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41955 } } peers { permanent_uuid: "7a9927186d644040bfde94952f7432ec" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 45699 } }
I20260812 17:47:09.078991 18693 catalog_manager.cc:5495] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 7a9927186d644040bfde94952f7432ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a9927186d644040bfde94952f7432ec (127.17.255.2). New cstate: current_term: 1 leader_uuid: "7a9927186d644040bfde94952f7432ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61394aade1084f35a3fdece0a1d0b2cd" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a427f7b7f694cc5b94d68967155cca4" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a9927186d644040bfde94952f7432ec" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 45699 } health_report { overall_health: HEALTHY } } }
W20260812 17:47:09.083514 19017 tablet.cc:2369] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 61394aade1084f35a3fdece0a1d0b2cd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 17:47:09.097652 19517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:09.094084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46714 (local address 127.17.255.2:45699)
0812 17:47:09.094221 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:09.094225 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:09.094261 (+ 36us) server_negotiation.cc:407] Connection header received
0812 17:47:09.094335 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:09.094337 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:09.094451 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:09.094546 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:47:09.094793 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:09.095292 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:09.096132 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:09.096334 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:09.096427 (+ 93us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:09.096785 (+ 358us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:47:09.097211 (+ 426us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:47:09.097324 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:09.097489 (+ 165us) server_negotiation.cc:299] Negotiation successful
0812 17:47:09.097521 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 17:47:09.104314 18937 raft_consensus.cc:1261] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 61394aade1084f35a3fdece0a1d0b2cd [term 1 FOLLOWER]: Refusing update from remote peer 7a9927186d644040bfde94952f7432ec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:47:09.104315 19396 raft_consensus.cc:1261] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 9a427f7b7f694cc5b94d68967155cca4 [term 1 FOLLOWER]: Refusing update from remote peer 7a9927186d644040bfde94952f7432ec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:47:09.105093 19541 consensus_queue.cc:1035] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 7a9927186d644040bfde94952f7432ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a427f7b7f694cc5b94d68967155cca4" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 41955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:47:09.105362 19537 consensus_queue.cc:1035] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 7a9927186d644040bfde94952f7432ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "61394aade1084f35a3fdece0a1d0b2cd" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 35607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:47:09.115361 19553 mvcc.cc:205] Tried to move back new op lower bound from 7317736772002209792 to 7317736771898368000. Current Snapshot: MvccSnapshot[applied={T|T < 7317736772002209792 or (T in {7317736772002209792})}]
I20260812 17:47:09.124749 18686 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35786:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:47:09.124989 18686 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35786:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:47:09.127931 18686 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fe024e25008643dc9917fc41d4ea0b2a: Sending DeleteTablet for 3 replicas of tablet 3b051e7a50fa4a4bb1d41d56d8c4918d
I20260812 17:47:09.128981 19362 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b051e7a50fa4a4bb1d41d56d8c4918d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:47:09 UTC) from {username='slave'} at 127.0.0.1:55240
I20260812 17:47:09.128973 18904 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b051e7a50fa4a4bb1d41d56d8c4918d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:47:09 UTC) from {username='slave'} at 127.0.0.1:56470
I20260812 17:47:09.129267 19128 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b051e7a50fa4a4bb1d41d56d8c4918d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:47:09 UTC) from {username='slave'} at 127.0.0.1:46698
I20260812 17:47:09.129671 19565 tablet_replica.cc:330] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 61394aade1084f35a3fdece0a1d0b2cd: stopping tablet replica
I20260812 17:47:09.129849 19568 tablet_replica.cc:330] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 7a9927186d644040bfde94952f7432ec: stopping tablet replica
I20260812 17:47:09.130213 19565 raft_consensus.cc:2229] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 61394aade1084f35a3fdece0a1d0b2cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:47:09.130198 19568 raft_consensus.cc:2229] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 7a9927186d644040bfde94952f7432ec [term 1 LEADER]: Raft consensus shutting down.
I20260812 17:47:09.130553 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 18801
I20260812 17:47:09.130771 19568 raft_consensus.cc:2258] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 7a9927186d644040bfde94952f7432ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:47:09.134402 19567 tablet_replica.cc:330] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 9a427f7b7f694cc5b94d68967155cca4: stopping tablet replica
I20260812 17:47:09.134893 19567 raft_consensus.cc:2229] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 9a427f7b7f694cc5b94d68967155cca4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:47:09.135293 19568 ts_tablet_manager.cc:1905] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 7a9927186d644040bfde94952f7432ec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:47:09.135334 19567 raft_consensus.cc:2258] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 9a427f7b7f694cc5b94d68967155cca4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:47:09.136991 19567 ts_tablet_manager.cc:1905] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 9a427f7b7f694cc5b94d68967155cca4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:47:09.138651 19568 ts_tablet_manager.cc:1918] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 7a9927186d644040bfde94952f7432ec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 17:47:09.138775 19568 log.cc:1196] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 7a9927186d644040bfde94952f7432ec: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-1/wal/wals/3b051e7a50fa4a4bb1d41d56d8c4918d
I20260812 17:47:09.139153 19568 ts_tablet_manager.cc:1939] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 7a9927186d644040bfde94952f7432ec: Deleting consensus metadata
I20260812 17:47:09.140959 19567 ts_tablet_manager.cc:1918] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 9a427f7b7f694cc5b94d68967155cca4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 17:47:09.141130 19567 log.cc:1196] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 9a427f7b7f694cc5b94d68967155cca4: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786556557564181-18428-0/minicluster-data/ts-2/wal/wals/3b051e7a50fa4a4bb1d41d56d8c4918d
I20260812 17:47:09.141510 19567 ts_tablet_manager.cc:1939] T 3b051e7a50fa4a4bb1d41d56d8c4918d P 9a427f7b7f694cc5b94d68967155cca4: Deleting consensus metadata
I20260812 17:47:09.143108 18657 catalog_manager.cc:4841] TS 9a427f7b7f694cc5b94d68967155cca4 (127.17.255.3:41955): tablet 3b051e7a50fa4a4bb1d41d56d8c4918d (table test-table [id=0797006931c94485b48d50a8371f7747]) successfully deleted
I20260812 17:47:09.146719 18664 catalog_manager.cc:4841] TS 7a9927186d644040bfde94952f7432ec (127.17.255.2:45699): tablet 3b051e7a50fa4a4bb1d41d56d8c4918d (table test-table [id=0797006931c94485b48d50a8371f7747]) successfully deleted
W20260812 17:47:09.152448 18655 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.255.1:35607 (error 108)
I20260812 17:47:09.152740 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 19023
I20260812 17:47:09.162920 19509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:09.162359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:35607 (local address 127.0.0.1:56476)
0812 17:47:09.162706 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:09.162804 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.1:35607: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183}
W20260812 17:47:09.163457 18655 catalog_manager.cc:4584] TS 61394aade1084f35a3fdece0a1d0b2cd (127.17.255.1:35607): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3b051e7a50fa4a4bb1d41d56d8c4918d: Network error: Client connection negotiation failed: client connection to 127.17.255.1:35607: connect: Connection refused (error 111)
I20260812 17:47:09.173079 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 19258
I20260812 17:47:09.185451 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 18627
2026-08-12T17:47:09Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1098 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:47:09 dist-test-slave-tk9z krb5kdc[19573](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:47:09 dist-test-slave-tk9z krb5kdc[19573](info): set up 2 sockets
Aug 12 17:47:09 dist-test-slave-tk9z krb5kdc[19573](info): commencing operation
krb5kdc: starting...
W20260812 17:47:10.496467 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.281s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:47:10 dist-test-slave-tk9z krb5kdc[19573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556830, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:47:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:47:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.255.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
I20260812 17:47:10.625703 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:34529
--webserver_interface=127.17.255.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:45563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:34529
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:47:10.743413 19596 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:10.743708 19596 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:10.743784 19596 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:10.747808 19596 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:47:10.747895 19596 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:10.747936 19596 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:10.747972 19596 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:47:10.748006 19596 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:47:10.753914 19596 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:45563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:34529
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:34529
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19596
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:10.755162 19596 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:10.756259 19596 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:10.765285 19613 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:10.765427 19596 server_base.cc:1034] running on GCE node
W20260812 17:47:10.765285 19607 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:10.765625 19604 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:10.766258 19596 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:10.767514 19596 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:10.768710 19596 hybrid_clock.cc:648] HybridClock initialized: now 1786556830768683 us; error 40 us; skew 500 ppm
Aug 12 17:47:10 dist-test-slave-tk9z krb5kdc[19573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556830, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:47:10.771780 19596 init.cc:377] Logged in from keytab as kudu/127.17.255.62@KRBTEST.COM (short username kudu)
I20260812 17:47:10.772991 19596 webserver.cc:460] Webserver started at http://127.17.255.62:44537/ using document root <none> and password file <none>
I20260812 17:47:10.773587 19596 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:10.773650 19596 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:10.773847 19596 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:10.776160 19596 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "744d49256cce49a398798149379179d5"
format_stamp: "Formatted at 2026-08-12 17:47:10 on dist-test-slave-tk9z"
server_key: "f2b3cc689e44274d4860554d8c40b39b"
server_key_iv: "637384f1825a7b62916499de67e11131"
server_key_version: "encryptionkey@0"
I20260812 17:47:10.776728 19596 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "744d49256cce49a398798149379179d5"
format_stamp: "Formatted at 2026-08-12 17:47:10 on dist-test-slave-tk9z"
server_key: "f2b3cc689e44274d4860554d8c40b39b"
server_key_iv: "637384f1825a7b62916499de67e11131"
server_key_version: "encryptionkey@0"
I20260812 17:47:10.780773 19596 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 17:47:10.783604 19628 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:10.785048 19596 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:47:10.785176 19596 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "744d49256cce49a398798149379179d5"
format_stamp: "Formatted at 2026-08-12 17:47:10 on dist-test-slave-tk9z"
server_key: "f2b3cc689e44274d4860554d8c40b39b"
server_key_iv: "637384f1825a7b62916499de67e11131"
server_key_version: "encryptionkey@0"
I20260812 17:47:10.785290 19596 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:10.802134 19596 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:10.806203 19596 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:10.806492 19596 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:10.814747 19596 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:34529
I20260812 17:47:10.814775 19714 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:34529 every 8 connection(s)
I20260812 17:47:10.815840 19596 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:47:10.818878 19716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:10.823308 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 19596
I20260812 17:47:10.823473 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:47:10.823843 18428 external_mini_cluster.cc:1428] Setting key d899e642b46e0d67624a7f67a66a99b1
I20260812 17:47:10.825048 19716 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 744d49256cce49a398798149379179d5: Bootstrap starting.
I20260812 17:47:10.827425 19716 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 744d49256cce49a398798149379179d5: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:10.828372 19716 log.cc:824] T 00000000000000000000000000000000 P 744d49256cce49a398798149379179d5: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:10.830654 19716 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 744d49256cce49a398798149379179d5: No bootstrap required, opened a new log
Aug 12 17:47:10 dist-test-slave-tk9z krb5kdc[19573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556830, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:47:10.835565 19716 raft_consensus.cc:348] T 00000000000000000000000000000000 P 744d49256cce49a398798149379179d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "744d49256cce49a398798149379179d5" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 34529 } }
I20260812 17:47:10.835903 19716 raft_consensus.cc:374] T 00000000000000000000000000000000 P 744d49256cce49a398798149379179d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:47:10.835963 19716 raft_consensus.cc:729] T 00000000000000000000000000000000 P 744d49256cce49a398798149379179d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 744d49256cce49a398798149379179d5, State: Initialized, Role: FOLLOWER
I20260812 17:47:10.836516 19716 consensus_queue.cc:260] T 00000000000000000000000000000000 P 744d49256cce49a398798149379179d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "744d49256cce49a398798149379179d5" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 34529 } }
I20260812 17:47:10.836696 19716 raft_consensus.cc:388] T 00000000000000000000000000000000 P 744d49256cce49a398798149379179d5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:47:10.836773 19716 raft_consensus.cc:482] T 00000000000000000000000000000000 P 744d49256cce49a398798149379179d5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:47:10.836894 19716 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 744d49256cce49a398798149379179d5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:10.838160 19716 raft_consensus.cc:504] T 00000000000000000000000000000000 P 744d49256cce49a398798149379179d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "744d49256cce49a398798149379179d5" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 34529 } }
I20260812 17:47:10.838580 19716 leader_election.cc:302] T 00000000000000000000000000000000 P 744d49256cce49a398798149379179d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 744d49256cce49a398798149379179d5; no voters:
I20260812 17:47:10.838984 19716 leader_election.cc:288] T 00000000000000000000000000000000 P 744d49256cce49a398798149379179d5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:47:10.839108 19722 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 744d49256cce49a398798149379179d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:47:10.839453 19722 raft_consensus.cc:686] T 00000000000000000000000000000000 P 744d49256cce49a398798149379179d5 [term 1 LEADER]: Becoming Leader. State: Replica: 744d49256cce49a398798149379179d5, State: Running, Role: LEADER
I20260812 17:47:10.839883 19722 consensus_queue.cc:237] T 00000000000000000000000000000000 P 744d49256cce49a398798149379179d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "744d49256cce49a398798149379179d5" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 34529 } }
I20260812 17:47:10.840180 19720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:10.825360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54882 (local address 127.17.255.62:34529)
0812 17:47:10.825816 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:10.825833 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:10.825870 (+ 37us) server_negotiation.cc:407] Connection header received
0812 17:47:10.826569 (+ 699us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:10.826589 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:10.826931 (+ 342us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:10.827209 (+ 278us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:10.828218 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:10.829623 (+ 1405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:10.830860 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:10.831380 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:10.831524 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:10.834570 (+ 3046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:10.834578 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:10.834597 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:10.834637 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:10.836705 (+ 2068us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:10.837242 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:10.837248 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:10.837254 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:10.837392 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:10.837660 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:10.837663 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:10.837665 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:10.838255 (+ 590us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:10.838504 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:10.838812 (+ 308us) server_negotiation.cc:299] Negotiation successful
0812 17:47:10.839154 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":147,"threads_started":1}
I20260812 17:47:10.840416 19716 sys_catalog.cc:564] T 00000000000000000000000000000000 P 744d49256cce49a398798149379179d5 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:47:10.841733 19723 sys_catalog.cc:455] T 00000000000000000000000000000000 P 744d49256cce49a398798149379179d5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "744d49256cce49a398798149379179d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "744d49256cce49a398798149379179d5" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 34529 } } }
I20260812 17:47:10.841885 19723 sys_catalog.cc:458] T 00000000000000000000000000000000 P 744d49256cce49a398798149379179d5 [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:10.842707 19735 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:47:10.843757 19725 sys_catalog.cc:455] T 00000000000000000000000000000000 P 744d49256cce49a398798149379179d5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 744d49256cce49a398798149379179d5. Latest consensus state: current_term: 1 leader_uuid: "744d49256cce49a398798149379179d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "744d49256cce49a398798149379179d5" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 34529 } } }
I20260812 17:47:10.843896 19725 sys_catalog.cc:458] T 00000000000000000000000000000000 P 744d49256cce49a398798149379179d5 [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:10.845868 19735 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:47:10.852617 19735 catalog_manager.cc:1347] Generated new cluster ID: 8b2a0a316b124bffb510c3cf7ac7f120
I20260812 17:47:10.852721 19735 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:47:10.905052 19735 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:47:10.906106 19735 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:47:10.926424 19735 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 744d49256cce49a398798149379179d5: Generated new TSK 0
I20260812 17:47:10.927287 19735 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.255.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab.
Entry for principal kudu/127.17.255.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab.
I20260812 17:47:10.961645 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.1:0
--local_ip_for_outbound_sockets=127.17.255.1
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:34529
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:45563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:47:11.078140 19762 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:11.078509 19762 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:11.078557 19762 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:11.082623 19762 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:11.082691 19762 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:11.082752 19762 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.1
I20260812 17:47:11.088121 19762 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:45563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.1.keytab
--principal=kudu/127.17.255.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:34529
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19762
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.1
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:11.089315 19762 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:11.090458 19762 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:11.100888 19774 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:11.100901 19772 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:11.100986 19762 server_base.cc:1034] running on GCE node
W20260812 17:47:11.100890 19770 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:11.101557 19762 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:11.102226 19762 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:11.103422 19762 hybrid_clock.cc:648] HybridClock initialized: now 1786556831103402 us; error 32 us; skew 500 ppm
Aug 12 17:47:11 dist-test-slave-tk9z krb5kdc[19573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556831, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:47:11.106524 19762 init.cc:377] Logged in from keytab as kudu/127.17.255.1@KRBTEST.COM (short username kudu)
I20260812 17:47:11.107448 19762 webserver.cc:460] Webserver started at http://127.17.255.1:34353/ using document root <none> and password file <none>
I20260812 17:47:11.108053 19762 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:11.108145 19762 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:11.108394 19762 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:11.110566 19762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-0/data/instance:
uuid: "c62b040f8eaa47d8848b4f3ad917f65f"
format_stamp: "Formatted at 2026-08-12 17:47:11 on dist-test-slave-tk9z"
server_key: "40b453c52c07ea67a835d9fed31845f1"
server_key_iv: "13ecf59444dc2b9e342ae46c272d123c"
server_key_version: "encryptionkey@0"
I20260812 17:47:11.111168 19762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance:
uuid: "c62b040f8eaa47d8848b4f3ad917f65f"
format_stamp: "Formatted at 2026-08-12 17:47:11 on dist-test-slave-tk9z"
server_key: "40b453c52c07ea67a835d9fed31845f1"
server_key_iv: "13ecf59444dc2b9e342ae46c272d123c"
server_key_version: "encryptionkey@0"
I20260812 17:47:11.115021 19762 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 17:47:11.117551 19786 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:11.118896 19762 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20260812 17:47:11.119052 19762 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-0/wal
uuid: "c62b040f8eaa47d8848b4f3ad917f65f"
format_stamp: "Formatted at 2026-08-12 17:47:11 on dist-test-slave-tk9z"
server_key: "40b453c52c07ea67a835d9fed31845f1"
server_key_iv: "13ecf59444dc2b9e342ae46c272d123c"
server_key_version: "encryptionkey@0"
I20260812 17:47:11.119169 19762 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:11.130676 19762 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:11.134167 19762 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:11.134466 19762 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:11.135169 19762 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:47:11.136103 19762 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:47:11.136174 19762 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:11.136247 19762 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:47:11.136291 19762 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:11.146205 19762 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.1:45479
I20260812 17:47:11.146229 19998 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.1:45479 every 8 connection(s)
I20260812 17:47:11.147265 19762 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
I20260812 17:47:11.149590 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 19762
I20260812 17:47:11.149742 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance
I20260812 17:47:11.150111 18428 external_mini_cluster.cc:1428] Setting key 6a9e79ef062dc04d821ff3d4f9326fdb
Aug 12 17:47:11 dist-test-slave-tk9z krb5kdc[19573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556831, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.1@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.255.2@KRBTEST.COM; defaulting to no policy
I20260812 17:47:11.163314 19720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:11.149413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:35761 (local address 127.17.255.62:34529)
0812 17:47:11.149560 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:11.149564 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:11.150847 (+ 1283us) server_negotiation.cc:407] Connection header received
0812 17:47:11.152549 (+ 1702us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:11.152563 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:11.152632 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:11.152731 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:11.154169 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:11.154770 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:11.156104 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:11.156326 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:11.156447 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:11.159276 (+ 2829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:11.159279 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:11.159281 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:11.159306 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:11.160826 (+ 1520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:11.161368 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:11.161371 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:11.161374 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:11.161460 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:11.161901 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:11.161907 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:11.161908 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:11.162198 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:11.162318 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:11.163042 (+ 724us) server_negotiation.cc:299] Negotiation successful
0812 17:47:11.163177 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 17:47:11.164331 20002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:11.149964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34529 (local address 127.17.255.1:35761)
0812 17:47:11.150674 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:11.150743 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:11.152307 (+ 1564us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:11.152905 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:11.152911 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:11.153285 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:47:11.153982 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:11.154009 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:11.154901 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:11.154907 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:11.155983 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:11.155993 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:11.156505 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:11.156510 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:11.156688 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:11.157316 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:47:11.157333 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:47:11.159101 (+ 1768us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:47:11.160951 (+ 1850us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:11.160958 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:11.160982 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:11.161261 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:11.161562 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:11.161565 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:11.161567 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:11.161766 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:11.162363 (+ 597us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:47:11.162440 (+ 77us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:47:11.162750 (+ 310us) client_negotiation.cc:769] Sending connection context
0812 17:47:11.162978 (+ 228us) client_negotiation.cc:240] Negotiation successful
0812 17:47:11.163300 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":187,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.2@KRBTEST.COM" created.
I20260812 17:47:11.165977 19999 heartbeater.cc:347] Connected to a master server at 127.17.255.62:34529
I20260812 17:47:11.166289 19999 heartbeater.cc:464] Registering TS with master...
I20260812 17:47:11.167003 19999 heartbeater.cc:511] Master 127.17.255.62:34529 requested a full tablet report, sending...
I20260812 17:47:11.169088 19649 ts_manager.cc:194] Registered new tserver with Master: c62b040f8eaa47d8848b4f3ad917f65f (127.17.255.1:45479)
I20260812 17:47:11.171075 19649 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.1@KRBTEST.COM'} at 127.17.255.1:35761
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab.
Entry for principal kudu/127.17.255.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab.
I20260812 17:47:11.183422 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.2:0
--local_ip_for_outbound_sockets=127.17.255.2
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:34529
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:45563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:47:11.303283 20006 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:11.303557 20006 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:11.303601 20006 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:11.307725 20006 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:11.307790 20006 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:11.307848 20006 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.2
I20260812 17:47:11.313099 20006 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:45563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.2.keytab
--principal=kudu/127.17.255.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:34529
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20006
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.2
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:11.314193 20006 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:11.315402 20006 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:11.325413 20020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:11.325378 20015 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:11.325378 20017 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:11.325755 20006 server_base.cc:1034] running on GCE node
I20260812 17:47:11.326114 20006 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:11.326814 20006 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:11.327982 20006 hybrid_clock.cc:648] HybridClock initialized: now 1786556831327963 us; error 31 us; skew 500 ppm
Aug 12 17:47:11 dist-test-slave-tk9z krb5kdc[19573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556831, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:47:11.330925 20006 init.cc:377] Logged in from keytab as kudu/127.17.255.2@KRBTEST.COM (short username kudu)
I20260812 17:47:11.331804 20006 webserver.cc:460] Webserver started at http://127.17.255.2:41779/ using document root <none> and password file <none>
I20260812 17:47:11.332331 20006 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:11.332391 20006 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:11.332569 20006 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:11.334630 20006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-1/data/instance:
uuid: "e38caab3ddda48be98c43c142e3527fb"
format_stamp: "Formatted at 2026-08-12 17:47:11 on dist-test-slave-tk9z"
server_key: "1fb253258c9a45c755bbaadbe9cc0c00"
server_key_iv: "5ef8ab912fb8c877ca12ca059da3a2a7"
server_key_version: "encryptionkey@0"
I20260812 17:47:11.335160 20006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance:
uuid: "e38caab3ddda48be98c43c142e3527fb"
format_stamp: "Formatted at 2026-08-12 17:47:11 on dist-test-slave-tk9z"
server_key: "1fb253258c9a45c755bbaadbe9cc0c00"
server_key_iv: "5ef8ab912fb8c877ca12ca059da3a2a7"
server_key_version: "encryptionkey@0"
I20260812 17:47:11.338843 20006 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260812 17:47:11.341246 20031 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:11.342721 20006 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:47:11.342845 20006 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-1/wal
uuid: "e38caab3ddda48be98c43c142e3527fb"
format_stamp: "Formatted at 2026-08-12 17:47:11 on dist-test-slave-tk9z"
server_key: "1fb253258c9a45c755bbaadbe9cc0c00"
server_key_iv: "5ef8ab912fb8c877ca12ca059da3a2a7"
server_key_version: "encryptionkey@0"
I20260812 17:47:11.342983 20006 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:11.357450 20006 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:11.360622 20006 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:11.360790 20006 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:11.361344 20006 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:47:11.362167 20006 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:47:11.362215 20006 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:11.362257 20006 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:47:11.362274 20006 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:11.370800 20006 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.2:43141
I20260812 17:47:11.370877 20244 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.2:43141 every 8 connection(s)
I20260812 17:47:11.371737 20006 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
I20260812 17:47:11.380985 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 20006
I20260812 17:47:11.381102 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance
Aug 12 17:47:11 dist-test-slave-tk9z krb5kdc[19573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556831, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.2@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:47:11.381464 18428 external_mini_cluster.cc:1428] Setting key 3598790fa6b06fed7f9180f1c3e6262a
I20260812 17:47:11.386639 19720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:11.373566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:45451 (local address 127.17.255.62:34529)
0812 17:47:11.373717 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:11.373722 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:11.374654 (+ 932us) server_negotiation.cc:407] Connection header received
0812 17:47:11.375957 (+ 1303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:11.375960 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:11.376009 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:11.376086 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:11.377247 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:11.377801 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:11.378962 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:11.379181 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:11.379264 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:11.382083 (+ 2819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:11.382089 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:11.382095 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:11.382129 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:11.384098 (+ 1969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:11.384663 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:11.384669 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:11.384674 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:11.384780 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:11.385123 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:11.385128 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:11.385133 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:11.385423 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:11.385539 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:11.386310 (+ 771us) server_negotiation.cc:299] Negotiation successful
0812 17:47:11.386508 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 17:47:11.387663 20250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:11.373998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34529 (local address 127.17.255.2:45451)
0812 17:47:11.374506 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:11.374549 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:11.375743 (+ 1194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:11.376248 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:11.376254 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:11.376607 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:47:11.377105 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:11.377121 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:11.377937 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:11.377940 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:11.378845 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:11.378856 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:11.379319 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:11.379321 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:11.379472 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:11.380120 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:47:11.380137 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:47:11.381799 (+ 1662us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:47:11.384239 (+ 2440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:11.384244 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:11.384259 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:11.384556 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:11.384882 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:11.384884 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:11.384885 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:11.385031 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:11.385556 (+ 525us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:47:11.385566 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:47:11.385978 (+ 412us) client_negotiation.cc:769] Sending connection context
0812 17:47:11.386220 (+ 242us) client_negotiation.cc:240] Negotiation successful
0812 17:47:11.386649 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":125,"threads_started":1}
I20260812 17:47:11.388883 20248 heartbeater.cc:347] Connected to a master server at 127.17.255.62:34529
I20260812 17:47:11.389222 20248 heartbeater.cc:464] Registering TS with master...
I20260812 17:47:11.389942 20248 heartbeater.cc:511] Master 127.17.255.62:34529 requested a full tablet report, sending...
I20260812 17:47:11.391302 19649 ts_manager.cc:194] Registered new tserver with Master: e38caab3ddda48be98c43c142e3527fb (127.17.255.2:43141)
I20260812 17:47:11.391912 19649 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.2@KRBTEST.COM'} at 127.17.255.2:45451
WARNING: no policy specified for kudu/127.17.255.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab.
Entry for principal kudu/127.17.255.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab.
I20260812 17:47:11.414431 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.3:0
--local_ip_for_outbound_sockets=127.17.255.3
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:34529
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:45563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:47:11.532466 20256 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:11.532728 20256 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:11.532773 20256 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:11.536738 20256 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:11.536799 20256 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:11.536856 20256 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.3
I20260812 17:47:11.542492 20256 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:45563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.3.keytab
--principal=kudu/127.17.255.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:34529
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20256
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.3
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:11.543570 20256 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:11.544580 20256 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:11.554458 20264 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:11.554467 20272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:11.554553 20256 server_base.cc:1034] running on GCE node
W20260812 17:47:11.554481 20265 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:11.555089 20256 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:11.555783 20256 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:11.556964 20256 hybrid_clock.cc:648] HybridClock initialized: now 1786556831556932 us; error 49 us; skew 500 ppm
Aug 12 17:47:11 dist-test-slave-tk9z krb5kdc[19573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556831, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:47:11.559980 20256 init.cc:377] Logged in from keytab as kudu/127.17.255.3@KRBTEST.COM (short username kudu)
I20260812 17:47:11.560935 20256 webserver.cc:460] Webserver started at http://127.17.255.3:42737/ using document root <none> and password file <none>
I20260812 17:47:11.561522 20256 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:11.561614 20256 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:11.561854 20256 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:11.564026 20256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-2/data/instance:
uuid: "efe01b591c994e009a3483180cba477f"
format_stamp: "Formatted at 2026-08-12 17:47:11 on dist-test-slave-tk9z"
server_key: "ef786feb70c2d782d82aff7c66c3306a"
server_key_iv: "7d9abe7461ac12734631a97ff1245a64"
server_key_version: "encryptionkey@0"
I20260812 17:47:11.564613 20256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance:
uuid: "efe01b591c994e009a3483180cba477f"
format_stamp: "Formatted at 2026-08-12 17:47:11 on dist-test-slave-tk9z"
server_key: "ef786feb70c2d782d82aff7c66c3306a"
server_key_iv: "7d9abe7461ac12734631a97ff1245a64"
server_key_version: "encryptionkey@0"
I20260812 17:47:11.568416 20256 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 17:47:11.571039 20285 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:11.572335 20256 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:47:11.572496 20256 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-2/wal
uuid: "efe01b591c994e009a3483180cba477f"
format_stamp: "Formatted at 2026-08-12 17:47:11 on dist-test-slave-tk9z"
server_key: "ef786feb70c2d782d82aff7c66c3306a"
server_key_iv: "7d9abe7461ac12734631a97ff1245a64"
server_key_version: "encryptionkey@0"
I20260812 17:47:11.572636 20256 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:11.592263 20256 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:11.595969 20256 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:11.596204 20256 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:11.596930 20256 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:47:11.597922 20256 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:47:11.597999 20256 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:11.598079 20256 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:47:11.598130 20256 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:11.608536 20256 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.3:33399
I20260812 17:47:11.608557 20503 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.3:33399 every 8 connection(s)
I20260812 17:47:11.609531 20256 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
I20260812 17:47:11.612563 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 20256
I20260812 17:47:11.612725 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance
I20260812 17:47:11.613114 18428 external_mini_cluster.cc:1428] Setting key c55245c15ae8fda8f200d5564ce91a40
Aug 12 17:47:11 dist-test-slave-tk9z krb5kdc[19573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556831, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.3@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:47:11.624436 19720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:11.611559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:51683 (local address 127.17.255.62:34529)
0812 17:47:11.611713 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:11.611717 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:11.612721 (+ 1004us) server_negotiation.cc:407] Connection header received
0812 17:47:11.614508 (+ 1787us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:11.614511 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:11.614570 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:11.614676 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:11.615989 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:11.616703 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:11.617904 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:11.618138 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:11.618243 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:11.620928 (+ 2685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:11.620937 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:11.620940 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:11.620965 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:11.622314 (+ 1349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:11.622931 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:11.622934 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:11.622936 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:11.623018 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:11.623353 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:11.623358 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:11.623359 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:11.623552 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:11.623659 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:11.624147 (+ 488us) server_negotiation.cc:299] Negotiation successful
0812 17:47:11.624271 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 17:47:11.625240 20506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:11.611966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:34529 (local address 127.17.255.3:51683)
0812 17:47:11.612535 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:11.612602 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:11.614237 (+ 1635us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:11.614875 (+ 638us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:11.614883 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:11.615249 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:47:11.615844 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:11.615859 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:11.616858 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:11.616862 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:11.617774 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:11.617785 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:11.618300 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:11.618304 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:11.618534 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:11.619100 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:47:11.619117 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:47:11.620766 (+ 1649us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:47:11.622528 (+ 1762us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:11.622535 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:11.622550 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:11.622813 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:11.623115 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:11.623118 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:11.623120 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:11.623258 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:11.623657 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:47:11.623664 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:47:11.623907 (+ 243us) client_negotiation.cc:769] Sending connection context
0812 17:47:11.624104 (+ 197us) client_negotiation.cc:240] Negotiation successful
0812 17:47:11.624426 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":113,"threads_started":1}
I20260812 17:47:11.626506 20504 heartbeater.cc:347] Connected to a master server at 127.17.255.62:34529
I20260812 17:47:11.626788 20504 heartbeater.cc:464] Registering TS with master...
I20260812 17:47:11.627456 20504 heartbeater.cc:511] Master 127.17.255.62:34529 requested a full tablet report, sending...
I20260812 17:47:11.628584 19649 ts_manager.cc:194] Registered new tserver with Master: efe01b591c994e009a3483180cba477f (127.17.255.3:33399)
I20260812 17:47:11.629215 19649 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.255.3@KRBTEST.COM'} at 127.17.255.3:51683
I20260812 17:47:11.639271 18428 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 17:47:11.649248 19720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:11.641367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57372 (local address 127.17.255.62:34529)
0812 17:47:11.641523 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:11.641528 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:11.641766 (+ 238us) server_negotiation.cc:407] Connection header received
0812 17:47:11.641885 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:11.641887 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:11.641931 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:11.641997 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:11.642824 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:11.643362 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:11.644219 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:11.644475 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:11.644568 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:11.645933 (+ 1365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:11.645936 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:11.645938 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:11.645966 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:11.647704 (+ 1738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:11.648117 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:11.648120 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:11.648121 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:11.648200 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:11.648440 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:11.648443 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:11.648444 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:11.648670 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:11.648776 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:11.648974 (+ 198us) server_negotiation.cc:299] Negotiation successful
0812 17:47:11.649073 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 17:47:11.652359 19649 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57372:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 17:47:11.655503 19649 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 17:47:11.671130 20527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:11.665460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58528 (local address 127.17.255.3:33399)
0812 17:47:11.666387 (+ 927us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:11.666400 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:11.666421 (+ 21us) server_negotiation.cc:407] Connection header received
0812 17:47:11.666496 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:11.666501 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:11.666703 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:11.666878 (+ 175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:47:11.667353 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:11.668119 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:11.669629 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:11.670364 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:11.670547 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:11.670714 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:11.670837 (+ 123us) server_negotiation.cc:299] Negotiation successful
0812 17:47:11.670953 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":808,"thread_start_us":110,"threads_started":1}
I20260812 17:47:11.671429 20523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:11.664727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:45479 (local address 127.0.0.1:41252)
0812 17:47:11.665713 (+ 986us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:11.665770 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:11.665921 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:11.666935 (+ 1014us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:11.666943 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:11.666975 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:47:11.667224 (+ 249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:11.667228 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:11.668705 (+ 1477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:11.668708 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:11.669878 (+ 1170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:11.669889 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:11.671016 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:11.671020 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:11.671115 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:11.671139 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 17:47:11.671190 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 17:47:11.671255 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":837,"mutex_wait_us":118,"spinlock_wait_cycles":3584,"thread_start_us":108,"threads_started":1}
I20260812 17:47:11.671304 20525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:11.664959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.3:33399 (local address 127.0.0.1:58528)
0812 17:47:11.665840 (+ 881us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:11.665853 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:11.665921 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:11.667021 (+ 1100us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:11.667024 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:11.667033 (+ 9us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:47:11.667221 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:11.667228 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:11.668256 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:11.668260 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:11.669514 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:11.669525 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:11.670545 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:11.670548 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:11.670659 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:11.670698 (+ 39us) client_negotiation.cc:769] Sending connection context
0812 17:47:11.670810 (+ 112us) client_negotiation.cc:240] Negotiation successful
0812 17:47:11.671138 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":813,"mutex_wait_us":63,"thread_start_us":108,"threads_started":1}
I20260812 17:47:11.671945 20524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:11.664963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41252 (local address 127.17.255.1:45479)
0812 17:47:11.666208 (+ 1245us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:11.666230 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:11.666257 (+ 27us) server_negotiation.cc:407] Connection header received
0812 17:47:11.666619 (+ 362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:11.666625 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:11.666778 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:11.666911 (+ 133us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:47:11.667362 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:11.668552 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:11.670004 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:11.670802 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:11.671469 (+ 667us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:11.671638 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:11.671693 (+ 55us) server_negotiation.cc:299] Negotiation successful
0812 17:47:11.671781 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1126,"thread_start_us":94,"threads_started":1}
I20260812 17:47:11.672205 20529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:11.665744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58598 (local address 127.17.255.2:43141)
0812 17:47:11.666240 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:11.666253 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:11.666275 (+ 22us) server_negotiation.cc:407] Connection header received
0812 17:47:11.666353 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:11.666359 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:11.666620 (+ 261us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:11.666778 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:47:11.667362 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:11.668561 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:11.669909 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:11.670802 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:11.670925 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:11.671073 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:11.671943 (+ 870us) server_negotiation.cc:299] Negotiation successful
0812 17:47:11.672062 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":156,"threads_started":1}
I20260812 17:47:11.671782 20522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:11.664698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:43141 (local address 127.0.0.1:58598)
0812 17:47:11.665713 (+ 1015us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:11.665768 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:11.665932 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:11.666955 (+ 1023us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:11.666958 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:11.666977 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:47:11.667220 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:11.667228 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:11.668694 (+ 1466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:11.668697 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:11.669788 (+ 1091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:11.669796 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:11.671130 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:11.671134 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:11.671222 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:11.671498 (+ 276us) client_negotiation.cc:769] Sending connection context
0812 17:47:11.671572 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 17:47:11.671643 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":825,"mutex_wait_us":86,"spinlock_wait_cycles":5632,"thread_start_us":110,"threads_started":1}
I20260812 17:47:11.674785 19874 tablet_service.cc:1467] Processing CreateTablet for tablet 93c179c5cddd488696761a777d77b12e (DEFAULT_TABLE table=test-table [id=036e283fa79f4a979a536f7330ae1fd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:47:11.674782 20377 tablet_service.cc:1467] Processing CreateTablet for tablet 93c179c5cddd488696761a777d77b12e (DEFAULT_TABLE table=test-table [id=036e283fa79f4a979a536f7330ae1fd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:47:11.675899 19874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93c179c5cddd488696761a777d77b12e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:11.675916 20377 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93c179c5cddd488696761a777d77b12e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:11.678454 20118 tablet_service.cc:1467] Processing CreateTablet for tablet 93c179c5cddd488696761a777d77b12e (DEFAULT_TABLE table=test-table [id=036e283fa79f4a979a536f7330ae1fd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:47:11.679674 20118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93c179c5cddd488696761a777d77b12e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:11.682973 20531 tablet_bootstrap.cc:492] T 93c179c5cddd488696761a777d77b12e P efe01b591c994e009a3483180cba477f: Bootstrap starting.
I20260812 17:47:11.684365 20532 tablet_bootstrap.cc:492] T 93c179c5cddd488696761a777d77b12e P c62b040f8eaa47d8848b4f3ad917f65f: Bootstrap starting.
I20260812 17:47:11.685266 20531 tablet_bootstrap.cc:654] T 93c179c5cddd488696761a777d77b12e P efe01b591c994e009a3483180cba477f: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:11.686460 20531 log.cc:824] T 93c179c5cddd488696761a777d77b12e P efe01b591c994e009a3483180cba477f: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:11.686719 20532 tablet_bootstrap.cc:654] T 93c179c5cddd488696761a777d77b12e P c62b040f8eaa47d8848b4f3ad917f65f: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:11.687669 20532 log.cc:824] T 93c179c5cddd488696761a777d77b12e P c62b040f8eaa47d8848b4f3ad917f65f: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:11.688143 20534 tablet_bootstrap.cc:492] T 93c179c5cddd488696761a777d77b12e P e38caab3ddda48be98c43c142e3527fb: Bootstrap starting.
I20260812 17:47:11.689031 20531 tablet_bootstrap.cc:492] T 93c179c5cddd488696761a777d77b12e P efe01b591c994e009a3483180cba477f: No bootstrap required, opened a new log
I20260812 17:47:11.689256 20531 ts_tablet_manager.cc:1397] T 93c179c5cddd488696761a777d77b12e P efe01b591c994e009a3483180cba477f: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260812 17:47:11.689692 20532 tablet_bootstrap.cc:492] T 93c179c5cddd488696761a777d77b12e P c62b040f8eaa47d8848b4f3ad917f65f: No bootstrap required, opened a new log
I20260812 17:47:11.689898 20532 ts_tablet_manager.cc:1397] T 93c179c5cddd488696761a777d77b12e P c62b040f8eaa47d8848b4f3ad917f65f: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260812 17:47:11.691025 20534 tablet_bootstrap.cc:654] T 93c179c5cddd488696761a777d77b12e P e38caab3ddda48be98c43c142e3527fb: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:11.691902 20534 log.cc:824] T 93c179c5cddd488696761a777d77b12e P e38caab3ddda48be98c43c142e3527fb: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:11.693491 20531 raft_consensus.cc:348] T 93c179c5cddd488696761a777d77b12e P efe01b591c994e009a3483180cba477f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e38caab3ddda48be98c43c142e3527fb" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 43141 } } peers { permanent_uuid: "c62b040f8eaa47d8848b4f3ad917f65f" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 45479 } } peers { permanent_uuid: "efe01b591c994e009a3483180cba477f" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 33399 } }
I20260812 17:47:11.693660 20532 raft_consensus.cc:348] T 93c179c5cddd488696761a777d77b12e P c62b040f8eaa47d8848b4f3ad917f65f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e38caab3ddda48be98c43c142e3527fb" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 43141 } } peers { permanent_uuid: "c62b040f8eaa47d8848b4f3ad917f65f" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 45479 } } peers { permanent_uuid: "efe01b591c994e009a3483180cba477f" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 33399 } }
I20260812 17:47:11.693928 20531 raft_consensus.cc:374] T 93c179c5cddd488696761a777d77b12e P efe01b591c994e009a3483180cba477f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:47:11.694027 20532 raft_consensus.cc:374] T 93c179c5cddd488696761a777d77b12e P c62b040f8eaa47d8848b4f3ad917f65f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:47:11.694060 20531 raft_consensus.cc:729] T 93c179c5cddd488696761a777d77b12e P efe01b591c994e009a3483180cba477f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efe01b591c994e009a3483180cba477f, State: Initialized, Role: FOLLOWER
I20260812 17:47:11.694187 20532 raft_consensus.cc:729] T 93c179c5cddd488696761a777d77b12e P c62b040f8eaa47d8848b4f3ad917f65f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c62b040f8eaa47d8848b4f3ad917f65f, State: Initialized, Role: FOLLOWER
I20260812 17:47:11.694214 20534 tablet_bootstrap.cc:492] T 93c179c5cddd488696761a777d77b12e P e38caab3ddda48be98c43c142e3527fb: No bootstrap required, opened a new log
I20260812 17:47:11.694638 20531 consensus_queue.cc:260] T 93c179c5cddd488696761a777d77b12e P efe01b591c994e009a3483180cba477f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e38caab3ddda48be98c43c142e3527fb" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 43141 } } peers { permanent_uuid: "c62b040f8eaa47d8848b4f3ad917f65f" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 45479 } } peers { permanent_uuid: "efe01b591c994e009a3483180cba477f" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 33399 } }
I20260812 17:47:11.694751 20532 consensus_queue.cc:260] T 93c179c5cddd488696761a777d77b12e P c62b040f8eaa47d8848b4f3ad917f65f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e38caab3ddda48be98c43c142e3527fb" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 43141 } } peers { permanent_uuid: "c62b040f8eaa47d8848b4f3ad917f65f" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 45479 } } peers { permanent_uuid: "efe01b591c994e009a3483180cba477f" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 33399 } }
I20260812 17:47:11.694927 20534 ts_tablet_manager.cc:1397] T 93c179c5cddd488696761a777d77b12e P e38caab3ddda48be98c43c142e3527fb: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260812 17:47:11.695493 20504 heartbeater.cc:503] Master 127.17.255.62:34529 was elected leader, sending a full tablet report...
I20260812 17:47:11.695783 20532 ts_tablet_manager.cc:1428] T 93c179c5cddd488696761a777d77b12e P c62b040f8eaa47d8848b4f3ad917f65f: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260812 17:47:11.695801 20531 ts_tablet_manager.cc:1428] T 93c179c5cddd488696761a777d77b12e P efe01b591c994e009a3483180cba477f: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260812 17:47:11.696170 19999 heartbeater.cc:503] Master 127.17.255.62:34529 was elected leader, sending a full tablet report...
I20260812 17:47:11.699285 20534 raft_consensus.cc:348] T 93c179c5cddd488696761a777d77b12e P e38caab3ddda48be98c43c142e3527fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e38caab3ddda48be98c43c142e3527fb" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 43141 } } peers { permanent_uuid: "c62b040f8eaa47d8848b4f3ad917f65f" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 45479 } } peers { permanent_uuid: "efe01b591c994e009a3483180cba477f" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 33399 } }
I20260812 17:47:11.699616 20534 raft_consensus.cc:374] T 93c179c5cddd488696761a777d77b12e P e38caab3ddda48be98c43c142e3527fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:47:11.699694 20534 raft_consensus.cc:729] T 93c179c5cddd488696761a777d77b12e P e38caab3ddda48be98c43c142e3527fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e38caab3ddda48be98c43c142e3527fb, State: Initialized, Role: FOLLOWER
I20260812 17:47:11.700177 20534 consensus_queue.cc:260] T 93c179c5cddd488696761a777d77b12e P e38caab3ddda48be98c43c142e3527fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e38caab3ddda48be98c43c142e3527fb" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 43141 } } peers { permanent_uuid: "c62b040f8eaa47d8848b4f3ad917f65f" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 45479 } } peers { permanent_uuid: "efe01b591c994e009a3483180cba477f" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 33399 } }
I20260812 17:47:11.701032 20248 heartbeater.cc:503] Master 127.17.255.62:34529 was elected leader, sending a full tablet report...
I20260812 17:47:11.701355 20534 ts_tablet_manager.cc:1428] T 93c179c5cddd488696761a777d77b12e P e38caab3ddda48be98c43c142e3527fb: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260812 17:47:11.750903 20542 raft_consensus.cc:482] T 93c179c5cddd488696761a777d77b12e P efe01b591c994e009a3483180cba477f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:47:11.751135 20542 raft_consensus.cc:504] T 93c179c5cddd488696761a777d77b12e P efe01b591c994e009a3483180cba477f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e38caab3ddda48be98c43c142e3527fb" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 43141 } } peers { permanent_uuid: "c62b040f8eaa47d8848b4f3ad917f65f" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 45479 } } peers { permanent_uuid: "efe01b591c994e009a3483180cba477f" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 33399 } }
I20260812 17:47:11.752437 20542 leader_election.cc:288] T 93c179c5cddd488696761a777d77b12e P efe01b591c994e009a3483180cba477f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e38caab3ddda48be98c43c142e3527fb (127.17.255.2:43141), c62b040f8eaa47d8848b4f3ad917f65f (127.17.255.1:45479)
I20260812 17:47:11.758209 20524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:11.752898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:51701 (local address 127.17.255.1:45479)
0812 17:47:11.753096 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:11.753102 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:11.753378 (+ 276us) server_negotiation.cc:407] Connection header received
0812 17:47:11.753443 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:11.753446 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:11.753495 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:11.753586 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:47:11.754014 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:11.754822 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:11.756745 (+ 1923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:11.757474 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:11.757610 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:11.757670 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:11.757986 (+ 316us) server_negotiation.cc:299] Negotiation successful
0812 17:47:11.758065 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260812 17:47:11.758209 20529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:11.752897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:44809 (local address 127.17.255.2:43141)
0812 17:47:11.753038 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:11.753043 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:11.753159 (+ 116us) server_negotiation.cc:407] Connection header received
0812 17:47:11.753360 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:11.753366 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:11.753467 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:11.753574 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:47:11.754014 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:11.754849 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:11.756745 (+ 1896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:11.757466 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:11.757610 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:11.757670 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:11.757986 (+ 316us) server_negotiation.cc:299] Negotiation successful
0812 17:47:11.758065 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 17:47:11.758296 20506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:11.752789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:43141 (local address 127.17.255.3:44809)
0812 17:47:11.753045 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:11.753063 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:11.753185 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:11.753662 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:11.753666 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:11.753713 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:47:11.753870 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:11.753886 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:11.754989 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:11.754993 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:11.756583 (+ 1590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:11.756596 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:11.757637 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:11.757642 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:11.757795 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:11.757864 (+ 69us) client_negotiation.cc:769] Sending connection context
0812 17:47:11.757956 (+ 92us) client_negotiation.cc:240] Negotiation successful
0812 17:47:11.758068 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"mutex_wait_us":204,"spinlock_wait_cycles":9600}
I20260812 17:47:11.758306 20549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:11.752789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:45479 (local address 127.17.255.3:51701)
0812 17:47:11.753265 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:11.753279 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:11.753370 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:11.753662 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:11.753666 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:11.753712 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:47:11.753885 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:11.753891 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:11.754989 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:11.754993 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:11.756586 (+ 1593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:11.756596 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:11.757637 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:11.757642 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:11.757791 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:11.757872 (+ 81us) client_negotiation.cc:769] Sending connection context
0812 17:47:11.757956 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 17:47:11.758068 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":403,"mutex_wait_us":295,"spinlock_wait_cycles":31744,"thread_start_us":155,"threads_started":1}
I20260812 17:47:11.759114 19916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93c179c5cddd488696761a777d77b12e" candidate_uuid: "efe01b591c994e009a3483180cba477f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c62b040f8eaa47d8848b4f3ad917f65f" is_pre_election: true
I20260812 17:47:11.759140 20158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93c179c5cddd488696761a777d77b12e" candidate_uuid: "efe01b591c994e009a3483180cba477f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e38caab3ddda48be98c43c142e3527fb" is_pre_election: true
I20260812 17:47:11.759503 20158 raft_consensus.cc:2454] T 93c179c5cddd488696761a777d77b12e P e38caab3ddda48be98c43c142e3527fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efe01b591c994e009a3483180cba477f in term 0.
I20260812 17:47:11.759503 19916 raft_consensus.cc:2454] T 93c179c5cddd488696761a777d77b12e P c62b040f8eaa47d8848b4f3ad917f65f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efe01b591c994e009a3483180cba477f in term 0.
I20260812 17:47:11.760063 20286 leader_election.cc:302] T 93c179c5cddd488696761a777d77b12e P efe01b591c994e009a3483180cba477f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: c62b040f8eaa47d8848b4f3ad917f65f, e38caab3ddda48be98c43c142e3527fb, efe01b591c994e009a3483180cba477f; no voters:
I20260812 17:47:11.760428 20542 raft_consensus.cc:2781] T 93c179c5cddd488696761a777d77b12e P efe01b591c994e009a3483180cba477f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 17:47:11.760537 20542 raft_consensus.cc:482] T 93c179c5cddd488696761a777d77b12e P efe01b591c994e009a3483180cba477f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 17:47:11.760618 20542 raft_consensus.cc:3037] T 93c179c5cddd488696761a777d77b12e P efe01b591c994e009a3483180cba477f [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:11.761803 20542 raft_consensus.cc:504] T 93c179c5cddd488696761a777d77b12e P efe01b591c994e009a3483180cba477f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e38caab3ddda48be98c43c142e3527fb" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 43141 } } peers { permanent_uuid: "c62b040f8eaa47d8848b4f3ad917f65f" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 45479 } } peers { permanent_uuid: "efe01b591c994e009a3483180cba477f" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 33399 } }
I20260812 17:47:11.762225 20542 leader_election.cc:288] T 93c179c5cddd488696761a777d77b12e P efe01b591c994e009a3483180cba477f [CANDIDATE]: Term 1 election: Requested vote from peers e38caab3ddda48be98c43c142e3527fb (127.17.255.2:43141), c62b040f8eaa47d8848b4f3ad917f65f (127.17.255.1:45479)
I20260812 17:47:11.762636 19916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93c179c5cddd488696761a777d77b12e" candidate_uuid: "efe01b591c994e009a3483180cba477f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c62b040f8eaa47d8848b4f3ad917f65f"
I20260812 17:47:11.762636 20158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93c179c5cddd488696761a777d77b12e" candidate_uuid: "efe01b591c994e009a3483180cba477f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e38caab3ddda48be98c43c142e3527fb"
I20260812 17:47:11.762775 19916 raft_consensus.cc:3037] T 93c179c5cddd488696761a777d77b12e P c62b040f8eaa47d8848b4f3ad917f65f [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:11.762775 20158 raft_consensus.cc:3037] T 93c179c5cddd488696761a777d77b12e P e38caab3ddda48be98c43c142e3527fb [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:11.764163 20158 raft_consensus.cc:2454] T 93c179c5cddd488696761a777d77b12e P e38caab3ddda48be98c43c142e3527fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efe01b591c994e009a3483180cba477f in term 1.
I20260812 17:47:11.764163 19916 raft_consensus.cc:2454] T 93c179c5cddd488696761a777d77b12e P c62b040f8eaa47d8848b4f3ad917f65f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efe01b591c994e009a3483180cba477f in term 1.
I20260812 17:47:11.764521 20286 leader_election.cc:302] T 93c179c5cddd488696761a777d77b12e P efe01b591c994e009a3483180cba477f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: c62b040f8eaa47d8848b4f3ad917f65f, e38caab3ddda48be98c43c142e3527fb, efe01b591c994e009a3483180cba477f; no voters:
I20260812 17:47:11.764681 20542 raft_consensus.cc:2781] T 93c179c5cddd488696761a777d77b12e P efe01b591c994e009a3483180cba477f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:47:11.764905 20542 raft_consensus.cc:686] T 93c179c5cddd488696761a777d77b12e P efe01b591c994e009a3483180cba477f [term 1 LEADER]: Becoming Leader. State: Replica: efe01b591c994e009a3483180cba477f, State: Running, Role: LEADER
I20260812 17:47:11.765249 20542 consensus_queue.cc:237] T 93c179c5cddd488696761a777d77b12e P efe01b591c994e009a3483180cba477f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e38caab3ddda48be98c43c142e3527fb" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 43141 } } peers { permanent_uuid: "c62b040f8eaa47d8848b4f3ad917f65f" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 45479 } } peers { permanent_uuid: "efe01b591c994e009a3483180cba477f" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 33399 } }
I20260812 17:47:11.768523 19649 catalog_manager.cc:5495] T 93c179c5cddd488696761a777d77b12e P efe01b591c994e009a3483180cba477f reported cstate change: term changed from 0 to 1, leader changed from <none> to efe01b591c994e009a3483180cba477f (127.17.255.3). New cstate: current_term: 1 leader_uuid: "efe01b591c994e009a3483180cba477f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e38caab3ddda48be98c43c142e3527fb" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 43141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c62b040f8eaa47d8848b4f3ad917f65f" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 45479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efe01b591c994e009a3483180cba477f" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 33399 } health_report { overall_health: HEALTHY } } }
I20260812 17:47:11.795269 20527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:11.791630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58542 (local address 127.17.255.3:33399)
0812 17:47:11.791759 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:11.791763 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:11.791777 (+ 14us) server_negotiation.cc:407] Connection header received
0812 17:47:11.791863 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:11.791866 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:11.791922 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:11.792021 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:47:11.792259 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:11.792784 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:11.793609 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:11.793823 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:11.793908 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:11.794191 (+ 283us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:47:11.794756 (+ 565us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:47:11.794851 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:11.795010 (+ 159us) server_negotiation.cc:299] Negotiation successful
0812 17:47:11.795091 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 17:47:11.802441 19916 raft_consensus.cc:1261] T 93c179c5cddd488696761a777d77b12e P c62b040f8eaa47d8848b4f3ad917f65f [term 1 FOLLOWER]: Refusing update from remote peer efe01b591c994e009a3483180cba477f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:47:11.802441 20158 raft_consensus.cc:1261] T 93c179c5cddd488696761a777d77b12e P e38caab3ddda48be98c43c142e3527fb [term 1 FOLLOWER]: Refusing update from remote peer efe01b591c994e009a3483180cba477f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:47:11.803304 20553 consensus_queue.cc:1035] T 93c179c5cddd488696761a777d77b12e P efe01b591c994e009a3483180cba477f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e38caab3ddda48be98c43c142e3527fb" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 43141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:47:11.803515 20542 consensus_queue.cc:1035] T 93c179c5cddd488696761a777d77b12e P efe01b591c994e009a3483180cba477f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c62b040f8eaa47d8848b4f3ad917f65f" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 45479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:47:11.810878 20561 mvcc.cc:205] Tried to move back new op lower bound from 7317736783053533184 to 7317736782913155072. Current Snapshot: MvccSnapshot[applied={T|T < 7317736783053533184}]
I20260812 17:47:11.817677 20566 mvcc.cc:205] Tried to move back new op lower bound from 7317736783053533184 to 7317736782913155072. Current Snapshot: MvccSnapshot[applied={T|T < 7317736783053533184}]
I20260812 17:47:11.822966 19649 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57372:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:47:11.823156 19649 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57372:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:47:11.825882 19649 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 744d49256cce49a398798149379179d5: Sending DeleteTablet for 3 replicas of tablet 93c179c5cddd488696761a777d77b12e
I20260812 17:47:11.826874 20377 tablet_service.cc:1514] Processing DeleteTablet for tablet 93c179c5cddd488696761a777d77b12e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:47:11 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:58528
I20260812 17:47:11.826937 19874 tablet_service.cc:1514] Processing DeleteTablet for tablet 93c179c5cddd488696761a777d77b12e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:47:11 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:41252
I20260812 17:47:11.827854 20118 tablet_service.cc:1514] Processing DeleteTablet for tablet 93c179c5cddd488696761a777d77b12e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:47:11 UTC) from {username='kudu', principal='kudu/127.17.255.62@KRBTEST.COM'} at 127.0.0.1:58598
I20260812 17:47:11.828411 20582 tablet_replica.cc:330] T 93c179c5cddd488696761a777d77b12e P e38caab3ddda48be98c43c142e3527fb: stopping tablet replica
I20260812 17:47:11.828498 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 19762
I20260812 17:47:11.839537 20576 tablet_replica.cc:330] T 93c179c5cddd488696761a777d77b12e P efe01b591c994e009a3483180cba477f: stopping tablet replica
I20260812 17:47:11.840044 20576 raft_consensus.cc:2229] T 93c179c5cddd488696761a777d77b12e P efe01b591c994e009a3483180cba477f [term 1 LEADER]: Raft consensus shutting down.
I20260812 17:47:11.840471 20576 raft_consensus.cc:2258] T 93c179c5cddd488696761a777d77b12e P efe01b591c994e009a3483180cba477f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:47:11.844178 20576 ts_tablet_manager.cc:1905] T 93c179c5cddd488696761a777d77b12e P efe01b591c994e009a3483180cba477f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:47:11.847407 20576 ts_tablet_manager.cc:1918] T 93c179c5cddd488696761a777d77b12e P efe01b591c994e009a3483180cba477f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 17:47:11.847522 20576 log.cc:1196] T 93c179c5cddd488696761a777d77b12e P efe01b591c994e009a3483180cba477f: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786556557564181-18428-0/minicluster-data/ts-2/wal/wals/93c179c5cddd488696761a777d77b12e
I20260812 17:47:11.847882 20576 ts_tablet_manager.cc:1939] T 93c179c5cddd488696761a777d77b12e P efe01b591c994e009a3483180cba477f: Deleting consensus metadata
I20260812 17:47:11.849370 19635 catalog_manager.cc:4841] TS efe01b591c994e009a3483180cba477f (127.17.255.3:33399): tablet 93c179c5cddd488696761a777d77b12e (table test-table [id=036e283fa79f4a979a536f7330ae1fd8]) successfully deleted
I20260812 17:47:11.855000 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 20006
W20260812 17:47:11.855144 19634 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.255.1:45479 (error 108)
I20260812 17:47:11.862743 20522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:11.862191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:45479 (local address 127.0.0.1:41260)
0812 17:47:11.862547 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:11.862637 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.1:45479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123}
W20260812 17:47:11.863096 19634 catalog_manager.cc:4584] TS c62b040f8eaa47d8848b4f3ad917f65f (127.17.255.1:45479): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 93c179c5cddd488696761a777d77b12e: Network error: Client connection negotiation failed: client connection to 127.17.255.1:45479: connect: Connection refused (error 111)
I20260812 17:47:11.873649 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 20256
I20260812 17:47:11.875043 20522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:11.874064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:43141 (local address 127.0.0.1:58608)
0812 17:47:11.874852 (+ 788us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:11.874929 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.2:43141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":675}
I20260812 17:47:11.885880 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 19596
2026-08-12T17:47:11Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2697 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-12T17:47:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:47:11Z Disabled control of system clock
I20260812 17:47:11.922811 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:40557
--webserver_interface=127.17.255.62
--webserver_port=0
--builtin_ntp_servers=127.17.255.20:41523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:40557
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 17:47:12.042331 20588 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:12.042695 20588 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:12.042734 20588 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:12.047906 20588 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:47:12.048049 20588 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:12.048067 20588 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:12.048086 20588 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:47:12.048102 20588 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:47:12.053741 20588 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:41523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:40557
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:40557
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20588
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:12.055126 20588 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:12.056612 20588 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:12.065754 20593 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:12.065711 20594 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:12.065759 20596 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:12.065939 20588 server_base.cc:1034] running on GCE node
I20260812 17:47:12.066737 20588 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:12.067886 20588 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:12.069052 20588 hybrid_clock.cc:648] HybridClock initialized: now 1786556832069037 us; error 29 us; skew 500 ppm
I20260812 17:47:12.076619 20588 webserver.cc:460] Webserver started at http://127.17.255.62:46061/ using document root <none> and password file <none>
I20260812 17:47:12.077378 20588 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:12.077458 20588 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:12.077713 20588 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:12.080202 20588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "70cb321a0a5b4709b8a891996786fba3"
format_stamp: "Formatted at 2026-08-12 17:47:12 on dist-test-slave-tk9z"
server_key: "d7b73991051dbeba00440a7a005e129e"
server_key_iv: "9c2c453e171593d313155fa3b39f95d1"
server_key_version: "encryptionkey@0"
I20260812 17:47:12.080870 20588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "70cb321a0a5b4709b8a891996786fba3"
format_stamp: "Formatted at 2026-08-12 17:47:12 on dist-test-slave-tk9z"
server_key: "d7b73991051dbeba00440a7a005e129e"
server_key_iv: "9c2c453e171593d313155fa3b39f95d1"
server_key_version: "encryptionkey@0"
I20260812 17:47:12.085100 20588 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 17:47:12.087957 20612 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:12.089347 20588 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 17:47:12.089525 20588 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "70cb321a0a5b4709b8a891996786fba3"
format_stamp: "Formatted at 2026-08-12 17:47:12 on dist-test-slave-tk9z"
server_key: "d7b73991051dbeba00440a7a005e129e"
server_key_iv: "9c2c453e171593d313155fa3b39f95d1"
server_key_version: "encryptionkey@0"
I20260812 17:47:12.089655 20588 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:12.121932 20588 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:12.122828 20588 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:12.123056 20588 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:12.130760 20588 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:40557
I20260812 17:47:12.130803 20698 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:40557 every 8 connection(s)
I20260812 17:47:12.131822 20588 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:47:12.135277 20699 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:12.139973 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 20588
I20260812 17:47:12.140136 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:47:12.140431 18428 external_mini_cluster.cc:1428] Setting key fd9d13bb2f3794902a6e20502a7438b4
I20260812 17:47:12.141397 20699 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70cb321a0a5b4709b8a891996786fba3: Bootstrap starting.
I20260812 17:47:12.143807 20699 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 70cb321a0a5b4709b8a891996786fba3: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:12.144784 20699 log.cc:824] T 00000000000000000000000000000000 P 70cb321a0a5b4709b8a891996786fba3: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:12.147118 20699 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70cb321a0a5b4709b8a891996786fba3: No bootstrap required, opened a new log
I20260812 17:47:12.150595 20704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:12.141956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38688 (local address 127.17.255.62:40557)
0812 17:47:12.142677 (+ 721us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:12.142692 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:12.142728 (+ 36us) server_negotiation.cc:407] Connection header received
0812 17:47:12.143383 (+ 655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:12.143401 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:12.143804 (+ 403us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:12.144145 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:12.144511 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:12.146022 (+ 1511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:12.147202 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:12.147689 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:12.147817 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:12.148655 (+ 838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:12.148660 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:12.148674 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:47:12.149093 (+ 419us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:12.149154 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:47:12.149174 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:12.149252 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:12.149429 (+ 177us) server_negotiation.cc:299] Negotiation successful
0812 17:47:12.149740 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":136,"threads_started":1}
I20260812 17:47:12.151362 20699 raft_consensus.cc:348] T 00000000000000000000000000000000 P 70cb321a0a5b4709b8a891996786fba3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70cb321a0a5b4709b8a891996786fba3" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40557 } }
I20260812 17:47:12.151616 20699 raft_consensus.cc:374] T 00000000000000000000000000000000 P 70cb321a0a5b4709b8a891996786fba3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:47:12.151677 20699 raft_consensus.cc:729] T 00000000000000000000000000000000 P 70cb321a0a5b4709b8a891996786fba3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70cb321a0a5b4709b8a891996786fba3, State: Initialized, Role: FOLLOWER
I20260812 17:47:12.152155 20699 consensus_queue.cc:260] T 00000000000000000000000000000000 P 70cb321a0a5b4709b8a891996786fba3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70cb321a0a5b4709b8a891996786fba3" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40557 } }
I20260812 17:47:12.152320 20699 raft_consensus.cc:388] T 00000000000000000000000000000000 P 70cb321a0a5b4709b8a891996786fba3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:47:12.152383 20699 raft_consensus.cc:482] T 00000000000000000000000000000000 P 70cb321a0a5b4709b8a891996786fba3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:47:12.152479 20699 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 70cb321a0a5b4709b8a891996786fba3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:12.153585 20699 raft_consensus.cc:504] T 00000000000000000000000000000000 P 70cb321a0a5b4709b8a891996786fba3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70cb321a0a5b4709b8a891996786fba3" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40557 } }
I20260812 17:47:12.153898 20699 leader_election.cc:302] T 00000000000000000000000000000000 P 70cb321a0a5b4709b8a891996786fba3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 70cb321a0a5b4709b8a891996786fba3; no voters:
I20260812 17:47:12.154198 20699 leader_election.cc:288] T 00000000000000000000000000000000 P 70cb321a0a5b4709b8a891996786fba3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:47:12.154299 20710 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 70cb321a0a5b4709b8a891996786fba3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:47:12.154597 20710 raft_consensus.cc:686] T 00000000000000000000000000000000 P 70cb321a0a5b4709b8a891996786fba3 [term 1 LEADER]: Becoming Leader. State: Replica: 70cb321a0a5b4709b8a891996786fba3, State: Running, Role: LEADER
I20260812 17:47:12.154917 20710 consensus_queue.cc:237] T 00000000000000000000000000000000 P 70cb321a0a5b4709b8a891996786fba3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70cb321a0a5b4709b8a891996786fba3" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40557 } }
I20260812 17:47:12.155510 20699 sys_catalog.cc:564] T 00000000000000000000000000000000 P 70cb321a0a5b4709b8a891996786fba3 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:47:12.156677 20716 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70cb321a0a5b4709b8a891996786fba3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 70cb321a0a5b4709b8a891996786fba3. Latest consensus state: current_term: 1 leader_uuid: "70cb321a0a5b4709b8a891996786fba3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70cb321a0a5b4709b8a891996786fba3" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40557 } } }
I20260812 17:47:12.156816 20716 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70cb321a0a5b4709b8a891996786fba3 [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:12.156685 20715 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70cb321a0a5b4709b8a891996786fba3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "70cb321a0a5b4709b8a891996786fba3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70cb321a0a5b4709b8a891996786fba3" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 40557 } } }
I20260812 17:47:12.156921 20715 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70cb321a0a5b4709b8a891996786fba3 [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:12.157277 20727 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:47:12.160440 20727 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:47:12.165645 20727 catalog_manager.cc:1347] Generated new cluster ID: 38fb3f4a056d4f1eb99a0571ec5b62b3
I20260812 17:47:12.165719 20727 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:47:12.175184 20727 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:47:12.176164 20727 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:47:12.182403 20727 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 70cb321a0a5b4709b8a891996786fba3: Generated new TSK 0
I20260812 17:47:12.183185 20727 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 17:47:12.195876 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.1:0
--local_ip_for_outbound_sockets=127.17.255.1
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:40557
--builtin_ntp_servers=127.17.255.20:41523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 17:47:12.313604 20750 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:12.313876 20750 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:12.313946 20750 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:12.318002 20750 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:12.318060 20750 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:12.318138 20750 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.1
I20260812 17:47:12.322973 20750 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:41523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.255.1
--webserver_port=0
--tserver_master_addrs=127.17.255.62:40557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20750
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.1
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:12.324149 20750 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:12.325587 20750 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:12.335863 20761 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:12.335991 20758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:12.335897 20757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:12.336112 20750 server_base.cc:1034] running on GCE node
I20260812 17:47:12.336658 20750 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:12.337328 20750 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:12.338523 20750 hybrid_clock.cc:648] HybridClock initialized: now 1786556832338504 us; error 33 us; skew 500 ppm
I20260812 17:47:12.340518 20750 webserver.cc:460] Webserver started at http://127.17.255.1:40129/ using document root <none> and password file <none>
I20260812 17:47:12.341142 20750 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:12.341234 20750 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:12.341475 20750 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:12.343735 20750 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-0/data/instance:
uuid: "fba54f9196774937a62586695ebb12f4"
format_stamp: "Formatted at 2026-08-12 17:47:12 on dist-test-slave-tk9z"
server_key: "39f8e34680c87ca7ddd0250edc9e1ee2"
server_key_iv: "e42a3696f6921937b1b0a8738b70cce0"
server_key_version: "encryptionkey@0"
I20260812 17:47:12.344355 20750 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance:
uuid: "fba54f9196774937a62586695ebb12f4"
format_stamp: "Formatted at 2026-08-12 17:47:12 on dist-test-slave-tk9z"
server_key: "39f8e34680c87ca7ddd0250edc9e1ee2"
server_key_iv: "e42a3696f6921937b1b0a8738b70cce0"
server_key_version: "encryptionkey@0"
I20260812 17:47:12.348333 20750 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 17:47:12.350925 20771 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:12.352156 20750 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 17:47:12.352288 20750 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-0/wal
uuid: "fba54f9196774937a62586695ebb12f4"
format_stamp: "Formatted at 2026-08-12 17:47:12 on dist-test-slave-tk9z"
server_key: "39f8e34680c87ca7ddd0250edc9e1ee2"
server_key_iv: "e42a3696f6921937b1b0a8738b70cce0"
server_key_version: "encryptionkey@0"
I20260812 17:47:12.352402 20750 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:12.364909 20750 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:12.365588 20750 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:12.365789 20750 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:12.366465 20750 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:47:12.367435 20750 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:47:12.367504 20750 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:12.367574 20750 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:47:12.367614 20750 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:12.376986 20750 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.1:42229
I20260812 17:47:12.377007 20967 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.1:42229 every 8 connection(s)
I20260812 17:47:12.377909 20750 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-0/data/info.pb
I20260812 17:47:12.383284 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 20750
I20260812 17:47:12.383430 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-0/wal/instance
I20260812 17:47:12.383778 18428 external_mini_cluster.cc:1428] Setting key 13d2c96caae2568df7fa0f24f6b434c8
I20260812 17:47:12.385974 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.2:0
--local_ip_for_outbound_sockets=127.17.255.2
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:40557
--builtin_ntp_servers=127.17.255.20:41523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 17:47:12.388263 20704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:12.379831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.1:54813 (local address 127.17.255.62:40557)
0812 17:47:12.379994 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:12.379999 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:12.381127 (+ 1128us) server_negotiation.cc:407] Connection header received
0812 17:47:12.382582 (+ 1455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:12.382585 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:12.382634 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:12.382712 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:12.383755 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:12.384472 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:12.385994 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:12.386400 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:12.386531 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:12.387736 (+ 1205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:12.387740 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:12.387743 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:47:12.387757 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:12.387784 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:47:12.387792 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:12.387876 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:12.388050 (+ 174us) server_negotiation.cc:299] Negotiation successful
0812 17:47:12.388117 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 17:47:12.389348 20970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:12.380270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40557 (local address 127.17.255.1:54813)
0812 17:47:12.380974 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:12.381019 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:12.382337 (+ 1318us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:12.382908 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:12.382915 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:12.383004 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:47:12.383606 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:12.383624 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:12.384624 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:12.384628 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:12.385856 (+ 1228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:12.385868 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:12.386584 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:12.386588 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:12.386755 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:12.387438 (+ 683us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 17:47:12.387441 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:47:12.387486 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 17:47:12.387558 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:47:12.387884 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:47:12.387896 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:47:12.387904 (+ 8us) client_negotiation.cc:769] Sending connection context
0812 17:47:12.388049 (+ 145us) client_negotiation.cc:240] Negotiation successful
0812 17:47:12.388377 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":109,"threads_started":1}
I20260812 17:47:12.390730 20968 heartbeater.cc:347] Connected to a master server at 127.17.255.62:40557
I20260812 17:47:12.390997 20968 heartbeater.cc:464] Registering TS with master...
I20260812 17:47:12.391551 20968 heartbeater.cc:511] Master 127.17.255.62:40557 requested a full tablet report, sending...
I20260812 17:47:12.393378 20635 ts_manager.cc:194] Registered new tserver with Master: fba54f9196774937a62586695ebb12f4 (127.17.255.1:42229)
I20260812 17:47:12.395241 20635 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.255.1:54813
W20260812 17:47:12.508033 20975 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:12.508347 20975 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:12.508389 20975 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:12.513101 20975 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:12.513175 20975 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:12.513233 20975 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.2
I20260812 17:47:12.518177 20975 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:41523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.255.2
--webserver_port=0
--tserver_master_addrs=127.17.255.62:40557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20975
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.2
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:12.519395 20975 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:12.520777 20975 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 17:47:12.530998 20975 server_base.cc:1034] running on GCE node
W20260812 17:47:12.530977 20981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:12.530923 20983 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:12.530928 20980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:12.531617 20975 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:12.532341 20975 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:12.533510 20975 hybrid_clock.cc:648] HybridClock initialized: now 1786556832533489 us; error 35 us; skew 500 ppm
I20260812 17:47:12.535502 20975 webserver.cc:460] Webserver started at http://127.17.255.2:46045/ using document root <none> and password file <none>
I20260812 17:47:12.536136 20975 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:12.536199 20975 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:12.536424 20975 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:12.538668 20975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-1/data/instance:
uuid: "629f5b68022d45adbf522f28e425623a"
format_stamp: "Formatted at 2026-08-12 17:47:12 on dist-test-slave-tk9z"
server_key: "aa4df52d7fd72ab359b70b9121bdb479"
server_key_iv: "2a1ef5855d7256bfff801553848bda58"
server_key_version: "encryptionkey@0"
I20260812 17:47:12.539266 20975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance:
uuid: "629f5b68022d45adbf522f28e425623a"
format_stamp: "Formatted at 2026-08-12 17:47:12 on dist-test-slave-tk9z"
server_key: "aa4df52d7fd72ab359b70b9121bdb479"
server_key_iv: "2a1ef5855d7256bfff801553848bda58"
server_key_version: "encryptionkey@0"
I20260812 17:47:12.543251 20975 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 17:47:12.545790 20990 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:12.547137 20975 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 17:47:12.547271 20975 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-1/wal
uuid: "629f5b68022d45adbf522f28e425623a"
format_stamp: "Formatted at 2026-08-12 17:47:12 on dist-test-slave-tk9z"
server_key: "aa4df52d7fd72ab359b70b9121bdb479"
server_key_iv: "2a1ef5855d7256bfff801553848bda58"
server_key_version: "encryptionkey@0"
I20260812 17:47:12.547377 20975 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:12.567893 20975 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:12.568674 20975 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:12.568877 20975 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:12.569530 20975 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:47:12.570617 20975 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:47:12.570667 20975 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:12.570729 20975 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:47:12.570765 20975 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:12.579718 20975 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.2:33633
I20260812 17:47:12.579751 21174 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.2:33633 every 8 connection(s)
I20260812 17:47:12.580668 20975 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-1/data/info.pb
I20260812 17:47:12.584391 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 20975
I20260812 17:47:12.584548 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-1/wal/instance
I20260812 17:47:12.584838 18428 external_mini_cluster.cc:1428] Setting key 8067df0755fd0099739d21bb0b979e53
I20260812 17:47:12.587134 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.255.3:0
--local_ip_for_outbound_sockets=127.17.255.3
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:40557
--builtin_ntp_servers=127.17.255.20:41523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 17:47:12.591297 20704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:12.582586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:48075 (local address 127.17.255.62:40557)
0812 17:47:12.582730 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:12.582733 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:12.583826 (+ 1093us) server_negotiation.cc:407] Connection header received
0812 17:47:12.585458 (+ 1632us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:12.585462 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:12.585520 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:12.585619 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:12.586895 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:12.587696 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:12.589009 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:12.589265 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:12.589411 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:12.590714 (+ 1303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:12.590718 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:12.590721 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:47:12.590741 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:12.590761 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:47:12.590770 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:12.590860 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:12.591066 (+ 206us) server_negotiation.cc:299] Negotiation successful
0812 17:47:12.591129 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 17:47:12.592347 21180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:12.582953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40557 (local address 127.17.255.2:48075)
0812 17:47:12.583676 (+ 723us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:12.583718 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:12.585206 (+ 1488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:12.585882 (+ 676us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:12.585891 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:12.586014 (+ 123us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:47:12.586734 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:12.586749 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:12.587846 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:12.587849 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:12.588855 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:12.588866 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:12.589458 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:12.589463 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:12.589645 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:12.590357 (+ 712us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 17:47:12.590358 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:47:12.590470 (+ 112us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 17:47:12.590544 (+ 74us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:47:12.590880 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:47:12.590892 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:47:12.590898 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 17:47:12.591038 (+ 140us) client_negotiation.cc:240] Negotiation successful
0812 17:47:12.591364 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":114,"threads_started":1}
I20260812 17:47:12.593583 21176 heartbeater.cc:347] Connected to a master server at 127.17.255.62:40557
I20260812 17:47:12.593848 21176 heartbeater.cc:464] Registering TS with master...
I20260812 17:47:12.594513 21176 heartbeater.cc:511] Master 127.17.255.62:40557 requested a full tablet report, sending...
I20260812 17:47:12.595722 20635 ts_manager.cc:194] Registered new tserver with Master: 629f5b68022d45adbf522f28e425623a (127.17.255.2:33633)
I20260812 17:47:12.596360 20635 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.255.2:48075
W20260812 17:47:12.707338 21182 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:12.707643 21182 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:12.707713 21182 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:12.711747 21182 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:12.711827 21182 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:12.711920 21182 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.255.3
I20260812 17:47:12.716684 21182 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:41523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.255.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.255.3
--webserver_port=0
--tserver_master_addrs=127.17.255.62:40557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21182
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.255.3
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:12.717828 21182 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:12.719316 21182 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:12.729420 21193 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:12.729413 21192 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:12.729528 21182 server_base.cc:1034] running on GCE node
W20260812 17:47:12.729413 21198 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:12.730120 21182 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:12.730854 21182 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:12.732044 21182 hybrid_clock.cc:648] HybridClock initialized: now 1786556832732015 us; error 38 us; skew 500 ppm
I20260812 17:47:12.734014 21182 webserver.cc:460] Webserver started at http://127.17.255.3:38913/ using document root <none> and password file <none>
I20260812 17:47:12.734661 21182 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:12.734750 21182 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:12.734993 21182 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:12.737105 21182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-2/data/instance:
uuid: "3a2d960dde6543f59f140bc49b96e533"
format_stamp: "Formatted at 2026-08-12 17:47:12 on dist-test-slave-tk9z"
server_key: "6698d81aa9ee2b61f77dcc2168d02ec1"
server_key_iv: "42659333e8e4aced9269990bb3190036"
server_key_version: "encryptionkey@0"
I20260812 17:47:12.737690 21182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance:
uuid: "3a2d960dde6543f59f140bc49b96e533"
format_stamp: "Formatted at 2026-08-12 17:47:12 on dist-test-slave-tk9z"
server_key: "6698d81aa9ee2b61f77dcc2168d02ec1"
server_key_iv: "42659333e8e4aced9269990bb3190036"
server_key_version: "encryptionkey@0"
I20260812 17:47:12.741465 21182 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260812 17:47:12.744282 21210 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:12.746079 21182 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 17:47:12.746201 21182 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-2/wal
uuid: "3a2d960dde6543f59f140bc49b96e533"
format_stamp: "Formatted at 2026-08-12 17:47:12 on dist-test-slave-tk9z"
server_key: "6698d81aa9ee2b61f77dcc2168d02ec1"
server_key_iv: "42659333e8e4aced9269990bb3190036"
server_key_version: "encryptionkey@0"
I20260812 17:47:12.746320 21182 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:12.762133 21182 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:12.762960 21182 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:12.763170 21182 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:12.763880 21182 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 17:47:12.764900 21182 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 17:47:12.764972 21182 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:12.765041 21182 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 17:47:12.765085 21182 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:12.774179 21182 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.3:45571
I20260812 17:47:12.774206 21414 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.3:45571 every 8 connection(s)
I20260812 17:47:12.775270 21182 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-2/data/info.pb
I20260812 17:47:12.784847 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 21182
I20260812 17:47:12.785014 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-2/wal/instance
I20260812 17:47:12.785230 20704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:12.777430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.3:39135 (local address 127.17.255.62:40557)
0812 17:47:12.777598 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:12.777604 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:12.778939 (+ 1335us) server_negotiation.cc:407] Connection header received
0812 17:47:12.780373 (+ 1434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:12.780376 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:12.780430 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:12.780529 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:12.781449 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:12.781987 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:12.783160 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:12.783390 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:12.783471 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:12.784628 (+ 1157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:12.784636 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:12.784643 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:47:12.784660 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:12.784689 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:47:12.784704 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:12.784800 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:12.785010 (+ 210us) server_negotiation.cc:299] Negotiation successful
0812 17:47:12.785079 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 17:47:12.785362 18428 external_mini_cluster.cc:1428] Setting key 4cb2f23083c4014bdd57e60b42fa04eb
I20260812 17:47:12.786152 21422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:12.777982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:40557 (local address 127.17.255.3:39135)
0812 17:47:12.778777 (+ 795us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:12.778822 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:12.780147 (+ 1325us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:12.780691 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:12.780698 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:12.780785 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:47:12.781283 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:12.781295 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:12.782106 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:12.782109 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:12.783060 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:12.783071 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:12.783540 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:12.783543 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:12.783686 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:12.784327 (+ 641us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 17:47:12.784329 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:47:12.784369 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 17:47:12.784433 (+ 64us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:47:12.784827 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:47:12.784836 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:47:12.784842 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 17:47:12.785004 (+ 162us) client_negotiation.cc:240] Negotiation successful
0812 17:47:12.785327 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":144,"threads_started":1}
I20260812 17:47:12.787463 21419 heartbeater.cc:347] Connected to a master server at 127.17.255.62:40557
I20260812 17:47:12.787703 21419 heartbeater.cc:464] Registering TS with master...
I20260812 17:47:12.788240 21419 heartbeater.cc:511] Master 127.17.255.62:40557 requested a full tablet report, sending...
I20260812 17:47:12.789242 20632 ts_manager.cc:194] Registered new tserver with Master: 3a2d960dde6543f59f140bc49b96e533 (127.17.255.3:45571)
I20260812 17:47:12.789928 20632 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.255.3:39135
I20260812 17:47:12.799889 18428 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 17:47:12.806149 20704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:12.802118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38692 (local address 127.17.255.62:40557)
0812 17:47:12.802420 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:12.802424 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:12.802439 (+ 15us) server_negotiation.cc:407] Connection header received
0812 17:47:12.802618 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:12.802621 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:12.802670 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:12.802748 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:12.803080 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:12.803609 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:12.804550 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:12.804762 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:12.804839 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:12.805646 (+ 807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:12.805649 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:12.805651 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:47:12.805665 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:12.805686 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:47:12.805694 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:12.805759 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:12.805865 (+ 106us) server_negotiation.cc:299] Negotiation successful
0812 17:47:12.805952 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183}
I20260812 17:47:12.809360 20632 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38692:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 17:47:12.813054 20632 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 17:47:12.830204 21446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:12.823663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54242 (local address 127.17.255.2:33633)
0812 17:47:12.824377 (+ 714us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:12.824392 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:12.824421 (+ 29us) server_negotiation.cc:407] Connection header received
0812 17:47:12.824511 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:12.824515 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:12.824696 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:12.824887 (+ 191us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:47:12.825236 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:12.826656 (+ 1420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:12.828407 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:12.829294 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:12.829442 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:12.829661 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:12.829901 (+ 240us) server_negotiation.cc:299] Negotiation successful
0812 17:47:12.830018 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":545,"thread_start_us":168,"threads_started":1}
I20260812 17:47:12.830202 21440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:12.822979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:33633 (local address 127.0.0.1:54242)
0812 17:47:12.823814 (+ 835us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:12.823831 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:12.823986 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:12.824883 (+ 897us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:12.824890 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:12.824917 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:47:12.825090 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:12.825100 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:12.826800 (+ 1700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:12.826804 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:12.828234 (+ 1430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:12.828246 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:12.829445 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:12.829449 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:12.829631 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:12.829727 (+ 96us) client_negotiation.cc:769] Sending connection context
0812 17:47:12.829862 (+ 135us) client_negotiation.cc:240] Negotiation successful
0812 17:47:12.830010 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":752,"mutex_wait_us":58,"spinlock_wait_cycles":4352,"thread_start_us":126,"threads_started":1}
I20260812 17:47:12.830277 21442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:12.822973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33552 (local address 127.17.255.3:45571)
0812 17:47:12.823495 (+ 522us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:12.823509 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:12.823858 (+ 349us) server_negotiation.cc:407] Connection header received
0812 17:47:12.824526 (+ 668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:12.824535 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:12.824818 (+ 283us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:12.824984 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:47:12.825419 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:12.826705 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:12.828222 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:12.828989 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:12.829104 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:12.829332 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:12.829936 (+ 604us) server_negotiation.cc:299] Negotiation successful
0812 17:47:12.830065 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":410,"thread_start_us":160,"threads_started":1}
I20260812 17:47:12.830801 21441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:12.822766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.3:45571 (local address 127.0.0.1:33552)
0812 17:47:12.823673 (+ 907us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:12.823737 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:12.823987 (+ 250us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:12.825112 (+ 1125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:12.825114 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:12.825137 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:47:12.825251 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:12.825257 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:12.826859 (+ 1602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:12.826862 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:12.828048 (+ 1186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:12.828059 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:12.829447 (+ 1388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:12.829451 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:12.829677 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:12.829729 (+ 52us) client_negotiation.cc:769] Sending connection context
0812 17:47:12.830542 (+ 813us) client_negotiation.cc:240] Negotiation successful
0812 17:47:12.830629 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":684,"mutex_wait_us":116,"spinlock_wait_cycles":7040,"thread_start_us":96,"threads_started":1}
I20260812 17:47:12.831373 21443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:12.823622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:42229 (local address 127.0.0.1:47562)
0812 17:47:12.825416 (+ 1794us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:12.825432 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:12.825532 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:12.826126 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:12.826129 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:12.826148 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:47:12.826255 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:12.826266 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:12.827728 (+ 1462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:12.827731 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:12.828950 (+ 1219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:12.828962 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:12.830460 (+ 1498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:12.830467 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:12.830568 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:12.830592 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 17:47:12.830682 (+ 90us) client_negotiation.cc:240] Negotiation successful
0812 17:47:12.830746 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1716,"thread_start_us":104,"threads_started":1}
I20260812 17:47:12.832176 21447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:12.824131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47562 (local address 127.17.255.1:42229)
0812 17:47:12.825713 (+ 1582us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:12.825725 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:12.825747 (+ 22us) server_negotiation.cc:407] Connection header received
0812 17:47:12.825821 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:12.825825 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:12.825972 (+ 147us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:12.826133 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:47:12.826406 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:12.827580 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:12.829099 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:12.830015 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:12.830123 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:12.830355 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:12.830743 (+ 388us) server_negotiation.cc:299] Negotiation successful
0812 17:47:12.831990 (+ 1247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1467,"thread_start_us":129,"threads_started":1}
I20260812 17:47:12.834355 21069 tablet_service.cc:1467] Processing CreateTablet for tablet e2575af198d0423693441140e569997a (DEFAULT_TABLE table=test-table [id=637d3401da0348cd93bc20a6625d2813]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:47:12.834789 21296 tablet_service.cc:1467] Processing CreateTablet for tablet e2575af198d0423693441140e569997a (DEFAULT_TABLE table=test-table [id=637d3401da0348cd93bc20a6625d2813]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:47:12.835000 20855 tablet_service.cc:1467] Processing CreateTablet for tablet e2575af198d0423693441140e569997a (DEFAULT_TABLE table=test-table [id=637d3401da0348cd93bc20a6625d2813]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 17:47:12.835686 21069 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2575af198d0423693441140e569997a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:12.836004 20855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2575af198d0423693441140e569997a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:12.836002 21296 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2575af198d0423693441140e569997a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:12.843225 21448 tablet_bootstrap.cc:492] T e2575af198d0423693441140e569997a P 3a2d960dde6543f59f140bc49b96e533: Bootstrap starting.
I20260812 17:47:12.844389 21450 tablet_bootstrap.cc:492] T e2575af198d0423693441140e569997a P fba54f9196774937a62586695ebb12f4: Bootstrap starting.
I20260812 17:47:12.845779 21448 tablet_bootstrap.cc:654] T e2575af198d0423693441140e569997a P 3a2d960dde6543f59f140bc49b96e533: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:12.846243 21450 tablet_bootstrap.cc:654] T e2575af198d0423693441140e569997a P fba54f9196774937a62586695ebb12f4: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:12.846730 21449 tablet_bootstrap.cc:492] T e2575af198d0423693441140e569997a P 629f5b68022d45adbf522f28e425623a: Bootstrap starting.
I20260812 17:47:12.846846 21448 log.cc:824] T e2575af198d0423693441140e569997a P 3a2d960dde6543f59f140bc49b96e533: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:12.847124 21450 log.cc:824] T e2575af198d0423693441140e569997a P fba54f9196774937a62586695ebb12f4: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:12.849042 21449 tablet_bootstrap.cc:654] T e2575af198d0423693441140e569997a P 629f5b68022d45adbf522f28e425623a: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:12.849088 21450 tablet_bootstrap.cc:492] T e2575af198d0423693441140e569997a P fba54f9196774937a62586695ebb12f4: No bootstrap required, opened a new log
I20260812 17:47:12.849133 21448 tablet_bootstrap.cc:492] T e2575af198d0423693441140e569997a P 3a2d960dde6543f59f140bc49b96e533: No bootstrap required, opened a new log
I20260812 17:47:12.849327 21448 ts_tablet_manager.cc:1397] T e2575af198d0423693441140e569997a P 3a2d960dde6543f59f140bc49b96e533: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 17:47:12.849326 21450 ts_tablet_manager.cc:1397] T e2575af198d0423693441140e569997a P fba54f9196774937a62586695ebb12f4: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260812 17:47:12.849891 21449 log.cc:824] T e2575af198d0423693441140e569997a P 629f5b68022d45adbf522f28e425623a: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:12.852131 21449 tablet_bootstrap.cc:492] T e2575af198d0423693441140e569997a P 629f5b68022d45adbf522f28e425623a: No bootstrap required, opened a new log
I20260812 17:47:12.852322 21449 ts_tablet_manager.cc:1397] T e2575af198d0423693441140e569997a P 629f5b68022d45adbf522f28e425623a: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260812 17:47:12.853816 21450 raft_consensus.cc:348] T e2575af198d0423693441140e569997a P fba54f9196774937a62586695ebb12f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a2d960dde6543f59f140bc49b96e533" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 45571 } } peers { permanent_uuid: "629f5b68022d45adbf522f28e425623a" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 33633 } } peers { permanent_uuid: "fba54f9196774937a62586695ebb12f4" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 42229 } }
I20260812 17:47:12.853878 21448 raft_consensus.cc:348] T e2575af198d0423693441140e569997a P 3a2d960dde6543f59f140bc49b96e533 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a2d960dde6543f59f140bc49b96e533" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 45571 } } peers { permanent_uuid: "629f5b68022d45adbf522f28e425623a" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 33633 } } peers { permanent_uuid: "fba54f9196774937a62586695ebb12f4" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 42229 } }
I20260812 17:47:12.854130 21448 raft_consensus.cc:374] T e2575af198d0423693441140e569997a P 3a2d960dde6543f59f140bc49b96e533 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:47:12.854132 21450 raft_consensus.cc:374] T e2575af198d0423693441140e569997a P fba54f9196774937a62586695ebb12f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:47:12.854187 21448 raft_consensus.cc:729] T e2575af198d0423693441140e569997a P 3a2d960dde6543f59f140bc49b96e533 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a2d960dde6543f59f140bc49b96e533, State: Initialized, Role: FOLLOWER
I20260812 17:47:12.854194 21450 raft_consensus.cc:729] T e2575af198d0423693441140e569997a P fba54f9196774937a62586695ebb12f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fba54f9196774937a62586695ebb12f4, State: Initialized, Role: FOLLOWER
I20260812 17:47:12.854801 21450 consensus_queue.cc:260] T e2575af198d0423693441140e569997a P fba54f9196774937a62586695ebb12f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a2d960dde6543f59f140bc49b96e533" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 45571 } } peers { permanent_uuid: "629f5b68022d45adbf522f28e425623a" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 33633 } } peers { permanent_uuid: "fba54f9196774937a62586695ebb12f4" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 42229 } }
I20260812 17:47:12.854804 21448 consensus_queue.cc:260] T e2575af198d0423693441140e569997a P 3a2d960dde6543f59f140bc49b96e533 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a2d960dde6543f59f140bc49b96e533" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 45571 } } peers { permanent_uuid: "629f5b68022d45adbf522f28e425623a" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 33633 } } peers { permanent_uuid: "fba54f9196774937a62586695ebb12f4" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 42229 } }
I20260812 17:47:12.855882 21450 ts_tablet_manager.cc:1428] T e2575af198d0423693441140e569997a P fba54f9196774937a62586695ebb12f4: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260812 17:47:12.855878 21448 ts_tablet_manager.cc:1428] T e2575af198d0423693441140e569997a P 3a2d960dde6543f59f140bc49b96e533: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260812 17:47:12.856330 20968 heartbeater.cc:503] Master 127.17.255.62:40557 was elected leader, sending a full tablet report...
I20260812 17:47:12.856531 21419 heartbeater.cc:503] Master 127.17.255.62:40557 was elected leader, sending a full tablet report...
I20260812 17:47:12.856700 21449 raft_consensus.cc:348] T e2575af198d0423693441140e569997a P 629f5b68022d45adbf522f28e425623a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a2d960dde6543f59f140bc49b96e533" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 45571 } } peers { permanent_uuid: "629f5b68022d45adbf522f28e425623a" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 33633 } } peers { permanent_uuid: "fba54f9196774937a62586695ebb12f4" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 42229 } }
I20260812 17:47:12.857009 21449 raft_consensus.cc:374] T e2575af198d0423693441140e569997a P 629f5b68022d45adbf522f28e425623a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:47:12.857074 21449 raft_consensus.cc:729] T e2575af198d0423693441140e569997a P 629f5b68022d45adbf522f28e425623a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629f5b68022d45adbf522f28e425623a, State: Initialized, Role: FOLLOWER
I20260812 17:47:12.857510 21449 consensus_queue.cc:260] T e2575af198d0423693441140e569997a P 629f5b68022d45adbf522f28e425623a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a2d960dde6543f59f140bc49b96e533" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 45571 } } peers { permanent_uuid: "629f5b68022d45adbf522f28e425623a" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 33633 } } peers { permanent_uuid: "fba54f9196774937a62586695ebb12f4" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 42229 } }
I20260812 17:47:12.858196 21176 heartbeater.cc:503] Master 127.17.255.62:40557 was elected leader, sending a full tablet report...
I20260812 17:47:12.859156 21449 ts_tablet_manager.cc:1428] T e2575af198d0423693441140e569997a P 629f5b68022d45adbf522f28e425623a: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
W20260812 17:47:12.879158 20969 tablet.cc:2369] T e2575af198d0423693441140e569997a P fba54f9196774937a62586695ebb12f4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 17:47:13.027784 21421 tablet.cc:2369] T e2575af198d0423693441140e569997a P 3a2d960dde6543f59f140bc49b96e533: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 17:47:13.081898 21177 tablet.cc:2369] T e2575af198d0423693441140e569997a P 629f5b68022d45adbf522f28e425623a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 17:47:13.099360 21467 raft_consensus.cc:482] T e2575af198d0423693441140e569997a P 629f5b68022d45adbf522f28e425623a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 17:47:13.099677 21467 raft_consensus.cc:504] T e2575af198d0423693441140e569997a P 629f5b68022d45adbf522f28e425623a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a2d960dde6543f59f140bc49b96e533" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 45571 } } peers { permanent_uuid: "629f5b68022d45adbf522f28e425623a" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 33633 } } peers { permanent_uuid: "fba54f9196774937a62586695ebb12f4" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 42229 } }
I20260812 17:47:13.100950 21467 leader_election.cc:288] T e2575af198d0423693441140e569997a P 629f5b68022d45adbf522f28e425623a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a2d960dde6543f59f140bc49b96e533 (127.17.255.3:45571), fba54f9196774937a62586695ebb12f4 (127.17.255.1:42229)
I20260812 17:47:13.104964 21447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:13.101616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:49243 (local address 127.17.255.1:42229)
0812 17:47:13.101779 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:13.101784 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:13.101799 (+ 15us) server_negotiation.cc:407] Connection header received
0812 17:47:13.101855 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:13.101862 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:13.101902 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:13.101989 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:47:13.102282 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:13.102863 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:13.103972 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:13.104376 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:13.104504 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:13.104559 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:13.104738 (+ 179us) server_negotiation.cc:299] Negotiation successful
0812 17:47:13.104811 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 17:47:13.104986 21468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:13.101222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:42229 (local address 127.17.255.2:49243)
0812 17:47:13.101560 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:13.101574 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:13.101693 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:13.102002 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:13.102005 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:13.102023 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:47:13.102148 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:13.102154 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:13.102981 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:13.102985 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:13.103843 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:13.103853 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:13.104501 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:13.104505 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:13.104614 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:13.104632 (+ 18us) client_negotiation.cc:769] Sending connection context
0812 17:47:13.104719 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 17:47:13.104791 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"mutex_wait_us":4,"thread_start_us":138,"threads_started":1}
I20260812 17:47:13.104998 21442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:13.101331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.255.2:48365 (local address 127.17.255.3:45571)
0812 17:47:13.101492 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:13.101497 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:13.101806 (+ 309us) server_negotiation.cc:407] Connection header received
0812 17:47:13.101943 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:13.101946 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:13.101999 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:13.102083 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 17:47:13.102351 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:13.102927 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:13.103996 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:13.104394 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:13.104521 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:13.104573 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:13.104785 (+ 212us) server_negotiation.cc:299] Negotiation successful
0812 17:47:13.104869 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 17:47:13.105023 21472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:13.101222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.3:45571 (local address 127.17.255.2:48365)
0812 17:47:13.101696 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:13.101709 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:13.101847 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:13.102097 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:13.102100 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:13.102117 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 17:47:13.102245 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:13.102250 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:13.103047 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:13.103052 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:13.103866 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:13.103875 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:13.104520 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:13.104524 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:13.104663 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:13.104681 (+ 18us) client_negotiation.cc:769] Sending connection context
0812 17:47:13.104767 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 17:47:13.104837 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":401,"mutex_wait_us":94,"thread_start_us":92,"threads_started":1}
I20260812 17:47:13.105684 21339 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2575af198d0423693441140e569997a" candidate_uuid: "629f5b68022d45adbf522f28e425623a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a2d960dde6543f59f140bc49b96e533" is_pre_election: true
I20260812 17:47:13.105679 20890 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2575af198d0423693441140e569997a" candidate_uuid: "629f5b68022d45adbf522f28e425623a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fba54f9196774937a62586695ebb12f4" is_pre_election: true
I20260812 17:47:13.106019 21339 raft_consensus.cc:2454] T e2575af198d0423693441140e569997a P 3a2d960dde6543f59f140bc49b96e533 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 629f5b68022d45adbf522f28e425623a in term 0.
I20260812 17:47:13.106029 20890 raft_consensus.cc:2454] T e2575af198d0423693441140e569997a P fba54f9196774937a62586695ebb12f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 629f5b68022d45adbf522f28e425623a in term 0.
I20260812 17:47:13.106582 20994 leader_election.cc:302] T e2575af198d0423693441140e569997a P 629f5b68022d45adbf522f28e425623a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a2d960dde6543f59f140bc49b96e533, 629f5b68022d45adbf522f28e425623a; no voters:
I20260812 17:47:13.106911 21467 raft_consensus.cc:2781] T e2575af198d0423693441140e569997a P 629f5b68022d45adbf522f28e425623a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 17:47:13.107012 21467 raft_consensus.cc:482] T e2575af198d0423693441140e569997a P 629f5b68022d45adbf522f28e425623a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 17:47:13.107059 21467 raft_consensus.cc:3037] T e2575af198d0423693441140e569997a P 629f5b68022d45adbf522f28e425623a [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:13.108103 21467 raft_consensus.cc:504] T e2575af198d0423693441140e569997a P 629f5b68022d45adbf522f28e425623a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a2d960dde6543f59f140bc49b96e533" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 45571 } } peers { permanent_uuid: "629f5b68022d45adbf522f28e425623a" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 33633 } } peers { permanent_uuid: "fba54f9196774937a62586695ebb12f4" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 42229 } }
I20260812 17:47:13.108462 21467 leader_election.cc:288] T e2575af198d0423693441140e569997a P 629f5b68022d45adbf522f28e425623a [CANDIDATE]: Term 1 election: Requested vote from peers 3a2d960dde6543f59f140bc49b96e533 (127.17.255.3:45571), fba54f9196774937a62586695ebb12f4 (127.17.255.1:42229)
I20260812 17:47:13.108863 21339 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2575af198d0423693441140e569997a" candidate_uuid: "629f5b68022d45adbf522f28e425623a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a2d960dde6543f59f140bc49b96e533"
I20260812 17:47:13.108912 20890 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2575af198d0423693441140e569997a" candidate_uuid: "629f5b68022d45adbf522f28e425623a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fba54f9196774937a62586695ebb12f4"
I20260812 17:47:13.108970 21339 raft_consensus.cc:3037] T e2575af198d0423693441140e569997a P 3a2d960dde6543f59f140bc49b96e533 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:13.109069 20890 raft_consensus.cc:3037] T e2575af198d0423693441140e569997a P fba54f9196774937a62586695ebb12f4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:13.109937 21339 raft_consensus.cc:2454] T e2575af198d0423693441140e569997a P 3a2d960dde6543f59f140bc49b96e533 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629f5b68022d45adbf522f28e425623a in term 1.
I20260812 17:47:13.110235 20890 raft_consensus.cc:2454] T e2575af198d0423693441140e569997a P fba54f9196774937a62586695ebb12f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 629f5b68022d45adbf522f28e425623a in term 1.
I20260812 17:47:13.110244 20994 leader_election.cc:302] T e2575af198d0423693441140e569997a P 629f5b68022d45adbf522f28e425623a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a2d960dde6543f59f140bc49b96e533, 629f5b68022d45adbf522f28e425623a; no voters:
I20260812 17:47:13.110481 21467 raft_consensus.cc:2781] T e2575af198d0423693441140e569997a P 629f5b68022d45adbf522f28e425623a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:47:13.110744 21467 raft_consensus.cc:686] T e2575af198d0423693441140e569997a P 629f5b68022d45adbf522f28e425623a [term 1 LEADER]: Becoming Leader. State: Replica: 629f5b68022d45adbf522f28e425623a, State: Running, Role: LEADER
I20260812 17:47:13.111145 21467 consensus_queue.cc:237] T e2575af198d0423693441140e569997a P 629f5b68022d45adbf522f28e425623a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a2d960dde6543f59f140bc49b96e533" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 45571 } } peers { permanent_uuid: "629f5b68022d45adbf522f28e425623a" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 33633 } } peers { permanent_uuid: "fba54f9196774937a62586695ebb12f4" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 42229 } }
I20260812 17:47:13.114531 20635 catalog_manager.cc:5495] T e2575af198d0423693441140e569997a P 629f5b68022d45adbf522f28e425623a reported cstate change: term changed from 0 to 1, leader changed from <none> to 629f5b68022d45adbf522f28e425623a (127.17.255.2). New cstate: current_term: 1 leader_uuid: "629f5b68022d45adbf522f28e425623a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a2d960dde6543f59f140bc49b96e533" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "629f5b68022d45adbf522f28e425623a" member_type: VOTER last_known_addr { host: "127.17.255.2" port: 33633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fba54f9196774937a62586695ebb12f4" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 42229 } health_report { overall_health: UNKNOWN } } }
I20260812 17:47:13.196328 21446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:13.192655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54248 (local address 127.17.255.2:33633)
0812 17:47:13.192812 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:13.192819 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:13.192837 (+ 18us) server_negotiation.cc:407] Connection header received
0812 17:47:13.192933 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:13.192936 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:13.192999 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:13.193118 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:47:13.193400 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:13.193914 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:13.194810 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:13.195034 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:13.195141 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:13.195462 (+ 321us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:47:13.195912 (+ 450us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:47:13.196052 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:13.196123 (+ 71us) server_negotiation.cc:299] Negotiation successful
0812 17:47:13.196177 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 17:47:13.202677 20890 raft_consensus.cc:1261] T e2575af198d0423693441140e569997a P fba54f9196774937a62586695ebb12f4 [term 1 FOLLOWER]: Refusing update from remote peer 629f5b68022d45adbf522f28e425623a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:47:13.202675 21339 raft_consensus.cc:1261] T e2575af198d0423693441140e569997a P 3a2d960dde6543f59f140bc49b96e533 [term 1 FOLLOWER]: Refusing update from remote peer 629f5b68022d45adbf522f28e425623a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:47:13.203456 21473 consensus_queue.cc:1035] T e2575af198d0423693441140e569997a P 629f5b68022d45adbf522f28e425623a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fba54f9196774937a62586695ebb12f4" member_type: VOTER last_known_addr { host: "127.17.255.1" port: 42229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:47:13.203655 21467 consensus_queue.cc:1035] T e2575af198d0423693441140e569997a P 629f5b68022d45adbf522f28e425623a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a2d960dde6543f59f140bc49b96e533" member_type: VOTER last_known_addr { host: "127.17.255.3" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:47:13.212172 21479 mvcc.cc:205] Tried to move back new op lower bound from 7317736788790083584 to 7317736788425924608. Current Snapshot: MvccSnapshot[applied={T|T < 7317736788790083584}]
I20260812 17:47:13.213877 21478 mvcc.cc:205] Tried to move back new op lower bound from 7317736788790083584 to 7317736788425924608. Current Snapshot: MvccSnapshot[applied={T|T < 7317736788790083584}]
I20260812 17:47:13.220686 20628 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38692:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:47:13.220896 20628 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:38692:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 17:47:13.223587 20628 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 70cb321a0a5b4709b8a891996786fba3: Sending DeleteTablet for 3 replicas of tablet e2575af198d0423693441140e569997a
I20260812 17:47:13.224546 21296 tablet_service.cc:1514] Processing DeleteTablet for tablet e2575af198d0423693441140e569997a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:47:13 UTC) from {username='slave'} at 127.0.0.1:33552
I20260812 17:47:13.224546 21069 tablet_service.cc:1514] Processing DeleteTablet for tablet e2575af198d0423693441140e569997a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:47:13 UTC) from {username='slave'} at 127.0.0.1:54242
I20260812 17:47:13.224658 20855 tablet_service.cc:1514] Processing DeleteTablet for tablet e2575af198d0423693441140e569997a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 17:47:13 UTC) from {username='slave'} at 127.0.0.1:47562
I20260812 17:47:13.225189 21498 tablet_replica.cc:330] T e2575af198d0423693441140e569997a P 3a2d960dde6543f59f140bc49b96e533: stopping tablet replica
I20260812 17:47:13.225597 21498 raft_consensus.cc:2229] T e2575af198d0423693441140e569997a P 3a2d960dde6543f59f140bc49b96e533 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 17:47:13.225906 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 20750
I20260812 17:47:13.226764 21498 raft_consensus.cc:2258] T e2575af198d0423693441140e569997a P 3a2d960dde6543f59f140bc49b96e533 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:47:13.233007 21498 ts_tablet_manager.cc:1905] T e2575af198d0423693441140e569997a P 3a2d960dde6543f59f140bc49b96e533: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:47:13.235812 21498 ts_tablet_manager.cc:1918] T e2575af198d0423693441140e569997a P 3a2d960dde6543f59f140bc49b96e533: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 17:47:13.235940 21498 log.cc:1196] T e2575af198d0423693441140e569997a P 3a2d960dde6543f59f140bc49b96e533: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-2/wal/wals/e2575af198d0423693441140e569997a
I20260812 17:47:13.236305 21498 ts_tablet_manager.cc:1939] T e2575af198d0423693441140e569997a P 3a2d960dde6543f59f140bc49b96e533: Deleting consensus metadata
I20260812 17:47:13.237741 20614 catalog_manager.cc:4841] TS 3a2d960dde6543f59f140bc49b96e533 (127.17.255.3:45571): tablet e2575af198d0423693441140e569997a (table test-table [id=637d3401da0348cd93bc20a6625d2813]) successfully deleted
I20260812 17:47:13.243680 21496 tablet_replica.cc:330] T e2575af198d0423693441140e569997a P 629f5b68022d45adbf522f28e425623a: stopping tablet replica
I20260812 17:47:13.244163 21496 raft_consensus.cc:2229] T e2575af198d0423693441140e569997a P 629f5b68022d45adbf522f28e425623a [term 1 LEADER]: Raft consensus shutting down.
I20260812 17:47:13.244781 21496 raft_consensus.cc:2258] T e2575af198d0423693441140e569997a P 629f5b68022d45adbf522f28e425623a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 17:47:13.246686 21496 ts_tablet_manager.cc:1905] T e2575af198d0423693441140e569997a P 629f5b68022d45adbf522f28e425623a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 17:47:13.250705 21496 ts_tablet_manager.cc:1918] T e2575af198d0423693441140e569997a P 629f5b68022d45adbf522f28e425623a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 17:47:13.250854 21496 log.cc:1196] T e2575af198d0423693441140e569997a P 629f5b68022d45adbf522f28e425623a: Deleting WAL directory at /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786556557564181-18428-0/minicluster-data/ts-1/wal/wals/e2575af198d0423693441140e569997a
I20260812 17:47:13.251332 21496 ts_tablet_manager.cc:1939] T e2575af198d0423693441140e569997a P 629f5b68022d45adbf522f28e425623a: Deleting consensus metadata
W20260812 17:47:13.251636 20616 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.255.1:42229 (error 108)
I20260812 17:47:13.251924 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 20975
I20260812 17:47:13.267023 21443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:13.266654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.1:42229 (local address 127.0.0.1:47574)
0812 17:47:13.266833 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:13.266924 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.1:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260812 17:47:13.267306 20616 catalog_manager.cc:4584] TS fba54f9196774937a62586695ebb12f4 (127.17.255.1:42229): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e2575af198d0423693441140e569997a: Network error: Client connection negotiation failed: client connection to 127.17.255.1:42229: connect: Connection refused (error 111)
I20260812 17:47:13.273145 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 21182
I20260812 17:47:13.280895 21443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:13.273310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.2:33633 (local address 127.0.0.1:54262)
0812 17:47:13.280638 (+ 7328us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:13.280744 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.2:33633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":7154}
I20260812 17:47:13.292441 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 20588
2026-08-12T17:47:13Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1407 ms)
[----------] 6 tests from EncryptionPolicyTest (12170 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:47:13 dist-test-slave-tk9z krb5kdc[21505](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:47:13 dist-test-slave-tk9z krb5kdc[21505](info): set up 2 sockets
Aug 12 17:47:13 dist-test-slave-tk9z krb5kdc[21505](info): commencing operation
krb5kdc: starting...
W20260812 17:47:14.600060 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.280s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:47:14 dist-test-slave-tk9z krb5kdc[21505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556834, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:47:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:47:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 17:47:14.733837 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41061
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41061
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:47:14.855245 21527 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:14.855590 21527 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:14.855672 21527 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:14.859795 21527 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:47:14.859898 21527 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:14.859939 21527 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:14.859997 21527 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:47:14.860033 21527 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:47:14.865595 21527 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41061
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41061
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21527
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:14.866976 21527 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:14.868652 21527 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:14.877902 21533 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:14.878064 21527 server_base.cc:1034] running on GCE node
W20260812 17:47:14.877902 21540 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:14.877930 21535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:14.878878 21527 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:14.880206 21527 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:14.881425 21527 hybrid_clock.cc:648] HybridClock initialized: now 1786556834881390 us; error 52 us; skew 500 ppm
Aug 12 17:47:14 dist-test-slave-tk9z krb5kdc[21505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556834, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:47:14.884537 21527 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 17:47:14.885489 21527 webserver.cc:460] Webserver started at http://127.0.0.1:45507/ using document root <none> and password file <none>
I20260812 17:47:14.886091 21527 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:14.886185 21527 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:14.886482 21527 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:14.888619 21527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "a141b552ed914f4584b63b4f20c7d194"
format_stamp: "Formatted at 2026-08-12 17:47:14 on dist-test-slave-tk9z"
server_key: "49c8e95b4dd223a29d59e28c78d460bb"
server_key_iv: "3c8e1a34aeecb3c64c1174abe3ed22b9"
server_key_version: "encryptionkey@0"
I20260812 17:47:14.889216 21527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "a141b552ed914f4584b63b4f20c7d194"
format_stamp: "Formatted at 2026-08-12 17:47:14 on dist-test-slave-tk9z"
server_key: "49c8e95b4dd223a29d59e28c78d460bb"
server_key_iv: "3c8e1a34aeecb3c64c1174abe3ed22b9"
server_key_version: "encryptionkey@0"
I20260812 17:47:14.893198 21527 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260812 17:47:14.895774 21551 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:14.897044 21527 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 17:47:14.897199 21527 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "a141b552ed914f4584b63b4f20c7d194"
format_stamp: "Formatted at 2026-08-12 17:47:14 on dist-test-slave-tk9z"
server_key: "49c8e95b4dd223a29d59e28c78d460bb"
server_key_iv: "3c8e1a34aeecb3c64c1174abe3ed22b9"
server_key_version: "encryptionkey@0"
I20260812 17:47:14.897339 21527 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:14.922319 21527 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:14.932195 21527 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:14.932472 21527 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:14.944710 21527 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41061
I20260812 17:47:14.945097 21644 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41061 every 8 connection(s)
I20260812 17:47:14.945873 21527 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:47:14.950103 21645 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:14.953505 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 21527
I20260812 17:47:14.953668 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:47:14.953994 18428 external_mini_cluster.cc:1428] Setting key 63e2c37167f80988b773c8a652fe4a91
I20260812 17:47:14.958295 21645 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a141b552ed914f4584b63b4f20c7d194: Bootstrap starting.
I20260812 17:47:14.961061 21645 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a141b552ed914f4584b63b4f20c7d194: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:14.961892 21645 log.cc:824] T 00000000000000000000000000000000 P a141b552ed914f4584b63b4f20c7d194: Log is configured to *not* fsync() on all Append() calls
Aug 12 17:47:14 dist-test-slave-tk9z krb5kdc[21505](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556834, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 17:47:14.964653 21645 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a141b552ed914f4584b63b4f20c7d194: No bootstrap required, opened a new log
I20260812 17:47:14.969122 21645 raft_consensus.cc:348] T 00000000000000000000000000000000 P a141b552ed914f4584b63b4f20c7d194 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a141b552ed914f4584b63b4f20c7d194" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41061 } }
I20260812 17:47:14.969420 21645 raft_consensus.cc:374] T 00000000000000000000000000000000 P a141b552ed914f4584b63b4f20c7d194 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:47:14.969483 21645 raft_consensus.cc:729] T 00000000000000000000000000000000 P a141b552ed914f4584b63b4f20c7d194 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a141b552ed914f4584b63b4f20c7d194, State: Initialized, Role: FOLLOWER
I20260812 17:47:14.970039 21645 consensus_queue.cc:260] T 00000000000000000000000000000000 P a141b552ed914f4584b63b4f20c7d194 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a141b552ed914f4584b63b4f20c7d194" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41061 } }
I20260812 17:47:14.970239 21645 raft_consensus.cc:388] T 00000000000000000000000000000000 P a141b552ed914f4584b63b4f20c7d194 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:47:14.970346 21645 raft_consensus.cc:482] T 00000000000000000000000000000000 P a141b552ed914f4584b63b4f20c7d194 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:47:14.970516 21645 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a141b552ed914f4584b63b4f20c7d194 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:14.970793 21649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:14.956135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33809 (local address 127.0.0.1:41061)
0812 17:47:14.956643 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:14.956671 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:14.956709 (+ 38us) server_negotiation.cc:407] Connection header received
0812 17:47:14.957347 (+ 638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:14.957365 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:14.957721 (+ 356us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:14.958042 (+ 321us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:14.959139 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:14.960184 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:14.961353 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:14.961850 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:14.961976 (+ 126us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:14.965205 (+ 3229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:14.965211 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:14.965227 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:14.965259 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:14.967297 (+ 2038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:14.967879 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:14.967891 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:14.967898 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:14.968023 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:14.968436 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:14.968438 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:14.968440 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:14.968875 (+ 435us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:14.969132 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:14.969486 (+ 354us) server_negotiation.cc:299] Negotiation successful
0812 17:47:14.969760 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":152,"threads_started":1}
I20260812 17:47:14.971678 21645 raft_consensus.cc:504] T 00000000000000000000000000000000 P a141b552ed914f4584b63b4f20c7d194 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a141b552ed914f4584b63b4f20c7d194" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41061 } }
I20260812 17:47:14.972093 21645 leader_election.cc:302] T 00000000000000000000000000000000 P a141b552ed914f4584b63b4f20c7d194 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a141b552ed914f4584b63b4f20c7d194; no voters:
I20260812 17:47:14.972467 21645 leader_election.cc:288] T 00000000000000000000000000000000 P a141b552ed914f4584b63b4f20c7d194 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:47:14.972585 21651 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a141b552ed914f4584b63b4f20c7d194 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:47:14.973166 21651 raft_consensus.cc:686] T 00000000000000000000000000000000 P a141b552ed914f4584b63b4f20c7d194 [term 1 LEADER]: Becoming Leader. State: Replica: a141b552ed914f4584b63b4f20c7d194, State: Running, Role: LEADER
I20260812 17:47:14.973517 21651 consensus_queue.cc:237] T 00000000000000000000000000000000 P a141b552ed914f4584b63b4f20c7d194 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a141b552ed914f4584b63b4f20c7d194" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41061 } }
I20260812 17:47:14.974056 21645 sys_catalog.cc:564] T 00000000000000000000000000000000 P a141b552ed914f4584b63b4f20c7d194 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:47:14.974239 18428 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 17:47:14.975288 21655 sys_catalog.cc:455] T 00000000000000000000000000000000 P a141b552ed914f4584b63b4f20c7d194 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a141b552ed914f4584b63b4f20c7d194. Latest consensus state: current_term: 1 leader_uuid: "a141b552ed914f4584b63b4f20c7d194" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a141b552ed914f4584b63b4f20c7d194" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41061 } } }
I20260812 17:47:14.975443 21655 sys_catalog.cc:458] T 00000000000000000000000000000000 P a141b552ed914f4584b63b4f20c7d194 [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:14.975817 21653 sys_catalog.cc:455] T 00000000000000000000000000000000 P a141b552ed914f4584b63b4f20c7d194 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a141b552ed914f4584b63b4f20c7d194" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a141b552ed914f4584b63b4f20c7d194" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41061 } } }
I20260812 17:47:14.975919 21653 sys_catalog.cc:458] T 00000000000000000000000000000000 P a141b552ed914f4584b63b4f20c7d194 [sys.catalog]: This master's current role is: LEADER
W20260812 17:47:14.979547 21683 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a141b552ed914f4584b63b4f20c7d194: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 17:47:14.979636 21683 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 17:47:14.979712 21664 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:47:14.980667 21664 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:47:14.986974 21664 catalog_manager.cc:1347] Generated new cluster ID: cfad6f00b2c1483281ccf953efae58ce
I20260812 17:47:14.987046 21664 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:47:14.988390 21649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:14.977644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45421 (local address 127.0.0.1:41061)
0812 17:47:14.977768 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:14.977772 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:14.978844 (+ 1072us) server_negotiation.cc:407] Connection header received
0812 17:47:14.979071 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:14.979074 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:14.979126 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:14.979222 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:14.980197 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:14.980947 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:14.982217 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:14.982597 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:14.982719 (+ 122us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:14.984154 (+ 1435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:14.984158 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:14.984161 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:14.984187 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:14.986132 (+ 1945us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:14.986777 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:14.986781 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:14.986783 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:14.986889 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:14.987368 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:14.987372 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:14.987374 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:14.987619 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:14.987791 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:14.988104 (+ 313us) server_negotiation.cc:299] Negotiation successful
0812 17:47:14.988223 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 17:47:15.005240 21664 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:47:15.006246 21664 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:47:15.015451 21664 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a141b552ed914f4584b63b4f20c7d194: Generated new TSK 0
I20260812 17:47:15.016207 21664 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 17:47:15.024856 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 21527
W20260812 17:47:15.045115 21502 connection.cc:535] client connection to 127.0.0.1:41061 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41061): Connection reset by peer (error 104)
2026-08-12T17:47:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1739 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:47:15 dist-test-slave-tk9z krb5kdc[21693](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:47:15 dist-test-slave-tk9z krb5kdc[21693](info): set up 2 sockets
Aug 12 17:47:15 dist-test-slave-tk9z krb5kdc[21693](info): commencing operation
krb5kdc: starting...
W20260812 17:47:16.356997 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.297s user 0.007s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:47:16 dist-test-slave-tk9z krb5kdc[21693](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556836, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:47:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:47:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 17:47:16.490067 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38441
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38441
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:47:16.616231 21718 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:16.616585 21718 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:16.616672 21718 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:16.620693 21718 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:47:16.620796 21718 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:16.620836 21718 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:16.620893 21718 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:47:16.620930 21718 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:47:16.626173 21718 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38441
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38441
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21718
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:16.627318 21718 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:16.628419 21718 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:16.637236 21727 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:16.637236 21730 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:16.637387 21728 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:16.637638 21718 server_base.cc:1034] running on GCE node
I20260812 17:47:16.638412 21718 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:16.639647 21718 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:16.640905 21718 hybrid_clock.cc:648] HybridClock initialized: now 1786556836640881 us; error 38 us; skew 500 ppm
Aug 12 17:47:16 dist-test-slave-tk9z krb5kdc[21693](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556836, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:47:16.644009 21718 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 17:47:16.645079 21718 webserver.cc:460] Webserver started at http://127.0.0.1:40125/ using document root <none> and password file <none>
I20260812 17:47:16.645692 21718 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:16.645790 21718 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:16.646044 21718 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:16.648252 21718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "405c8923f3854cbaaf521397b13c2367"
format_stamp: "Formatted at 2026-08-12 17:47:16 on dist-test-slave-tk9z"
server_key: "ed899d1167e2815352eca737d29f958c"
server_key_iv: "60173f5122dac8b3e388fe2a79175bb5"
server_key_version: "encryptionkey@0"
I20260812 17:47:16.648864 21718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "405c8923f3854cbaaf521397b13c2367"
format_stamp: "Formatted at 2026-08-12 17:47:16 on dist-test-slave-tk9z"
server_key: "ed899d1167e2815352eca737d29f958c"
server_key_iv: "60173f5122dac8b3e388fe2a79175bb5"
server_key_version: "encryptionkey@0"
I20260812 17:47:16.652863 21718 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 17:47:16.655606 21750 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:16.656983 21718 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:47:16.657152 21718 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "405c8923f3854cbaaf521397b13c2367"
format_stamp: "Formatted at 2026-08-12 17:47:16 on dist-test-slave-tk9z"
server_key: "ed899d1167e2815352eca737d29f958c"
server_key_iv: "60173f5122dac8b3e388fe2a79175bb5"
server_key_version: "encryptionkey@0"
I20260812 17:47:16.657284 21718 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:16.676543 21718 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:16.680441 21718 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:16.680706 21718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:16.689529 21718 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38441
I20260812 17:47:16.689586 21829 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38441 every 8 connection(s)
I20260812 17:47:16.690836 21718 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:47:16.694022 21832 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:16.698680 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 21718
I20260812 17:47:16.698868 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:47:16.699200 18428 external_mini_cluster.cc:1428] Setting key c7a3b73b4dc8ab7978c68d1df8b5bfa6
I20260812 17:47:16.700726 21832 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 405c8923f3854cbaaf521397b13c2367: Bootstrap starting.
I20260812 17:47:16.703285 21832 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 405c8923f3854cbaaf521397b13c2367: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:16.704066 21832 log.cc:824] T 00000000000000000000000000000000 P 405c8923f3854cbaaf521397b13c2367: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:16.706516 21832 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 405c8923f3854cbaaf521397b13c2367: No bootstrap required, opened a new log
I20260812 17:47:16.709241 21839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:16.700834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40267 (local address 127.0.0.1:38441)
0812 17:47:16.701338 (+ 504us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:16.701355 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:16.701394 (+ 39us) server_negotiation.cc:407] Connection header received
0812 17:47:16.702062 (+ 668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:16.702079 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:16.702522 (+ 443us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:16.702824 (+ 302us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:16.703170 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:16.704261 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:16.705426 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:16.705920 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:16.706049 (+ 129us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:16.707078 (+ 1029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:16.707083 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:16.707097 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:47:16.707520 (+ 423us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:16.707582 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:47:16.707605 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:16.707717 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:16.708044 (+ 327us) server_negotiation.cc:299] Negotiation successful
0812 17:47:16.708206 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":153,"threads_started":1}
I20260812 17:47:16.710436 21832 raft_consensus.cc:348] T 00000000000000000000000000000000 P 405c8923f3854cbaaf521397b13c2367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "405c8923f3854cbaaf521397b13c2367" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38441 } }
I20260812 17:47:16.710728 21832 raft_consensus.cc:374] T 00000000000000000000000000000000 P 405c8923f3854cbaaf521397b13c2367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:47:16.710810 21832 raft_consensus.cc:729] T 00000000000000000000000000000000 P 405c8923f3854cbaaf521397b13c2367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 405c8923f3854cbaaf521397b13c2367, State: Initialized, Role: FOLLOWER
I20260812 17:47:16.711288 21832 consensus_queue.cc:260] T 00000000000000000000000000000000 P 405c8923f3854cbaaf521397b13c2367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "405c8923f3854cbaaf521397b13c2367" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38441 } }
I20260812 17:47:16.711503 21832 raft_consensus.cc:388] T 00000000000000000000000000000000 P 405c8923f3854cbaaf521397b13c2367 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:47:16.711580 21832 raft_consensus.cc:482] T 00000000000000000000000000000000 P 405c8923f3854cbaaf521397b13c2367 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:47:16.711680 21832 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 405c8923f3854cbaaf521397b13c2367 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:16.712801 18428 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 17:47:16.712790 21832 raft_consensus.cc:504] T 00000000000000000000000000000000 P 405c8923f3854cbaaf521397b13c2367 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "405c8923f3854cbaaf521397b13c2367" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38441 } }
I20260812 17:47:16.713164 21832 leader_election.cc:302] T 00000000000000000000000000000000 P 405c8923f3854cbaaf521397b13c2367 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 405c8923f3854cbaaf521397b13c2367; no voters:
I20260812 17:47:16.713537 21832 leader_election.cc:288] T 00000000000000000000000000000000 P 405c8923f3854cbaaf521397b13c2367 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:47:16.713599 21841 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 405c8923f3854cbaaf521397b13c2367 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:47:16.713825 21841 raft_consensus.cc:686] T 00000000000000000000000000000000 P 405c8923f3854cbaaf521397b13c2367 [term 1 LEADER]: Becoming Leader. State: Replica: 405c8923f3854cbaaf521397b13c2367, State: Running, Role: LEADER
I20260812 17:47:16.714134 21841 consensus_queue.cc:237] T 00000000000000000000000000000000 P 405c8923f3854cbaaf521397b13c2367 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "405c8923f3854cbaaf521397b13c2367" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38441 } }
I20260812 17:47:16.714907 21832 sys_catalog.cc:564] T 00000000000000000000000000000000 P 405c8923f3854cbaaf521397b13c2367 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:47:16.716030 21842 sys_catalog.cc:455] T 00000000000000000000000000000000 P 405c8923f3854cbaaf521397b13c2367 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "405c8923f3854cbaaf521397b13c2367" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "405c8923f3854cbaaf521397b13c2367" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38441 } } }
I20260812 17:47:16.716045 21843 sys_catalog.cc:455] T 00000000000000000000000000000000 P 405c8923f3854cbaaf521397b13c2367 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 405c8923f3854cbaaf521397b13c2367. Latest consensus state: current_term: 1 leader_uuid: "405c8923f3854cbaaf521397b13c2367" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "405c8923f3854cbaaf521397b13c2367" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38441 } } }
I20260812 17:47:16.716285 21843 sys_catalog.cc:458] T 00000000000000000000000000000000 P 405c8923f3854cbaaf521397b13c2367 [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:16.716185 21842 sys_catalog.cc:458] T 00000000000000000000000000000000 P 405c8923f3854cbaaf521397b13c2367 [sys.catalog]: This master's current role is: LEADER
W20260812 17:47:16.720736 21875 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 405c8923f3854cbaaf521397b13c2367: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 17:47:16.720830 21875 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 17:47:16.720904 21868 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:47:16.721145 21839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:16.715045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40527 (local address 127.0.0.1:38441)
0812 17:47:16.715196 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:16.715200 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:16.716456 (+ 1256us) server_negotiation.cc:407] Connection header received
0812 17:47:16.716675 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:16.716678 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:16.716733 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:16.716790 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:16.717258 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:16.717908 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:16.719061 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:16.719381 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:16.719492 (+ 111us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:16.720453 (+ 961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:16.720456 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:16.720459 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:47:16.720473 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:16.720503 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:47:16.720517 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:16.720613 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:16.720824 (+ 211us) server_negotiation.cc:299] Negotiation successful
0812 17:47:16.720869 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260812 17:47:16.721932 21868 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:47:16.727209 21868 catalog_manager.cc:1347] Generated new cluster ID: 80caa79198c942e89eda7c614b06ad13
I20260812 17:47:16.727281 21868 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:47:16.738557 21868 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:47:16.739609 21868 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:47:16.747956 21868 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 405c8923f3854cbaaf521397b13c2367: Generated new TSK 0
I20260812 17:47:16.748698 21868 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 17:47:16.752647 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 21718
W20260812 17:47:16.776928 21690 connection.cc:535] client connection to 127.0.0.1:38441 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38441): Connection reset by peer (error 104)
2026-08-12T17:47:16Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1732 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:47:16 dist-test-slave-tk9z krb5kdc[21891](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:47:16 dist-test-slave-tk9z krb5kdc[21891](info): set up 2 sockets
Aug 12 17:47:16 dist-test-slave-tk9z krb5kdc[21891](info): commencing operation
krb5kdc: starting...
W20260812 17:47:18.095996 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.304s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:47:18 dist-test-slave-tk9z krb5kdc[21891](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556838, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:47:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:47:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 17:47:18.227672 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45825
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45825
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:47:18.345129 21912 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:18.345448 21912 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:18.345547 21912 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:18.349547 21912 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:47:18.349649 21912 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:18.349691 21912 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:18.349731 21912 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:47:18.349766 21912 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:47:18.355113 21912 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45825
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45825
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21912
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:18.356276 21912 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:18.357344 21912 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:18.366302 21921 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:18.366308 21923 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:18.366415 21912 server_base.cc:1034] running on GCE node
W20260812 17:47:18.366308 21927 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:18.367169 21912 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:18.368304 21912 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:18.369520 21912 hybrid_clock.cc:648] HybridClock initialized: now 1786556838369491 us; error 43 us; skew 500 ppm
Aug 12 17:47:18 dist-test-slave-tk9z krb5kdc[21891](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556838, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:47:18.377023 21912 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 17:47:18.377998 21912 webserver.cc:460] Webserver started at http://127.0.0.1:38759/ using document root <none> and password file <none>
I20260812 17:47:18.378664 21912 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:18.378757 21912 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:18.379014 21912 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:18.381110 21912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "1e41ed35b361429d98fb4e354abf3d00"
format_stamp: "Formatted at 2026-08-12 17:47:18 on dist-test-slave-tk9z"
server_key: "245e6b6f4db56f8e955d7fbb8bfe10bf"
server_key_iv: "8caaaaf8389f414d8863da25b9eaf29f"
server_key_version: "encryptionkey@0"
I20260812 17:47:18.381763 21912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "1e41ed35b361429d98fb4e354abf3d00"
format_stamp: "Formatted at 2026-08-12 17:47:18 on dist-test-slave-tk9z"
server_key: "245e6b6f4db56f8e955d7fbb8bfe10bf"
server_key_iv: "8caaaaf8389f414d8863da25b9eaf29f"
server_key_version: "encryptionkey@0"
I20260812 17:47:18.385737 21912 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 17:47:18.388429 21938 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:18.389904 21912 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 17:47:18.390062 21912 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "1e41ed35b361429d98fb4e354abf3d00"
format_stamp: "Formatted at 2026-08-12 17:47:18 on dist-test-slave-tk9z"
server_key: "245e6b6f4db56f8e955d7fbb8bfe10bf"
server_key_iv: "8caaaaf8389f414d8863da25b9eaf29f"
server_key_version: "encryptionkey@0"
I20260812 17:47:18.390188 21912 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:18.395123 21912 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:18.398217 21912 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:18.398474 21912 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:18.405587 21912 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45825
I20260812 17:47:18.405601 22046 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45825 every 8 connection(s)
I20260812 17:47:18.406585 21912 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:47:18.409600 22049 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:18.415194 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 21912
I20260812 17:47:18.415405 22049 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e41ed35b361429d98fb4e354abf3d00: Bootstrap starting.
I20260812 17:47:18.415442 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:47:18.415758 18428 external_mini_cluster.cc:1428] Setting key 0e744145679f45a4bf775591a1d43a95
I20260812 17:47:18.418009 22049 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1e41ed35b361429d98fb4e354abf3d00: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:18.418911 22049 log.cc:824] T 00000000000000000000000000000000 P 1e41ed35b361429d98fb4e354abf3d00: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:18.421356 22049 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e41ed35b361429d98fb4e354abf3d00: No bootstrap required, opened a new log
I20260812 17:47:18.421737 22056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:18.417226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43809 (local address 127.0.0.1:45825)
0812 17:47:18.417699 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:18.417716 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:18.417754 (+ 38us) server_negotiation.cc:407] Connection header received
0812 17:47:18.418652 (+ 898us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:18.418675 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:18.418990 (+ 315us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:18.419426 (+ 436us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:18.420218 (+ 792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:18.420224 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:18.420241 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:47:18.420252 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:18.420335 (+ 83us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:47:18.420363 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:18.420484 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:18.420570 (+ 86us) server_negotiation.cc:299] Negotiation successful
0812 17:47:18.420738 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":137,"threads_started":1}
I20260812 17:47:18.424853 18428 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 17:47:18.426007 22049 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1e41ed35b361429d98fb4e354abf3d00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e41ed35b361429d98fb4e354abf3d00" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45825 } }
I20260812 17:47:18.426362 22049 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1e41ed35b361429d98fb4e354abf3d00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:47:18.426470 22049 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1e41ed35b361429d98fb4e354abf3d00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e41ed35b361429d98fb4e354abf3d00, State: Initialized, Role: FOLLOWER
I20260812 17:47:18.427045 22049 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1e41ed35b361429d98fb4e354abf3d00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e41ed35b361429d98fb4e354abf3d00" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45825 } }
I20260812 17:47:18.427230 22049 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1e41ed35b361429d98fb4e354abf3d00 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:47:18.427309 22049 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e41ed35b361429d98fb4e354abf3d00 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:47:18.427421 22049 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e41ed35b361429d98fb4e354abf3d00 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:18.428467 22049 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e41ed35b361429d98fb4e354abf3d00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e41ed35b361429d98fb4e354abf3d00" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45825 } }
I20260812 17:47:18.428893 22056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:18.427067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57467 (local address 127.0.0.1:45825)
0812 17:47:18.427206 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:18.427212 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:18.427499 (+ 287us) server_negotiation.cc:407] Connection header received
0812 17:47:18.427625 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:18.427628 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:18.427668 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:18.427756 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:18.428510 (+ 754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:18.428514 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:18.428516 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:47:18.428528 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:18.428559 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:47:18.428574 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:18.428654 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:18.428727 (+ 73us) server_negotiation.cc:299] Negotiation successful
0812 17:47:18.428768 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 17:47:18.428913 22049 leader_election.cc:302] T 00000000000000000000000000000000 P 1e41ed35b361429d98fb4e354abf3d00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1e41ed35b361429d98fb4e354abf3d00; no voters:
I20260812 17:47:18.429373 22049 leader_election.cc:288] T 00000000000000000000000000000000 P 1e41ed35b361429d98fb4e354abf3d00 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:47:18.429461 22070 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1e41ed35b361429d98fb4e354abf3d00 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:47:18.429672 22070 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1e41ed35b361429d98fb4e354abf3d00 [term 1 LEADER]: Becoming Leader. State: Replica: 1e41ed35b361429d98fb4e354abf3d00, State: Running, Role: LEADER
I20260812 17:47:18.430034 22070 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1e41ed35b361429d98fb4e354abf3d00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e41ed35b361429d98fb4e354abf3d00" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45825 } }
I20260812 17:47:18.430857 22049 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1e41ed35b361429d98fb4e354abf3d00 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:47:18.431947 22072 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e41ed35b361429d98fb4e354abf3d00 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e41ed35b361429d98fb4e354abf3d00. Latest consensus state: current_term: 1 leader_uuid: "1e41ed35b361429d98fb4e354abf3d00" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e41ed35b361429d98fb4e354abf3d00" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45825 } } }
I20260812 17:47:18.432089 22072 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e41ed35b361429d98fb4e354abf3d00 [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:18.432382 22071 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e41ed35b361429d98fb4e354abf3d00 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1e41ed35b361429d98fb4e354abf3d00" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e41ed35b361429d98fb4e354abf3d00" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45825 } } }
I20260812 17:47:18.432507 22071 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e41ed35b361429d98fb4e354abf3d00 [sys.catalog]: This master's current role is: LEADER
W20260812 17:47:18.436437 22096 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1e41ed35b361429d98fb4e354abf3d00: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 17:47:18.436547 22096 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 17:47:18.436642 22083 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:47:18.437355 22083 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:47:18.443810 22083 catalog_manager.cc:1347] Generated new cluster ID: b2768205dc4644689cac5af89e1ec764
I20260812 17:47:18.443903 22083 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:47:18.453291 22083 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:47:18.453728 22083 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:47:18.461477 22083 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1e41ed35b361429d98fb4e354abf3d00: Generated new TSK 0
I20260812 17:47:18.462319 22083 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 17:47:18.470623 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 21912
2026-08-12T17:47:18Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1715 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:47:18 dist-test-slave-tk9z krb5kdc[22106](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:47:18 dist-test-slave-tk9z krb5kdc[22106](info): set up 2 sockets
Aug 12 17:47:18 dist-test-slave-tk9z krb5kdc[22106](info): commencing operation
krb5kdc: starting...
W20260812 17:47:19.780408 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.272s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:47:19 dist-test-slave-tk9z krb5kdc[22106](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556839, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:47:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:47:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 17:47:19.914166 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34111
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34111
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:47:20.032294 22129 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:20.032621 22129 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:20.032667 22129 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:20.037797 22129 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:47:20.037901 22129 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:20.037926 22129 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:20.037945 22129 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:47:20.037962 22129 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:47:20.043861 22129 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34111
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34111
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22129
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:20.045215 22129 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:20.046244 22129 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:20.055300 22135 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:20.055426 22129 server_base.cc:1034] running on GCE node
W20260812 17:47:20.055294 22137 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:20.055294 22139 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:20.056284 22129 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:20.057557 22129 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:20.058733 22129 hybrid_clock.cc:648] HybridClock initialized: now 1786556840058710 us; error 35 us; skew 500 ppm
Aug 12 17:47:20 dist-test-slave-tk9z krb5kdc[22106](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556840, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:47:20.061818 22129 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 17:47:20.062882 22129 webserver.cc:460] Webserver started at http://127.0.0.1:40361/ using document root <none> and password file <none>
I20260812 17:47:20.063433 22129 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:20.063496 22129 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:20.063671 22129 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:20.065838 22129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "867cb6bff4174fb197f8763b506443a3"
format_stamp: "Formatted at 2026-08-12 17:47:20 on dist-test-slave-tk9z"
server_key: "06371f97c6e8b721042f7707f9b7a473"
server_key_iv: "1c510f034d3e34b832f477cd36acebc4"
server_key_version: "encryptionkey@0"
I20260812 17:47:20.066499 22129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "867cb6bff4174fb197f8763b506443a3"
format_stamp: "Formatted at 2026-08-12 17:47:20 on dist-test-slave-tk9z"
server_key: "06371f97c6e8b721042f7707f9b7a473"
server_key_iv: "1c510f034d3e34b832f477cd36acebc4"
server_key_version: "encryptionkey@0"
I20260812 17:47:20.070547 22129 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 17:47:20.073081 22151 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:20.074600 22129 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:47:20.074766 22129 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "867cb6bff4174fb197f8763b506443a3"
format_stamp: "Formatted at 2026-08-12 17:47:20 on dist-test-slave-tk9z"
server_key: "06371f97c6e8b721042f7707f9b7a473"
server_key_iv: "1c510f034d3e34b832f477cd36acebc4"
server_key_version: "encryptionkey@0"
I20260812 17:47:20.074921 22129 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:20.095276 22129 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:20.098924 22129 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:20.099155 22129 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:20.106709 22129 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34111
I20260812 17:47:20.106745 22240 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34111 every 8 connection(s)
I20260812 17:47:20.107757 22129 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:47:20.110960 22242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:20.111792 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 22129
I20260812 17:47:20.111943 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:47:20.112288 18428 external_mini_cluster.cc:1428] Setting key 2c1d35bdecc29d0b2e055d2dd39d8e59
I20260812 17:47:20.117527 22242 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 867cb6bff4174fb197f8763b506443a3: Bootstrap starting.
I20260812 17:47:20.119861 22242 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 867cb6bff4174fb197f8763b506443a3: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:20.120795 22242 log.cc:824] T 00000000000000000000000000000000 P 867cb6bff4174fb197f8763b506443a3: Log is configured to *not* fsync() on all Append() calls
Aug 12 17:47:20 dist-test-slave-tk9z krb5kdc[22106](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556839, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 17:47:20.123176 22242 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 867cb6bff4174fb197f8763b506443a3: No bootstrap required, opened a new log
I20260812 17:47:20.126912 22242 raft_consensus.cc:348] T 00000000000000000000000000000000 P 867cb6bff4174fb197f8763b506443a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "867cb6bff4174fb197f8763b506443a3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34111 } }
I20260812 17:47:20.127233 22242 raft_consensus.cc:374] T 00000000000000000000000000000000 P 867cb6bff4174fb197f8763b506443a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:47:20.127337 22242 raft_consensus.cc:729] T 00000000000000000000000000000000 P 867cb6bff4174fb197f8763b506443a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 867cb6bff4174fb197f8763b506443a3, State: Initialized, Role: FOLLOWER
I20260812 17:47:20.127812 22242 consensus_queue.cc:260] T 00000000000000000000000000000000 P 867cb6bff4174fb197f8763b506443a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "867cb6bff4174fb197f8763b506443a3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34111 } }
I20260812 17:47:20.127941 22242 raft_consensus.cc:388] T 00000000000000000000000000000000 P 867cb6bff4174fb197f8763b506443a3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:47:20.128033 22242 raft_consensus.cc:482] T 00000000000000000000000000000000 P 867cb6bff4174fb197f8763b506443a3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:47:20.128153 22242 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 867cb6bff4174fb197f8763b506443a3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:20.128427 22246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:20.113905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40141 (local address 127.0.0.1:34111)
0812 17:47:20.114442 (+ 537us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:20.114468 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:20.114515 (+ 47us) server_negotiation.cc:407] Connection header received
0812 17:47:20.115239 (+ 724us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:20.115258 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:20.115636 (+ 378us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:20.116018 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:20.116939 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:20.118095 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:20.119113 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:20.119625 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:20.119831 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:20.122955 (+ 3124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:20.122961 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:20.122976 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:20.123006 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:20.124898 (+ 1892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:20.125431 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:20.125437 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:20.125442 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:20.125564 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:20.125890 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:20.125894 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:20.125896 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:20.126328 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:20.126646 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:20.126953 (+ 307us) server_negotiation.cc:299] Negotiation successful
0812 17:47:20.127345 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":127,"threads_started":1}
I20260812 17:47:20.129194 22242 raft_consensus.cc:504] T 00000000000000000000000000000000 P 867cb6bff4174fb197f8763b506443a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "867cb6bff4174fb197f8763b506443a3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34111 } }
I20260812 17:47:20.129549 22242 leader_election.cc:302] T 00000000000000000000000000000000 P 867cb6bff4174fb197f8763b506443a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 867cb6bff4174fb197f8763b506443a3; no voters:
I20260812 17:47:20.129868 22242 leader_election.cc:288] T 00000000000000000000000000000000 P 867cb6bff4174fb197f8763b506443a3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:47:20.129998 22248 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 867cb6bff4174fb197f8763b506443a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:47:20.130228 22248 raft_consensus.cc:686] T 00000000000000000000000000000000 P 867cb6bff4174fb197f8763b506443a3 [term 1 LEADER]: Becoming Leader. State: Replica: 867cb6bff4174fb197f8763b506443a3, State: Running, Role: LEADER
I20260812 17:47:20.130708 22248 consensus_queue.cc:237] T 00000000000000000000000000000000 P 867cb6bff4174fb197f8763b506443a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "867cb6bff4174fb197f8763b506443a3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34111 } }
I20260812 17:47:20.131273 22242 sys_catalog.cc:564] T 00000000000000000000000000000000 P 867cb6bff4174fb197f8763b506443a3 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:47:20.131834 18428 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 17:47:20.132087 22248 sys_catalog.cc:455] T 00000000000000000000000000000000 P 867cb6bff4174fb197f8763b506443a3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 867cb6bff4174fb197f8763b506443a3. Latest consensus state: current_term: 1 leader_uuid: "867cb6bff4174fb197f8763b506443a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "867cb6bff4174fb197f8763b506443a3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34111 } } }
I20260812 17:47:20.132932 22248 sys_catalog.cc:458] T 00000000000000000000000000000000 P 867cb6bff4174fb197f8763b506443a3 [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:20.132794 22249 sys_catalog.cc:455] T 00000000000000000000000000000000 P 867cb6bff4174fb197f8763b506443a3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "867cb6bff4174fb197f8763b506443a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "867cb6bff4174fb197f8763b506443a3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34111 } } }
I20260812 17:47:20.133291 22249 sys_catalog.cc:458] T 00000000000000000000000000000000 P 867cb6bff4174fb197f8763b506443a3 [sys.catalog]: This master's current role is: LEADER
W20260812 17:47:20.137343 22269 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 867cb6bff4174fb197f8763b506443a3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 17:47:20.137444 22269 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 17:47:20.137511 22264 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:47:20.138578 22264 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:47:20.142812 22246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:20.134679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54755 (local address 127.0.0.1:34111)
0812 17:47:20.134800 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:20.134805 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:20.134949 (+ 144us) server_negotiation.cc:407] Connection header received
0812 17:47:20.135033 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:20.135036 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:20.135086 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:20.135182 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:20.135867 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:20.136407 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:20.137240 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:20.137549 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:20.137681 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:20.139184 (+ 1503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:20.139188 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:20.139191 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:20.139216 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:20.140731 (+ 1515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:20.141279 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:20.141283 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:20.141284 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:20.141380 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:20.141791 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:20.141794 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:20.141796 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:20.142034 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:20.142159 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:20.142538 (+ 379us) server_negotiation.cc:299] Negotiation successful
0812 17:47:20.142663 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 17:47:20.145640 22264 catalog_manager.cc:1347] Generated new cluster ID: ec56ac23370c4965a1f188d632235fd5
I20260812 17:47:20.145721 22264 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:47:20.161900 22264 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:47:20.163071 22264 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:47:20.182475 22264 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 867cb6bff4174fb197f8763b506443a3: Generated new TSK 0
I20260812 17:47:20.183303 22264 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 17:47:20.188355 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 22129
2026-08-12T17:47:20Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1704 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:47:20 dist-test-slave-tk9z krb5kdc[22284](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:47:20 dist-test-slave-tk9z krb5kdc[22284](info): set up 2 sockets
Aug 12 17:47:20 dist-test-slave-tk9z krb5kdc[22284](info): commencing operation
krb5kdc: starting...
W20260812 17:47:21.482820 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.270s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:47:21 dist-test-slave-tk9z krb5kdc[22284](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556841, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:47:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:47:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 17:47:21.622660 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41761
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41761
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:47:21.744057 22308 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:21.744411 22308 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:21.744504 22308 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:21.748661 22308 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:47:21.748776 22308 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:21.748814 22308 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:21.748862 22308 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:47:21.748903 22308 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:47:21.754829 22308 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41761
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41761
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22308
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:21.756085 22308 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:21.757207 22308 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:21.766232 22318 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:21.766300 22320 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:21.766233 22324 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:21.766577 22308 server_base.cc:1034] running on GCE node
I20260812 17:47:21.767279 22308 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:21.768464 22308 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:21.769690 22308 hybrid_clock.cc:648] HybridClock initialized: now 1786556841769672 us; error 35 us; skew 500 ppm
Aug 12 17:47:21 dist-test-slave-tk9z krb5kdc[22284](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556841, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:47:21.772805 22308 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 17:47:21.773880 22308 webserver.cc:460] Webserver started at http://127.0.0.1:39127/ using document root <none> and password file <none>
I20260812 17:47:21.774564 22308 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:21.774667 22308 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:21.774928 22308 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:21.777156 22308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "3ec925b7e77b4478a1c1d50df30b40a3"
format_stamp: "Formatted at 2026-08-12 17:47:21 on dist-test-slave-tk9z"
server_key: "6c0115d71b51acfdeb0069c1b22df8ad"
server_key_iv: "75d5aad90a2b62497865470383cf302c"
server_key_version: "encryptionkey@0"
I20260812 17:47:21.777791 22308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "3ec925b7e77b4478a1c1d50df30b40a3"
format_stamp: "Formatted at 2026-08-12 17:47:21 on dist-test-slave-tk9z"
server_key: "6c0115d71b51acfdeb0069c1b22df8ad"
server_key_iv: "75d5aad90a2b62497865470383cf302c"
server_key_version: "encryptionkey@0"
I20260812 17:47:21.788862 22308 fs_manager.cc:691] Time spent creating directory manager: real 0.011s user 0.005s sys 0.003s
I20260812 17:47:21.791839 22336 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:21.793380 22308 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 17:47:21.793562 22308 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "3ec925b7e77b4478a1c1d50df30b40a3"
format_stamp: "Formatted at 2026-08-12 17:47:21 on dist-test-slave-tk9z"
server_key: "6c0115d71b51acfdeb0069c1b22df8ad"
server_key_iv: "75d5aad90a2b62497865470383cf302c"
server_key_version: "encryptionkey@0"
I20260812 17:47:21.793713 22308 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:21.821358 22308 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:21.824888 22308 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:21.825178 22308 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:21.833886 22308 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41761
I20260812 17:47:21.833986 22427 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41761 every 8 connection(s)
I20260812 17:47:21.835181 22308 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:47:21.838495 22429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:21.841382 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 22308
I20260812 17:47:21.841570 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:47:21.841882 18428 external_mini_cluster.cc:1428] Setting key 462b3ffd317b86d7c12a43eb9807d287
I20260812 17:47:21.845597 22429 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ec925b7e77b4478a1c1d50df30b40a3: Bootstrap starting.
I20260812 17:47:21.848706 22429 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3ec925b7e77b4478a1c1d50df30b40a3: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:21.849705 22429 log.cc:824] T 00000000000000000000000000000000 P 3ec925b7e77b4478a1c1d50df30b40a3: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:21.852644 22429 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ec925b7e77b4478a1c1d50df30b40a3: No bootstrap required, opened a new log
I20260812 17:47:21.853808 22435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:21.843480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59821 (local address 127.0.0.1:41761)
0812 17:47:21.843988 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:21.844009 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:21.844059 (+ 50us) server_negotiation.cc:407] Connection header received
0812 17:47:21.845007 (+ 948us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:21.845033 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:21.845530 (+ 497us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:21.845952 (+ 422us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:21.846440 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:21.847970 (+ 1530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:21.849157 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:21.849904 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:21.850078 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:21.851334 (+ 1256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:21.851343 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:21.851364 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:47:21.851976 (+ 612us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:21.852062 (+ 86us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:47:21.852099 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:21.852228 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:21.852465 (+ 237us) server_negotiation.cc:299] Negotiation successful
0812 17:47:21.852727 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":322,"thread_start_us":128,"threads_started":1}
I20260812 17:47:21.857276 18428 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 17:47:21.857690 22429 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3ec925b7e77b4478a1c1d50df30b40a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ec925b7e77b4478a1c1d50df30b40a3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41761 } }
I20260812 17:47:21.857982 22429 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3ec925b7e77b4478a1c1d50df30b40a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:47:21.858070 22429 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3ec925b7e77b4478a1c1d50df30b40a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ec925b7e77b4478a1c1d50df30b40a3, State: Initialized, Role: FOLLOWER
I20260812 17:47:21.858625 22429 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ec925b7e77b4478a1c1d50df30b40a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ec925b7e77b4478a1c1d50df30b40a3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41761 } }
I20260812 17:47:21.858798 22429 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3ec925b7e77b4478a1c1d50df30b40a3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:47:21.858899 22429 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3ec925b7e77b4478a1c1d50df30b40a3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:47:21.859021 22429 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3ec925b7e77b4478a1c1d50df30b40a3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:21.860368 22429 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3ec925b7e77b4478a1c1d50df30b40a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ec925b7e77b4478a1c1d50df30b40a3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41761 } }
I20260812 17:47:21.860807 22429 leader_election.cc:302] T 00000000000000000000000000000000 P 3ec925b7e77b4478a1c1d50df30b40a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3ec925b7e77b4478a1c1d50df30b40a3; no voters:
I20260812 17:47:21.861191 22429 leader_election.cc:288] T 00000000000000000000000000000000 P 3ec925b7e77b4478a1c1d50df30b40a3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:47:21.861372 22447 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3ec925b7e77b4478a1c1d50df30b40a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:47:21.861634 22447 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3ec925b7e77b4478a1c1d50df30b40a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ec925b7e77b4478a1c1d50df30b40a3, State: Running, Role: LEADER
I20260812 17:47:21.862026 22447 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3ec925b7e77b4478a1c1d50df30b40a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ec925b7e77b4478a1c1d50df30b40a3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41761 } }
I20260812 17:47:21.862725 22429 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3ec925b7e77b4478a1c1d50df30b40a3 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:47:21.864567 22449 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ec925b7e77b4478a1c1d50df30b40a3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3ec925b7e77b4478a1c1d50df30b40a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ec925b7e77b4478a1c1d50df30b40a3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41761 } } }
I20260812 17:47:21.864705 22449 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ec925b7e77b4478a1c1d50df30b40a3 [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:21.865136 22435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:21.859851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53205 (local address 127.0.0.1:41761)
0812 17:47:21.860002 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:21.860008 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:21.860156 (+ 148us) server_negotiation.cc:407] Connection header received
0812 17:47:21.860249 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:21.860252 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:21.860315 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:21.860419 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:21.860750 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:21.861620 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:21.862898 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:21.863279 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:21.863878 (+ 599us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:21.864399 (+ 521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:21.864403 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:21.864406 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:47:21.864419 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:21.864449 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:47:21.864465 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:21.864523 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:21.864882 (+ 359us) server_negotiation.cc:299] Negotiation successful
0812 17:47:21.864944 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 17:47:21.865371 22451 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ec925b7e77b4478a1c1d50df30b40a3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3ec925b7e77b4478a1c1d50df30b40a3. Latest consensus state: current_term: 1 leader_uuid: "3ec925b7e77b4478a1c1d50df30b40a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ec925b7e77b4478a1c1d50df30b40a3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41761 } } }
I20260812 17:47:21.865477 22451 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ec925b7e77b4478a1c1d50df30b40a3 [sys.catalog]: This master's current role is: LEADER
W20260812 17:47:21.868822 22473 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3ec925b7e77b4478a1c1d50df30b40a3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 17:47:21.868902 22473 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 17:47:21.868991 22462 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:47:21.869935 22462 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:47:21.875922 22462 catalog_manager.cc:1347] Generated new cluster ID: 7de73ea68ab448a68fc49ebace919a6f
I20260812 17:47:21.876010 22462 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:47:21.894620 22462 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:47:21.896044 22462 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:47:21.907131 22462 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3ec925b7e77b4478a1c1d50df30b40a3: Generated new TSK 0
I20260812 17:47:21.908026 22462 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 17:47:21.915263 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 22308
2026-08-12T17:47:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1731 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:47:21 dist-test-slave-tk9z krb5kdc[22487](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:47:21 dist-test-slave-tk9z krb5kdc[22487](info): set up 2 sockets
Aug 12 17:47:21 dist-test-slave-tk9z krb5kdc[22487](info): commencing operation
krb5kdc: starting...
W20260812 17:47:23.232116 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.288s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:47:23 dist-test-slave-tk9z krb5kdc[22487](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556843, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:47:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:47:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 17:47:23.366032 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40053
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45807
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40053
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:47:23.486409 22512 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:23.486703 22512 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:23.486748 22512 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:23.490937 22512 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:47:23.491014 22512 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:23.491034 22512 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:23.491051 22512 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:47:23.491066 22512 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:47:23.496574 22512 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45807
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40053
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40053
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22512
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:23.497776 22512 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:23.498989 22512 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:23.508154 22522 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:23.508154 22523 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:23.508533 22512 server_base.cc:1034] running on GCE node
W20260812 17:47:23.508563 22529 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:23.509157 22512 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:23.510428 22512 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:23.511643 22512 hybrid_clock.cc:648] HybridClock initialized: now 1786556843511618 us; error 36 us; skew 500 ppm
Aug 12 17:47:23 dist-test-slave-tk9z krb5kdc[22487](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556843, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:47:23.519363 22512 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 17:47:23.520390 22512 webserver.cc:460] Webserver started at http://127.0.0.1:44495/ using document root <none> and password file <none>
I20260812 17:47:23.520972 22512 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:23.521034 22512 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:23.521209 22512 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:23.523486 22512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "5de79f45b7d1409fa4bcb1e64b310da5"
format_stamp: "Formatted at 2026-08-12 17:47:23 on dist-test-slave-tk9z"
server_key: "2cebf36b93da0a9001b1bbec3358767d"
server_key_iv: "1aad07ce3f5b975ceb9e379bf20dea38"
server_key_version: "encryptionkey@0"
I20260812 17:47:23.524083 22512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "5de79f45b7d1409fa4bcb1e64b310da5"
format_stamp: "Formatted at 2026-08-12 17:47:23 on dist-test-slave-tk9z"
server_key: "2cebf36b93da0a9001b1bbec3358767d"
server_key_iv: "1aad07ce3f5b975ceb9e379bf20dea38"
server_key_version: "encryptionkey@0"
I20260812 17:47:23.528141 22512 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 17:47:23.531045 22544 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:23.532496 22512 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:47:23.532672 22512 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "5de79f45b7d1409fa4bcb1e64b310da5"
format_stamp: "Formatted at 2026-08-12 17:47:23 on dist-test-slave-tk9z"
server_key: "2cebf36b93da0a9001b1bbec3358767d"
server_key_iv: "1aad07ce3f5b975ceb9e379bf20dea38"
server_key_version: "encryptionkey@0"
I20260812 17:47:23.532830 22512 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:23.537925 22512 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:23.541595 22512 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:23.541860 22512 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:23.549808 22512 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40053
I20260812 17:47:23.549870 22646 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40053 every 8 connection(s)
I20260812 17:47:23.550942 22512 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:47:23.553998 22647 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:23.554417 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 22512
I20260812 17:47:23.554590 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:47:23.554920 18428 external_mini_cluster.cc:1428] Setting key 06c1d941b9f020ba2b9b91c619725c57
I20260812 17:47:23.560564 22652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:23.556541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52083 (local address 127.0.0.1:40053)
0812 17:47:23.557026 (+ 485us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:23.557042 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:23.557080 (+ 38us) server_negotiation.cc:407] Connection header received
0812 17:47:23.557792 (+ 712us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:23.557812 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:23.558112 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:23.558502 (+ 390us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:23.559350 (+ 848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:23.559356 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:23.559370 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:47:23.559380 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:23.559439 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:47:23.559459 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:23.559616 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:23.559692 (+ 76us) server_negotiation.cc:299] Negotiation successful
0812 17:47:23.559856 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":144,"threads_started":1}
I20260812 17:47:23.561484 22647 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5de79f45b7d1409fa4bcb1e64b310da5: Bootstrap starting.
I20260812 17:47:23.563592 18428 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 17:47:23.564198 22647 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5de79f45b7d1409fa4bcb1e64b310da5: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:23.565013 22647 log.cc:824] T 00000000000000000000000000000000 P 5de79f45b7d1409fa4bcb1e64b310da5: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:23.567242 22647 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5de79f45b7d1409fa4bcb1e64b310da5: No bootstrap required, opened a new log
I20260812 17:47:23.567698 22652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:23.565815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35537 (local address 127.0.0.1:40053)
0812 17:47:23.565951 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:23.565956 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:23.566178 (+ 222us) server_negotiation.cc:407] Connection header received
0812 17:47:23.566341 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:23.566349 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:23.566429 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:23.566523 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:23.567281 (+ 758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:23.567285 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:23.567290 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:47:23.567307 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:23.567340 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:47:23.567353 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:23.567440 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:23.567538 (+ 98us) server_negotiation.cc:299] Negotiation successful
0812 17:47:23.567581 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 17:47:23.571305 22647 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5de79f45b7d1409fa4bcb1e64b310da5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5de79f45b7d1409fa4bcb1e64b310da5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40053 } }
I20260812 17:47:23.571556 22647 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5de79f45b7d1409fa4bcb1e64b310da5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:47:23.571616 22647 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5de79f45b7d1409fa4bcb1e64b310da5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5de79f45b7d1409fa4bcb1e64b310da5, State: Initialized, Role: FOLLOWER
I20260812 17:47:23.572111 22647 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5de79f45b7d1409fa4bcb1e64b310da5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5de79f45b7d1409fa4bcb1e64b310da5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40053 } }
I20260812 17:47:23.572299 22647 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5de79f45b7d1409fa4bcb1e64b310da5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:47:23.572402 22647 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5de79f45b7d1409fa4bcb1e64b310da5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:47:23.572539 22647 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5de79f45b7d1409fa4bcb1e64b310da5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:23.573613 22647 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5de79f45b7d1409fa4bcb1e64b310da5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5de79f45b7d1409fa4bcb1e64b310da5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40053 } }
I20260812 17:47:23.573988 22647 leader_election.cc:302] T 00000000000000000000000000000000 P 5de79f45b7d1409fa4bcb1e64b310da5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5de79f45b7d1409fa4bcb1e64b310da5; no voters:
I20260812 17:47:23.574362 22647 leader_election.cc:288] T 00000000000000000000000000000000 P 5de79f45b7d1409fa4bcb1e64b310da5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:47:23.574570 22667 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5de79f45b7d1409fa4bcb1e64b310da5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:47:23.574819 22667 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5de79f45b7d1409fa4bcb1e64b310da5 [term 1 LEADER]: Becoming Leader. State: Replica: 5de79f45b7d1409fa4bcb1e64b310da5, State: Running, Role: LEADER
I20260812 17:47:23.575230 22667 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5de79f45b7d1409fa4bcb1e64b310da5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5de79f45b7d1409fa4bcb1e64b310da5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40053 } }
I20260812 17:47:23.575769 22647 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5de79f45b7d1409fa4bcb1e64b310da5 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:47:23.577121 22668 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5de79f45b7d1409fa4bcb1e64b310da5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5de79f45b7d1409fa4bcb1e64b310da5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5de79f45b7d1409fa4bcb1e64b310da5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40053 } } }
I20260812 17:47:23.577258 22668 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5de79f45b7d1409fa4bcb1e64b310da5 [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:23.577693 22670 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5de79f45b7d1409fa4bcb1e64b310da5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5de79f45b7d1409fa4bcb1e64b310da5. Latest consensus state: current_term: 1 leader_uuid: "5de79f45b7d1409fa4bcb1e64b310da5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5de79f45b7d1409fa4bcb1e64b310da5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40053 } } }
I20260812 17:47:23.577755 22679 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:47:23.578456 22670 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5de79f45b7d1409fa4bcb1e64b310da5 [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:23.581251 22679 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:47:23.586880 22679 catalog_manager.cc:1347] Generated new cluster ID: 0ba5863eed8443f290c7ec3ad642076f
I20260812 17:47:23.586966 22679 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:47:23.613042 22679 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:47:23.613427 22679 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:47:23.619177 22679 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5de79f45b7d1409fa4bcb1e64b310da5: Generated new TSK 0
I20260812 17:47:23.619928 22679 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 17:47:23.624610 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 22512
2026-08-12T17:47:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1708 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:47:23 dist-test-slave-tk9z krb5kdc[22699](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:47:23 dist-test-slave-tk9z krb5kdc[22699](info): set up 2 sockets
Aug 12 17:47:23 dist-test-slave-tk9z krb5kdc[22699](info): commencing operation
krb5kdc: starting...
W20260812 17:47:24.953534 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.301s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:47:25 dist-test-slave-tk9z krb5kdc[22699](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556845, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:47:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:47:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 17:47:25.091404 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38297
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38297
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:47:25.211110 22719 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:25.211391 22719 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:25.211434 22719 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:25.215507 22719 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:47:25.215581 22719 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:25.215602 22719 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:25.215619 22719 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:47:25.215636 22719 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:47:25.221210 22719 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38297
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38297
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22719
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:25.222401 22719 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:25.223492 22719 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:25.232282 22730 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:25.232296 22729 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:25.232357 22733 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:25.232595 22719 server_base.cc:1034] running on GCE node
I20260812 17:47:25.233264 22719 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:25.234468 22719 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:25.235663 22719 hybrid_clock.cc:648] HybridClock initialized: now 1786556845235655 us; error 30 us; skew 500 ppm
Aug 12 17:47:25 dist-test-slave-tk9z krb5kdc[22699](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556845, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:47:25.238597 22719 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 17:47:25.239491 22719 webserver.cc:460] Webserver started at http://127.0.0.1:43171/ using document root <none> and password file <none>
I20260812 17:47:25.240080 22719 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:25.240141 22719 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:25.240362 22719 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:25.242527 22719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "b1158bf9d8f74b5794bf468e83c9938a"
format_stamp: "Formatted at 2026-08-12 17:47:25 on dist-test-slave-tk9z"
server_key: "67ed0a995a73143783cd2c0fd0f72712"
server_key_iv: "1b2791129b1faff6252ec8a0d89258af"
server_key_version: "encryptionkey@0"
I20260812 17:47:25.243126 22719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "b1158bf9d8f74b5794bf468e83c9938a"
format_stamp: "Formatted at 2026-08-12 17:47:25 on dist-test-slave-tk9z"
server_key: "67ed0a995a73143783cd2c0fd0f72712"
server_key_iv: "1b2791129b1faff6252ec8a0d89258af"
server_key_version: "encryptionkey@0"
I20260812 17:47:25.247012 22719 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 17:47:25.249629 22746 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:25.251065 22719 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:47:25.251199 22719 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "b1158bf9d8f74b5794bf468e83c9938a"
format_stamp: "Formatted at 2026-08-12 17:47:25 on dist-test-slave-tk9z"
server_key: "67ed0a995a73143783cd2c0fd0f72712"
server_key_iv: "1b2791129b1faff6252ec8a0d89258af"
server_key_version: "encryptionkey@0"
I20260812 17:47:25.251312 22719 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:25.267400 22719 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:25.271116 22719 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:25.271353 22719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:25.278975 22719 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38297
I20260812 17:47:25.278992 22836 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38297 every 8 connection(s)
I20260812 17:47:25.279995 22719 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:47:25.283013 22839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:25.289183 22839 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1158bf9d8f74b5794bf468e83c9938a: Bootstrap starting.
I20260812 17:47:25.289743 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 22719
I20260812 17:47:25.289897 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:47:25.290213 18428 external_mini_cluster.cc:1428] Setting key 4dc720b370593e1da9e70625fadd0d38
I20260812 17:47:25.292398 22839 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b1158bf9d8f74b5794bf468e83c9938a: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:25.293327 22839 log.cc:824] T 00000000000000000000000000000000 P b1158bf9d8f74b5794bf468e83c9938a: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:25.295773 22839 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1158bf9d8f74b5794bf468e83c9938a: No bootstrap required, opened a new log
I20260812 17:47:25.300143 22839 raft_consensus.cc:348] T 00000000000000000000000000000000 P b1158bf9d8f74b5794bf468e83c9938a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1158bf9d8f74b5794bf468e83c9938a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38297 } }
I20260812 17:47:25.300521 22839 raft_consensus.cc:374] T 00000000000000000000000000000000 P b1158bf9d8f74b5794bf468e83c9938a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:47:25.300594 22839 raft_consensus.cc:729] T 00000000000000000000000000000000 P b1158bf9d8f74b5794bf468e83c9938a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1158bf9d8f74b5794bf468e83c9938a, State: Initialized, Role: FOLLOWER
Aug 12 17:47:25 dist-test-slave-tk9z krb5kdc[22699](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556845, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 17:47:25.301120 22839 consensus_queue.cc:260] T 00000000000000000000000000000000 P b1158bf9d8f74b5794bf468e83c9938a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1158bf9d8f74b5794bf468e83c9938a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38297 } }
I20260812 17:47:25.301298 22839 raft_consensus.cc:388] T 00000000000000000000000000000000 P b1158bf9d8f74b5794bf468e83c9938a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:47:25.301389 22839 raft_consensus.cc:482] T 00000000000000000000000000000000 P b1158bf9d8f74b5794bf468e83c9938a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:47:25.301523 22839 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b1158bf9d8f74b5794bf468e83c9938a [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:25.302587 22839 raft_consensus.cc:504] T 00000000000000000000000000000000 P b1158bf9d8f74b5794bf468e83c9938a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1158bf9d8f74b5794bf468e83c9938a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38297 } }
I20260812 17:47:25.302968 22839 leader_election.cc:302] T 00000000000000000000000000000000 P b1158bf9d8f74b5794bf468e83c9938a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b1158bf9d8f74b5794bf468e83c9938a; no voters:
I20260812 17:47:25.303378 22839 leader_election.cc:288] T 00000000000000000000000000000000 P b1158bf9d8f74b5794bf468e83c9938a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:47:25.303454 22848 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b1158bf9d8f74b5794bf468e83c9938a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:47:25.303653 22848 raft_consensus.cc:686] T 00000000000000000000000000000000 P b1158bf9d8f74b5794bf468e83c9938a [term 1 LEADER]: Becoming Leader. State: Replica: b1158bf9d8f74b5794bf468e83c9938a, State: Running, Role: LEADER
I20260812 17:47:25.304047 22848 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1158bf9d8f74b5794bf468e83c9938a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1158bf9d8f74b5794bf468e83c9938a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38297 } }
I20260812 17:47:25.304827 22839 sys_catalog.cc:564] T 00000000000000000000000000000000 P b1158bf9d8f74b5794bf468e83c9938a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:47:25.306048 22853 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1158bf9d8f74b5794bf468e83c9938a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b1158bf9d8f74b5794bf468e83c9938a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1158bf9d8f74b5794bf468e83c9938a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38297 } } }
I20260812 17:47:25.306049 22849 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1158bf9d8f74b5794bf468e83c9938a [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1158bf9d8f74b5794bf468e83c9938a. Latest consensus state: current_term: 1 leader_uuid: "b1158bf9d8f74b5794bf468e83c9938a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1158bf9d8f74b5794bf468e83c9938a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38297 } } }
I20260812 17:47:25.306291 22849 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1158bf9d8f74b5794bf468e83c9938a [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:25.306290 22853 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1158bf9d8f74b5794bf468e83c9938a [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:25.308151 22846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:25.291892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.86:45049 (local address 127.0.0.1:38297)
0812 17:47:25.292390 (+ 498us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:25.292413 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:25.292462 (+ 49us) server_negotiation.cc:407] Connection header received
0812 17:47:25.293403 (+ 941us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:25.293431 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:25.293897 (+ 466us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:25.294246 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:25.295028 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:25.296514 (+ 1486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:25.297519 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:25.298306 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:25.298536 (+ 230us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:25.301440 (+ 2904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:25.301447 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:25.301467 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:25.301509 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:25.303586 (+ 2077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:25.304302 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:25.304307 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:25.304312 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:25.304431 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:25.304844 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:25.304848 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:25.304849 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:25.305588 (+ 739us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:25.305819 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:25.306745 (+ 926us) server_negotiation.cc:299] Negotiation successful
0812 17:47:25.307068 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":131,"threads_started":1}
W20260812 17:47:25.310097 22874 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b1158bf9d8f74b5794bf468e83c9938a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 17:47:25.310187 22874 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 17:47:25.310295 22865 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:47:25.311249 22865 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:47:25.311731 18428 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 17:47:25.317770 22865 catalog_manager.cc:1347] Generated new cluster ID: 746b1529ff09491980554b4d8708617d
I20260812 17:47:25.317871 22865 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:47:25.323834 22846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:25.314135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.86:52747 (local address 127.0.0.1:38297)
0812 17:47:25.314272 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:25.314277 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:25.314530 (+ 253us) server_negotiation.cc:407] Connection header received
0812 17:47:25.314671 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:25.314674 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:25.314727 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:25.314821 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:25.315662 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:25.316380 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:25.317220 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:25.317574 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:25.317700 (+ 126us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:25.320119 (+ 2419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:25.320123 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:25.320127 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:25.320157 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:25.321880 (+ 1723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:25.322462 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:25.322466 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:25.322468 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:25.322563 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:25.322915 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:25.322920 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:25.322922 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:25.323144 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:25.323308 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:25.323562 (+ 254us) server_negotiation.cc:299] Negotiation successful
0812 17:47:25.323667 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 17:47:25.336073 22865 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:47:25.337260 22865 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:47:25.342504 22865 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b1158bf9d8f74b5794bf468e83c9938a: Generated new TSK 0
I20260812 17:47:25.343457 22865 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 17:47:25.354955 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 22719
W20260812 17:47:25.368693 22695 connection.cc:535] client connection to 127.0.0.1:38297 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38297): Connection reset by peer (error 104)
2026-08-12T17:47:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1730 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:47:25 dist-test-slave-tk9z krb5kdc[22895](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:47:25 dist-test-slave-tk9z krb5kdc[22895](info): set up 2 sockets
Aug 12 17:47:25 dist-test-slave-tk9z krb5kdc[22895](info): commencing operation
krb5kdc: starting...
W20260812 17:47:26.657495 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.274s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:47:26 dist-test-slave-tk9z krb5kdc[22895](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556846, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:47:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:47:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 17:47:26.795266 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38363
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38363
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:47:26.926258 22916 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:26.926654 22916 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:26.926740 22916 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:26.930860 22916 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:47:26.930938 22916 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:26.930974 22916 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:26.931031 22916 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:47:26.931069 22916 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:47:26.936582 22916 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38363
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38363
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22916
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:26.937779 22916 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:26.938990 22916 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:26.948642 22926 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:26.948619 22925 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:26.948590 22930 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:26.948750 22916 server_base.cc:1034] running on GCE node
I20260812 17:47:26.949662 22916 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:26.951027 22916 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:26.952277 22916 hybrid_clock.cc:648] HybridClock initialized: now 1786556846952235 us; error 32 us; skew 500 ppm
Aug 12 17:47:26 dist-test-slave-tk9z krb5kdc[22895](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556846, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:47:26.955359 22916 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 17:47:26.956441 22916 webserver.cc:460] Webserver started at http://127.0.0.1:35123/ using document root <none> and password file <none>
I20260812 17:47:26.957065 22916 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:26.957163 22916 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:26.957432 22916 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:26.959656 22916 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "f009765f39894b9e997d1ef968213a84"
format_stamp: "Formatted at 2026-08-12 17:47:26 on dist-test-slave-tk9z"
server_key: "9048cf0b92196b564f9581011c58ae5f"
server_key_iv: "c5f17caffb0f9b9a18500d71955de1e9"
server_key_version: "encryptionkey@0"
I20260812 17:47:26.960254 22916 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "f009765f39894b9e997d1ef968213a84"
format_stamp: "Formatted at 2026-08-12 17:47:26 on dist-test-slave-tk9z"
server_key: "9048cf0b92196b564f9581011c58ae5f"
server_key_iv: "c5f17caffb0f9b9a18500d71955de1e9"
server_key_version: "encryptionkey@0"
I20260812 17:47:26.964239 22916 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 17:47:26.967038 22943 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:26.968523 22916 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:47:26.968711 22916 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "f009765f39894b9e997d1ef968213a84"
format_stamp: "Formatted at 2026-08-12 17:47:26 on dist-test-slave-tk9z"
server_key: "9048cf0b92196b564f9581011c58ae5f"
server_key_iv: "c5f17caffb0f9b9a18500d71955de1e9"
server_key_version: "encryptionkey@0"
I20260812 17:47:26.968858 22916 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:26.985100 22916 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:26.988521 22916 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:26.988755 22916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:26.996652 22916 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38363
I20260812 17:47:26.996682 23019 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38363 every 8 connection(s)
I20260812 17:47:26.997704 22916 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:47:27.000891 23021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:27.003374 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 22916
I20260812 17:47:27.003537 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:47:27.003816 18428 external_mini_cluster.cc:1428] Setting key ba62e521b833417c65bfab2b36728475
I20260812 17:47:27.008036 23021 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f009765f39894b9e997d1ef968213a84: Bootstrap starting.
I20260812 17:47:27.010663 23021 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f009765f39894b9e997d1ef968213a84: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:27.011739 23021 log.cc:824] T 00000000000000000000000000000000 P f009765f39894b9e997d1ef968213a84: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:27.014065 23026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:27.005434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.86:48461 (local address 127.0.0.1:38363)
0812 17:47:27.005985 (+ 551us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:27.006002 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:27.006044 (+ 42us) server_negotiation.cc:407] Connection header received
0812 17:47:27.006970 (+ 926us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:27.006994 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:27.007395 (+ 401us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:27.007753 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:27.008213 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:27.009205 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:27.010136 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:27.010746 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:27.010932 (+ 186us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:27.012004 (+ 1072us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:27.012009 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:27.012023 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:47:27.012596 (+ 573us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:27.012678 (+ 82us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:47:27.012704 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:27.012810 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:27.013034 (+ 224us) server_negotiation.cc:299] Negotiation successful
0812 17:47:27.013197 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":157,"threads_started":1}
I20260812 17:47:27.014187 23021 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f009765f39894b9e997d1ef968213a84: No bootstrap required, opened a new log
I20260812 17:47:27.017320 18428 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 17:47:27.019259 23021 raft_consensus.cc:348] T 00000000000000000000000000000000 P f009765f39894b9e997d1ef968213a84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f009765f39894b9e997d1ef968213a84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38363 } }
I20260812 17:47:27.019599 23021 raft_consensus.cc:374] T 00000000000000000000000000000000 P f009765f39894b9e997d1ef968213a84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:47:27.019711 23021 raft_consensus.cc:729] T 00000000000000000000000000000000 P f009765f39894b9e997d1ef968213a84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f009765f39894b9e997d1ef968213a84, State: Initialized, Role: FOLLOWER
I20260812 17:47:27.020241 23021 consensus_queue.cc:260] T 00000000000000000000000000000000 P f009765f39894b9e997d1ef968213a84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f009765f39894b9e997d1ef968213a84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38363 } }
I20260812 17:47:27.020409 23021 raft_consensus.cc:388] T 00000000000000000000000000000000 P f009765f39894b9e997d1ef968213a84 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:47:27.020498 23021 raft_consensus.cc:482] T 00000000000000000000000000000000 P f009765f39894b9e997d1ef968213a84 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:47:27.020620 23021 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f009765f39894b9e997d1ef968213a84 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:27.021898 23021 raft_consensus.cc:504] T 00000000000000000000000000000000 P f009765f39894b9e997d1ef968213a84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f009765f39894b9e997d1ef968213a84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38363 } }
I20260812 17:47:27.022303 23021 leader_election.cc:302] T 00000000000000000000000000000000 P f009765f39894b9e997d1ef968213a84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f009765f39894b9e997d1ef968213a84; no voters:
I20260812 17:47:27.022686 23021 leader_election.cc:288] T 00000000000000000000000000000000 P f009765f39894b9e997d1ef968213a84 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:47:27.022805 23038 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f009765f39894b9e997d1ef968213a84 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:47:27.023082 23038 raft_consensus.cc:686] T 00000000000000000000000000000000 P f009765f39894b9e997d1ef968213a84 [term 1 LEADER]: Becoming Leader. State: Replica: f009765f39894b9e997d1ef968213a84, State: Running, Role: LEADER
I20260812 17:47:27.023488 23038 consensus_queue.cc:237] T 00000000000000000000000000000000 P f009765f39894b9e997d1ef968213a84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f009765f39894b9e997d1ef968213a84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38363 } }
I20260812 17:47:27.024199 23021 sys_catalog.cc:564] T 00000000000000000000000000000000 P f009765f39894b9e997d1ef968213a84 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:47:27.024923 23026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:27.019956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.86:54999 (local address 127.0.0.1:38363)
0812 17:47:27.020070 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:27.020073 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:27.020346 (+ 273us) server_negotiation.cc:407] Connection header received
0812 17:47:27.020492 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:27.020495 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:27.020559 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:27.020652 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:27.020985 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:27.021811 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:27.022857 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:27.023242 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:27.023353 (+ 111us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:27.024336 (+ 983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:27.024342 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:27.024346 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:47:27.024362 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:27.024395 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:47:27.024410 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:27.024507 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:27.024745 (+ 238us) server_negotiation.cc:299] Negotiation successful
0812 17:47:27.024783 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 17:47:27.024986 23038 sys_catalog.cc:455] T 00000000000000000000000000000000 P f009765f39894b9e997d1ef968213a84 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f009765f39894b9e997d1ef968213a84. Latest consensus state: current_term: 1 leader_uuid: "f009765f39894b9e997d1ef968213a84" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f009765f39894b9e997d1ef968213a84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38363 } } }
I20260812 17:47:27.025110 23038 sys_catalog.cc:458] T 00000000000000000000000000000000 P f009765f39894b9e997d1ef968213a84 [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:27.025465 23040 sys_catalog.cc:455] T 00000000000000000000000000000000 P f009765f39894b9e997d1ef968213a84 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f009765f39894b9e997d1ef968213a84" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f009765f39894b9e997d1ef968213a84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38363 } } }
I20260812 17:47:27.025566 23040 sys_catalog.cc:458] T 00000000000000000000000000000000 P f009765f39894b9e997d1ef968213a84 [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:27.025602 23051 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:47:27.029100 23051 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:47:27.035701 23051 catalog_manager.cc:1347] Generated new cluster ID: f5b6b5d36dc44bec81b1a435212111ea
I20260812 17:47:27.035790 23051 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:47:27.048422 23051 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:47:27.049892 23051 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:47:27.058017 23051 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f009765f39894b9e997d1ef968213a84: Generated new TSK 0
I20260812 17:47:27.059125 23051 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 17:47:27.064548 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 22916
W20260812 17:47:27.091660 22892 connection.cc:535] client connection to 127.0.0.1:38363 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38363): Connection reset by peer (error 104)
2026-08-12T17:47:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1723 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:47:27 dist-test-slave-tk9z krb5kdc[23073](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:47:27 dist-test-slave-tk9z krb5kdc[23073](info): set up 2 sockets
Aug 12 17:47:27 dist-test-slave-tk9z krb5kdc[23073](info): commencing operation
krb5kdc: starting...
W20260812 17:47:28.388682 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.282s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:47:28 dist-test-slave-tk9z krb5kdc[23073](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556848, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:47:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:47:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 17:47:28.521806 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43531
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43531
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:47:28.635985 23094 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:28.636308 23094 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:28.636391 23094 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:28.640338 23094 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:47:28.640427 23094 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:28.640466 23094 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:28.640518 23094 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:47:28.640558 23094 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:47:28.645829 23094 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43531
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43531
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23094
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:28.647080 23094 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:28.648206 23094 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:28.657296 23109 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:28.657313 23107 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:28.657296 23106 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:28.658278 23094 server_base.cc:1034] running on GCE node
I20260812 17:47:28.658967 23094 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:28.660234 23094 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:28.661420 23094 hybrid_clock.cc:648] HybridClock initialized: now 1786556848661398 us; error 35 us; skew 500 ppm
Aug 12 17:47:28 dist-test-slave-tk9z krb5kdc[23073](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556848, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:47:28.669173 23094 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 17:47:28.670343 23094 webserver.cc:460] Webserver started at http://127.0.0.1:36379/ using document root <none> and password file <none>
I20260812 17:47:28.671088 23094 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:28.671161 23094 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:28.671411 23094 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:28.673727 23094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "6825082b1d034c0c9e4fe58e9594fb2e"
format_stamp: "Formatted at 2026-08-12 17:47:28 on dist-test-slave-tk9z"
server_key: "029ea23a181e2baabfc7ad8d3faee9aa"
server_key_iv: "f735c04218f89c9ed9c2c85742283a4c"
server_key_version: "encryptionkey@0"
I20260812 17:47:28.674439 23094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "6825082b1d034c0c9e4fe58e9594fb2e"
format_stamp: "Formatted at 2026-08-12 17:47:28 on dist-test-slave-tk9z"
server_key: "029ea23a181e2baabfc7ad8d3faee9aa"
server_key_iv: "f735c04218f89c9ed9c2c85742283a4c"
server_key_version: "encryptionkey@0"
I20260812 17:47:28.678755 23094 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 17:47:28.681325 23118 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:28.682725 23094 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:47:28.682870 23094 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "6825082b1d034c0c9e4fe58e9594fb2e"
format_stamp: "Formatted at 2026-08-12 17:47:28 on dist-test-slave-tk9z"
server_key: "029ea23a181e2baabfc7ad8d3faee9aa"
server_key_iv: "f735c04218f89c9ed9c2c85742283a4c"
server_key_version: "encryptionkey@0"
I20260812 17:47:28.682996 23094 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:28.687763 23094 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:28.690913 23094 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:28.691119 23094 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:28.699743 23094 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43531
I20260812 17:47:28.699760 23187 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43531 every 8 connection(s)
I20260812 17:47:28.700846 23094 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:47:28.704119 23192 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:28.709466 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 23094
I20260812 17:47:28.709630 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:47:28.709955 18428 external_mini_cluster.cc:1428] Setting key 28b488103234018095ed87a71584c380
I20260812 17:47:28.710912 23192 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6825082b1d034c0c9e4fe58e9594fb2e: Bootstrap starting.
I20260812 17:47:28.713397 23192 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6825082b1d034c0c9e4fe58e9594fb2e: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:28.714444 23192 log.cc:824] T 00000000000000000000000000000000 P 6825082b1d034c0c9e4fe58e9594fb2e: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:28.715909 23195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:28.711516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.86:45567 (local address 127.0.0.1:43531)
0812 17:47:28.711976 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:28.711995 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:28.712034 (+ 39us) server_negotiation.cc:407] Connection header received
0812 17:47:28.712670 (+ 636us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:28.712688 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:28.712979 (+ 291us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:28.713264 (+ 285us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:28.714252 (+ 988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:28.714257 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:28.714270 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:47:28.714281 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:28.714336 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:47:28.714356 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:28.714512 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:28.714902 (+ 390us) server_negotiation.cc:299] Negotiation successful
0812 17:47:28.715083 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286,"thread_start_us":143,"threads_started":1}
I20260812 17:47:28.716616 23192 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6825082b1d034c0c9e4fe58e9594fb2e: No bootstrap required, opened a new log
I20260812 17:47:28.719012 18428 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 17:47:28.721465 23192 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6825082b1d034c0c9e4fe58e9594fb2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6825082b1d034c0c9e4fe58e9594fb2e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43531 } }
I20260812 17:47:28.721796 23192 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6825082b1d034c0c9e4fe58e9594fb2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:47:28.721872 23192 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6825082b1d034c0c9e4fe58e9594fb2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6825082b1d034c0c9e4fe58e9594fb2e, State: Initialized, Role: FOLLOWER
I20260812 17:47:28.722445 23192 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6825082b1d034c0c9e4fe58e9594fb2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6825082b1d034c0c9e4fe58e9594fb2e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43531 } }
I20260812 17:47:28.722641 23192 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6825082b1d034c0c9e4fe58e9594fb2e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:47:28.722715 23192 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6825082b1d034c0c9e4fe58e9594fb2e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:47:28.722827 23192 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6825082b1d034c0c9e4fe58e9594fb2e [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:28.723340 23195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:28.721462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.86:58863 (local address 127.0.0.1:43531)
0812 17:47:28.721597 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:28.721602 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:28.721889 (+ 287us) server_negotiation.cc:407] Connection header received
0812 17:47:28.722025 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:28.722027 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:28.722059 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:28.722152 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:28.722921 (+ 769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:28.722927 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:28.722932 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:47:28.722947 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:28.722976 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:47:28.722991 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:28.723065 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:28.723187 (+ 122us) server_negotiation.cc:299] Negotiation successful
0812 17:47:28.723220 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 17:47:28.724167 23192 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6825082b1d034c0c9e4fe58e9594fb2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6825082b1d034c0c9e4fe58e9594fb2e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43531 } }
I20260812 17:47:28.724534 23192 leader_election.cc:302] T 00000000000000000000000000000000 P 6825082b1d034c0c9e4fe58e9594fb2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6825082b1d034c0c9e4fe58e9594fb2e; no voters:
I20260812 17:47:28.724877 23192 leader_election.cc:288] T 00000000000000000000000000000000 P 6825082b1d034c0c9e4fe58e9594fb2e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:47:28.724969 23204 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6825082b1d034c0c9e4fe58e9594fb2e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:47:28.725158 23204 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6825082b1d034c0c9e4fe58e9594fb2e [term 1 LEADER]: Becoming Leader. State: Replica: 6825082b1d034c0c9e4fe58e9594fb2e, State: Running, Role: LEADER
I20260812 17:47:28.725467 23204 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6825082b1d034c0c9e4fe58e9594fb2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6825082b1d034c0c9e4fe58e9594fb2e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43531 } }
I20260812 17:47:28.726257 23192 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6825082b1d034c0c9e4fe58e9594fb2e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:47:28.727304 23206 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6825082b1d034c0c9e4fe58e9594fb2e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6825082b1d034c0c9e4fe58e9594fb2e. Latest consensus state: current_term: 1 leader_uuid: "6825082b1d034c0c9e4fe58e9594fb2e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6825082b1d034c0c9e4fe58e9594fb2e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43531 } } }
I20260812 17:47:28.727519 23205 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6825082b1d034c0c9e4fe58e9594fb2e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6825082b1d034c0c9e4fe58e9594fb2e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6825082b1d034c0c9e4fe58e9594fb2e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43531 } } }
I20260812 17:47:28.727622 23206 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6825082b1d034c0c9e4fe58e9594fb2e [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:28.727725 23205 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6825082b1d034c0c9e4fe58e9594fb2e [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:28.728055 23215 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:47:28.731309 23215 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:47:28.736550 23215 catalog_manager.cc:1347] Generated new cluster ID: 355360f03fd2411da685106ceb5dd9bb
I20260812 17:47:28.736622 23215 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:47:28.757601 23215 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:47:28.758066 23215 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:47:28.763171 23215 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6825082b1d034c0c9e4fe58e9594fb2e: Generated new TSK 0
I20260812 17:47:28.764004 23215 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 17:47:28.771018 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 23094
2026-08-12T17:47:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1696 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:47:28 dist-test-slave-tk9z krb5kdc[23249](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:47:28 dist-test-slave-tk9z krb5kdc[23249](info): set up 2 sockets
Aug 12 17:47:28 dist-test-slave-tk9z krb5kdc[23249](info): commencing operation
krb5kdc: starting...
W20260812 17:47:30.185127 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.382s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:47:30 dist-test-slave-tk9z krb5kdc[23249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556850, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:47:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:47:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 17:47:30.322554 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36477
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36477
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:47:30.442265 23267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:30.442632 23267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:30.442724 23267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:30.446794 23267 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:47:30.446913 23267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:30.446954 23267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:30.446993 23267 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:47:30.447026 23267 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:47:30.452535 23267 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36477
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36477
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23267
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:30.453788 23267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:30.454949 23267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:30.464277 23274 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:30.464289 23286 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:30.464370 23276 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:30.464648 23267 server_base.cc:1034] running on GCE node
I20260812 17:47:30.465337 23267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:30.466531 23267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:30.467739 23267 hybrid_clock.cc:648] HybridClock initialized: now 1786556850467695 us; error 56 us; skew 500 ppm
Aug 12 17:47:30 dist-test-slave-tk9z krb5kdc[23249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556850, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:47:30.470881 23267 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 17:47:30.471798 23267 webserver.cc:460] Webserver started at http://127.0.0.1:41701/ using document root <none> and password file <none>
I20260812 17:47:30.472378 23267 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:30.472504 23267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:30.472747 23267 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:30.474939 23267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "4d5e630d00d74950b2d7e8984172fdf0"
format_stamp: "Formatted at 2026-08-12 17:47:30 on dist-test-slave-tk9z"
server_key: "a6242d106210f6489fa6dfcda1b6ab2c"
server_key_iv: "1e3be1675dcd56ef990e19b0a1ae2156"
server_key_version: "encryptionkey@0"
I20260812 17:47:30.475535 23267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "4d5e630d00d74950b2d7e8984172fdf0"
format_stamp: "Formatted at 2026-08-12 17:47:30 on dist-test-slave-tk9z"
server_key: "a6242d106210f6489fa6dfcda1b6ab2c"
server_key_iv: "1e3be1675dcd56ef990e19b0a1ae2156"
server_key_version: "encryptionkey@0"
I20260812 17:47:30.479322 23267 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 17:47:30.481843 23296 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:30.483160 23267 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 17:47:30.483302 23267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "4d5e630d00d74950b2d7e8984172fdf0"
format_stamp: "Formatted at 2026-08-12 17:47:30 on dist-test-slave-tk9z"
server_key: "a6242d106210f6489fa6dfcda1b6ab2c"
server_key_iv: "1e3be1675dcd56ef990e19b0a1ae2156"
server_key_version: "encryptionkey@0"
I20260812 17:47:30.483414 23267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:30.498027 23267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:30.501456 23267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:30.501690 23267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:30.509429 23267 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36477
I20260812 17:47:30.509451 23388 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36477 every 8 connection(s)
I20260812 17:47:30.510654 23267 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:47:30.513609 23389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:30.519569 23389 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d5e630d00d74950b2d7e8984172fdf0: Bootstrap starting.
I20260812 17:47:30.520583 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 23267
I20260812 17:47:30.520848 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:47:30.521184 18428 external_mini_cluster.cc:1428] Setting key 8c0e073a483adc62b58cf5e78b9c8106
I20260812 17:47:30.522622 23389 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4d5e630d00d74950b2d7e8984172fdf0: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:30.523610 23389 log.cc:824] T 00000000000000000000000000000000 P 4d5e630d00d74950b2d7e8984172fdf0: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:30.526048 23389 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d5e630d00d74950b2d7e8984172fdf0: No bootstrap required, opened a new log
I20260812 17:47:30.530277 23389 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4d5e630d00d74950b2d7e8984172fdf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d5e630d00d74950b2d7e8984172fdf0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36477 } }
I20260812 17:47:30.530601 23389 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4d5e630d00d74950b2d7e8984172fdf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:47:30.530673 23389 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4d5e630d00d74950b2d7e8984172fdf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d5e630d00d74950b2d7e8984172fdf0, State: Initialized, Role: FOLLOWER
Aug 12 17:47:30 dist-test-slave-tk9z krb5kdc[23249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556850, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 17:47:30.531157 23389 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4d5e630d00d74950b2d7e8984172fdf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d5e630d00d74950b2d7e8984172fdf0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36477 } }
I20260812 17:47:30.531303 23389 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4d5e630d00d74950b2d7e8984172fdf0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:47:30.531383 23389 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4d5e630d00d74950b2d7e8984172fdf0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:47:30.531528 23389 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4d5e630d00d74950b2d7e8984172fdf0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:30.532835 23389 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4d5e630d00d74950b2d7e8984172fdf0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d5e630d00d74950b2d7e8984172fdf0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36477 } }
I20260812 17:47:30.533238 23389 leader_election.cc:302] T 00000000000000000000000000000000 P 4d5e630d00d74950b2d7e8984172fdf0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4d5e630d00d74950b2d7e8984172fdf0; no voters:
I20260812 17:47:30.533636 23389 leader_election.cc:288] T 00000000000000000000000000000000 P 4d5e630d00d74950b2d7e8984172fdf0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:47:30.533706 23397 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4d5e630d00d74950b2d7e8984172fdf0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:47:30.533958 23397 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4d5e630d00d74950b2d7e8984172fdf0 [term 1 LEADER]: Becoming Leader. State: Replica: 4d5e630d00d74950b2d7e8984172fdf0, State: Running, Role: LEADER
I20260812 17:47:30.534322 23397 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4d5e630d00d74950b2d7e8984172fdf0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d5e630d00d74950b2d7e8984172fdf0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36477 } }
I20260812 17:47:30.535115 23389 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4d5e630d00d74950b2d7e8984172fdf0 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:47:30.536103 23398 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d5e630d00d74950b2d7e8984172fdf0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d5e630d00d74950b2d7e8984172fdf0. Latest consensus state: current_term: 1 leader_uuid: "4d5e630d00d74950b2d7e8984172fdf0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d5e630d00d74950b2d7e8984172fdf0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36477 } } }
I20260812 17:47:30.536260 23398 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d5e630d00d74950b2d7e8984172fdf0 [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:30.536609 23401 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d5e630d00d74950b2d7e8984172fdf0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4d5e630d00d74950b2d7e8984172fdf0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d5e630d00d74950b2d7e8984172fdf0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36477 } } }
I20260812 17:47:30.536700 23401 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d5e630d00d74950b2d7e8984172fdf0 [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:30.537125 23411 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:47:30.539019 23393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:30.522496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.86:57971 (local address 127.0.0.1:36477)
0812 17:47:30.523060 (+ 564us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:30.523081 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:30.523126 (+ 45us) server_negotiation.cc:407] Connection header received
0812 17:47:30.524078 (+ 952us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:30.524103 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:30.524511 (+ 408us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:30.524902 (+ 391us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:30.525646 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:30.527138 (+ 1492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:30.528049 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:30.528807 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:30.529015 (+ 208us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:30.531956 (+ 2941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:30.531963 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:30.531981 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:30.532014 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:30.534044 (+ 2030us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:30.534702 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:30.534707 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:30.534712 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:30.534843 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:30.535215 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:30.535221 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:30.535223 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:30.536807 (+ 1584us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:30.537799 (+ 992us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:30.538005 (+ 206us) server_negotiation.cc:299] Negotiation successful
0812 17:47:30.538216 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":202,"threads_started":1}
I20260812 17:47:30.540982 23411 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:47:30.542102 18428 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 17:47:30.547590 23411 catalog_manager.cc:1347] Generated new cluster ID: 64a082ba1c1a432a9d2454e5771ee0c8
I20260812 17:47:30.547654 23411 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:47:30.554351 23393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:30.544327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.86:52747 (local address 127.0.0.1:36477)
0812 17:47:30.544439 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:30.544444 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:30.544757 (+ 313us) server_negotiation.cc:407] Connection header received
0812 17:47:30.544879 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:30.544882 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:30.544936 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:30.545031 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:30.545824 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:30.546552 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:30.547762 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:30.548119 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:30.548225 (+ 106us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:30.550167 (+ 1942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:30.550171 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:30.550174 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:30.550202 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:30.551949 (+ 1747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:30.552591 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:30.552597 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:30.552599 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:30.552683 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:30.553069 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:30.553072 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:30.553074 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:30.553288 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:30.553437 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:30.554092 (+ 655us) server_negotiation.cc:299] Negotiation successful
0812 17:47:30.554189 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 17:47:30.567140 23411 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:47:30.568518 23411 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:47:30.585628 23411 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4d5e630d00d74950b2d7e8984172fdf0: Generated new TSK 0
I20260812 17:47:30.586977 23411 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 17:47:30.597916 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 23267
W20260812 17:47:30.612720 23243 connection.cc:535] client connection to 127.0.0.1:36477 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36477): Connection reset by peer (error 104)
2026-08-12T17:47:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1824 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:47:30 dist-test-slave-tk9z krb5kdc[23441](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:47:30 dist-test-slave-tk9z krb5kdc[23441](info): set up 2 sockets
Aug 12 17:47:30 dist-test-slave-tk9z krb5kdc[23441](info): commencing operation
krb5kdc: starting...
W20260812 17:47:31.969261 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.341s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:47:32 dist-test-slave-tk9z krb5kdc[23441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556852, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:47:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:47:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 17:47:32.113400 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41549
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41549
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:47:32.233175 23458 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:32.233515 23458 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:32.233618 23458 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:32.237777 23458 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:47:32.237881 23458 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:32.237920 23458 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:32.237980 23458 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:47:32.238018 23458 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:47:32.243604 23458 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41549
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41549
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23458
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:32.244834 23458 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:32.245940 23458 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:32.254820 23473 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:32.255000 23475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:32.254892 23458 server_base.cc:1034] running on GCE node
W20260812 17:47:32.254913 23472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:32.255728 23458 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:32.256865 23458 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:32.258050 23458 hybrid_clock.cc:648] HybridClock initialized: now 1786556852257977 us; error 87 us; skew 500 ppm
Aug 12 17:47:32 dist-test-slave-tk9z krb5kdc[23441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556852, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:47:32.261463 23458 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 17:47:32.262682 23458 webserver.cc:460] Webserver started at http://127.0.0.1:44309/ using document root <none> and password file <none>
I20260812 17:47:32.263335 23458 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:32.263444 23458 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:32.263715 23458 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:32.266078 23458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "8a2fa86fc249497abf28147c28bdcec4"
format_stamp: "Formatted at 2026-08-12 17:47:32 on dist-test-slave-tk9z"
server_key: "0549c43c7e34e49f1ddbf8ec724ef1bc"
server_key_iv: "336bfe3a4fa06967232c34ca8a4b5b61"
server_key_version: "encryptionkey@0"
I20260812 17:47:32.266839 23458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "8a2fa86fc249497abf28147c28bdcec4"
format_stamp: "Formatted at 2026-08-12 17:47:32 on dist-test-slave-tk9z"
server_key: "0549c43c7e34e49f1ddbf8ec724ef1bc"
server_key_iv: "336bfe3a4fa06967232c34ca8a4b5b61"
server_key_version: "encryptionkey@0"
I20260812 17:47:32.271358 23458 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 17:47:32.274545 23485 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:32.276125 23458 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:47:32.276307 23458 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "8a2fa86fc249497abf28147c28bdcec4"
format_stamp: "Formatted at 2026-08-12 17:47:32 on dist-test-slave-tk9z"
server_key: "0549c43c7e34e49f1ddbf8ec724ef1bc"
server_key_iv: "336bfe3a4fa06967232c34ca8a4b5b61"
server_key_version: "encryptionkey@0"
I20260812 17:47:32.276455 23458 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:32.293773 23458 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:32.297168 23458 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:32.297422 23458 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:32.305145 23458 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41549
I20260812 17:47:32.305182 23573 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41549 every 8 connection(s)
I20260812 17:47:32.306206 23458 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:47:32.309404 23574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:32.311494 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 23458
I20260812 17:47:32.311760 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:47:32.312067 18428 external_mini_cluster.cc:1428] Setting key 2f63ee16541eceb537f1d2c65864db96
I20260812 17:47:32.316160 23574 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a2fa86fc249497abf28147c28bdcec4: Bootstrap starting.
I20260812 17:47:32.318859 23574 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8a2fa86fc249497abf28147c28bdcec4: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:32.319907 23574 log.cc:824] T 00000000000000000000000000000000 P 8a2fa86fc249497abf28147c28bdcec4: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:32.322208 23578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:32.313606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.86:44911 (local address 127.0.0.1:41549)
0812 17:47:32.314090 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:32.314107 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:32.314145 (+ 38us) server_negotiation.cc:407] Connection header received
0812 17:47:32.315028 (+ 883us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:32.315049 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:32.315417 (+ 368us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:32.315731 (+ 314us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:32.316156 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:32.317219 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:32.318486 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:32.319003 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:32.319150 (+ 147us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:32.320145 (+ 995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:32.320150 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:32.320165 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:47:32.320709 (+ 544us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:32.320788 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:47:32.320833 (+ 45us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:32.320946 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:32.321293 (+ 347us) server_negotiation.cc:299] Negotiation successful
0812 17:47:32.321465 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":147,"threads_started":1}
I20260812 17:47:32.322271 23574 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a2fa86fc249497abf28147c28bdcec4: No bootstrap required, opened a new log
I20260812 17:47:32.325318 18428 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 17:47:32.326292 23574 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8a2fa86fc249497abf28147c28bdcec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a2fa86fc249497abf28147c28bdcec4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41549 } }
I20260812 17:47:32.326618 23574 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8a2fa86fc249497abf28147c28bdcec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:47:32.326682 23574 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8a2fa86fc249497abf28147c28bdcec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a2fa86fc249497abf28147c28bdcec4, State: Initialized, Role: FOLLOWER
I20260812 17:47:32.327221 23574 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a2fa86fc249497abf28147c28bdcec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a2fa86fc249497abf28147c28bdcec4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41549 } }
I20260812 17:47:32.327436 23574 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8a2fa86fc249497abf28147c28bdcec4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:47:32.327502 23574 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8a2fa86fc249497abf28147c28bdcec4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:47:32.327659 23574 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8a2fa86fc249497abf28147c28bdcec4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:32.328995 23574 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8a2fa86fc249497abf28147c28bdcec4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a2fa86fc249497abf28147c28bdcec4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41549 } }
I20260812 17:47:32.329399 23574 leader_election.cc:302] T 00000000000000000000000000000000 P 8a2fa86fc249497abf28147c28bdcec4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8a2fa86fc249497abf28147c28bdcec4; no voters:
I20260812 17:47:32.329792 23574 leader_election.cc:288] T 00000000000000000000000000000000 P 8a2fa86fc249497abf28147c28bdcec4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:47:32.329919 23589 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8a2fa86fc249497abf28147c28bdcec4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:47:32.330205 23589 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8a2fa86fc249497abf28147c28bdcec4 [term 1 LEADER]: Becoming Leader. State: Replica: 8a2fa86fc249497abf28147c28bdcec4, State: Running, Role: LEADER
I20260812 17:47:32.330650 23589 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8a2fa86fc249497abf28147c28bdcec4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a2fa86fc249497abf28147c28bdcec4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41549 } }
I20260812 17:47:32.331269 23574 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8a2fa86fc249497abf28147c28bdcec4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:47:32.331883 23589 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a2fa86fc249497abf28147c28bdcec4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8a2fa86fc249497abf28147c28bdcec4. Latest consensus state: current_term: 1 leader_uuid: "8a2fa86fc249497abf28147c28bdcec4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a2fa86fc249497abf28147c28bdcec4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41549 } } }
I20260812 17:47:32.332017 23589 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a2fa86fc249497abf28147c28bdcec4 [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:32.332479 23591 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a2fa86fc249497abf28147c28bdcec4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8a2fa86fc249497abf28147c28bdcec4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a2fa86fc249497abf28147c28bdcec4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41549 } } }
I20260812 17:47:32.332605 23598 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:47:32.332631 23591 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a2fa86fc249497abf28147c28bdcec4 [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:32.332895 23578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:32.327680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.86:50311 (local address 127.0.0.1:41549)
0812 17:47:32.327830 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:32.327835 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:32.328128 (+ 293us) server_negotiation.cc:407] Connection header received
0812 17:47:32.328217 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:32.328219 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:32.328262 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:32.328330 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:32.328674 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:32.329279 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:32.330477 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:32.330828 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:32.330909 (+ 81us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:32.332037 (+ 1128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:32.332043 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:32.332048 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:47:32.332067 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:32.332099 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:47:32.332115 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:32.332207 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:32.332729 (+ 522us) server_negotiation.cc:299] Negotiation successful
0812 17:47:32.332762 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 17:47:32.336053 23598 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:47:32.342110 23598 catalog_manager.cc:1347] Generated new cluster ID: 3ff9dce0b47e456a9c57f31827265bec
I20260812 17:47:32.342192 23598 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:47:32.353224 23598 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:47:32.354154 23598 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:47:32.361219 23598 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8a2fa86fc249497abf28147c28bdcec4: Generated new TSK 0
I20260812 17:47:32.362007 23598 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 17:47:32.371086 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 23458
W20260812 17:47:32.396231 23436 connection.cc:535] client connection to 127.0.0.1:41549 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41549): Connection reset by peer (error 104)
2026-08-12T17:47:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1783 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:47:32 dist-test-slave-tk9z krb5kdc[23623](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:47:32 dist-test-slave-tk9z krb5kdc[23623](info): set up 2 sockets
Aug 12 17:47:32 dist-test-slave-tk9z krb5kdc[23623](info): commencing operation
krb5kdc: starting...
W20260812 17:47:33.709168 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.297s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:47:33 dist-test-slave-tk9z krb5kdc[23623](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556853, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:47:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:47:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 17:47:33.849399 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46149
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46149
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:47:33.966068 23640 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:33.966439 23640 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:33.966516 23640 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:33.970536 23640 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:47:33.970638 23640 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:33.970675 23640 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:33.970734 23640 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:47:33.970777 23640 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:47:33.976125 23640 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46149
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786556557564181-18428-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46149
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23640
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:33.977296 23640 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:33.978423 23640 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:33.987272 23652 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:33.989151 23640 server_base.cc:1034] running on GCE node
W20260812 17:47:33.989250 23648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:33.989264 23649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:33.989940 23640 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:33.991263 23640 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:33.992496 23640 hybrid_clock.cc:648] HybridClock initialized: now 1786556853992477 us; error 36 us; skew 500 ppm
Aug 12 17:47:33 dist-test-slave-tk9z krb5kdc[23623](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556853, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:47:34.000473 23640 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 17:47:34.001613 23640 webserver.cc:460] Webserver started at http://127.0.0.1:42931/ using document root <none> and password file <none>
I20260812 17:47:34.002297 23640 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:34.002436 23640 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:34.002676 23640 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:34.005007 23640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "041f15781ac348b9bb32d036d803b31b"
format_stamp: "Formatted at 2026-08-12 17:47:33 on dist-test-slave-tk9z"
server_key: "f7f83b575980196a2b33f2bba228c515"
server_key_iv: "110d71b7d847fea8e8ba24f00197f23b"
server_key_version: "encryptionkey@0"
I20260812 17:47:34.005612 23640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "041f15781ac348b9bb32d036d803b31b"
format_stamp: "Formatted at 2026-08-12 17:47:33 on dist-test-slave-tk9z"
server_key: "f7f83b575980196a2b33f2bba228c515"
server_key_iv: "110d71b7d847fea8e8ba24f00197f23b"
server_key_version: "encryptionkey@0"
I20260812 17:47:34.009933 23640 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260812 17:47:34.012923 23660 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:34.014539 23640 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:47:34.014674 23640 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "041f15781ac348b9bb32d036d803b31b"
format_stamp: "Formatted at 2026-08-12 17:47:33 on dist-test-slave-tk9z"
server_key: "f7f83b575980196a2b33f2bba228c515"
server_key_iv: "110d71b7d847fea8e8ba24f00197f23b"
server_key_version: "encryptionkey@0"
I20260812 17:47:34.014793 23640 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:34.019783 23640 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:34.023103 23640 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:34.023386 23640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:34.032043 23640 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46149
I20260812 17:47:34.032068 23742 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46149 every 8 connection(s)
I20260812 17:47:34.033185 23640 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:47:34.036302 23743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:34.036947 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 23640
I20260812 17:47:34.037113 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:47:34.037437 18428 external_mini_cluster.cc:1428] Setting key ddd2117d73aa33400119d8918802ef3f
I20260812 17:47:34.042899 23748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:34.038923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.86:39907 (local address 127.0.0.1:46149)
0812 17:47:34.039361 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:34.039377 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:34.039414 (+ 37us) server_negotiation.cc:407] Connection header received
0812 17:47:34.040067 (+ 653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:34.040084 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:34.040387 (+ 303us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:34.040676 (+ 289us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:34.041541 (+ 865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:34.041546 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:34.041559 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:47:34.041571 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:34.041635 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:47:34.041654 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:34.041769 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:34.041891 (+ 122us) server_negotiation.cc:299] Negotiation successful
0812 17:47:34.042075 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"thread_start_us":136,"threads_started":1}
I20260812 17:47:34.043107 23743 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 041f15781ac348b9bb32d036d803b31b: Bootstrap starting.
I20260812 17:47:34.045411 23743 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 041f15781ac348b9bb32d036d803b31b: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:34.045800 18428 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 17:47:34.046401 23743 log.cc:824] T 00000000000000000000000000000000 P 041f15781ac348b9bb32d036d803b31b: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:34.048610 23743 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 041f15781ac348b9bb32d036d803b31b: No bootstrap required, opened a new log
I20260812 17:47:34.049906 23748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:34.048136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.86:48241 (local address 127.0.0.1:46149)
0812 17:47:34.048267 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:34.048275 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:34.048463 (+ 188us) server_negotiation.cc:407] Connection header received
0812 17:47:34.048583 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:34.048585 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:34.048613 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:34.048709 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:34.049474 (+ 765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:34.049477 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:34.049480 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:47:34.049498 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:34.049524 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:47:34.049535 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:34.049632 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:34.049718 (+ 86us) server_negotiation.cc:299] Negotiation successful
0812 17:47:34.049759 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 17:47:34.052804 23743 raft_consensus.cc:348] T 00000000000000000000000000000000 P 041f15781ac348b9bb32d036d803b31b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "041f15781ac348b9bb32d036d803b31b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46149 } }
I20260812 17:47:34.053053 23743 raft_consensus.cc:374] T 00000000000000000000000000000000 P 041f15781ac348b9bb32d036d803b31b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:47:34.053135 23743 raft_consensus.cc:729] T 00000000000000000000000000000000 P 041f15781ac348b9bb32d036d803b31b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 041f15781ac348b9bb32d036d803b31b, State: Initialized, Role: FOLLOWER
I20260812 17:47:34.053618 23743 consensus_queue.cc:260] T 00000000000000000000000000000000 P 041f15781ac348b9bb32d036d803b31b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "041f15781ac348b9bb32d036d803b31b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46149 } }
I20260812 17:47:34.053771 23743 raft_consensus.cc:388] T 00000000000000000000000000000000 P 041f15781ac348b9bb32d036d803b31b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:47:34.053864 23743 raft_consensus.cc:482] T 00000000000000000000000000000000 P 041f15781ac348b9bb32d036d803b31b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:47:34.053985 23743 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 041f15781ac348b9bb32d036d803b31b [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:34.055051 23743 raft_consensus.cc:504] T 00000000000000000000000000000000 P 041f15781ac348b9bb32d036d803b31b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "041f15781ac348b9bb32d036d803b31b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46149 } }
I20260812 17:47:34.055454 23743 leader_election.cc:302] T 00000000000000000000000000000000 P 041f15781ac348b9bb32d036d803b31b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 041f15781ac348b9bb32d036d803b31b; no voters:
I20260812 17:47:34.055842 23743 leader_election.cc:288] T 00000000000000000000000000000000 P 041f15781ac348b9bb32d036d803b31b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:47:34.056002 23759 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 041f15781ac348b9bb32d036d803b31b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:47:34.056304 23759 raft_consensus.cc:686] T 00000000000000000000000000000000 P 041f15781ac348b9bb32d036d803b31b [term 1 LEADER]: Becoming Leader. State: Replica: 041f15781ac348b9bb32d036d803b31b, State: Running, Role: LEADER
I20260812 17:47:34.056695 23759 consensus_queue.cc:237] T 00000000000000000000000000000000 P 041f15781ac348b9bb32d036d803b31b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "041f15781ac348b9bb32d036d803b31b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46149 } }
I20260812 17:47:34.057241 23743 sys_catalog.cc:564] T 00000000000000000000000000000000 P 041f15781ac348b9bb32d036d803b31b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:47:34.058527 23762 sys_catalog.cc:455] T 00000000000000000000000000000000 P 041f15781ac348b9bb32d036d803b31b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "041f15781ac348b9bb32d036d803b31b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "041f15781ac348b9bb32d036d803b31b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46149 } } }
I20260812 17:47:34.058660 23762 sys_catalog.cc:458] T 00000000000000000000000000000000 P 041f15781ac348b9bb32d036d803b31b [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:34.058611 23765 sys_catalog.cc:455] T 00000000000000000000000000000000 P 041f15781ac348b9bb32d036d803b31b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 041f15781ac348b9bb32d036d803b31b. Latest consensus state: current_term: 1 leader_uuid: "041f15781ac348b9bb32d036d803b31b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "041f15781ac348b9bb32d036d803b31b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46149 } } }
I20260812 17:47:34.058713 23765 sys_catalog.cc:458] T 00000000000000000000000000000000 P 041f15781ac348b9bb32d036d803b31b [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:34.059095 23778 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:47:34.062196 23778 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:47:34.068557 23778 catalog_manager.cc:1347] Generated new cluster ID: a127745b7d0c4f1dac4a9284a711d4cb
I20260812 17:47:34.068635 23778 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:47:34.085037 23778 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:47:34.085417 23778 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:47:34.097687 23778 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 041f15781ac348b9bb32d036d803b31b: Generated new TSK 0
I20260812 17:47:34.098670 23778 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 17:47:34.103614 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 23640
2026-08-12T17:47:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1737 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:47:34 dist-test-slave-tk9z krb5kdc[23802](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:47:34 dist-test-slave-tk9z krb5kdc[23802](info): set up 2 sockets
Aug 12 17:47:34 dist-test-slave-tk9z krb5kdc[23802](info): commencing operation
krb5kdc: starting...
W20260812 17:47:35.440420 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.291s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:47:35 dist-test-slave-tk9z krb5kdc[23802](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556855, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:47:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:47:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.255.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
I20260812 17:47:35.573814 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:45627
--webserver_interface=127.17.255.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:39167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:45627
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:47:35.692333 23820 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:35.692620 23820 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:35.692663 23820 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:35.696657 23820 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:47:35.696725 23820 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:35.696745 23820 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:35.696762 23820 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:47:35.696777 23820 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:47:35.702157 23820 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:39167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:45627
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:45627
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23820
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:35.703337 23820 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:35.704361 23820 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:35.713403 23827 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:35.713354 23831 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:35.713510 23820 server_base.cc:1034] running on GCE node
W20260812 17:47:35.713369 23828 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:35.714417 23820 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:35.715634 23820 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:35.716826 23820 hybrid_clock.cc:648] HybridClock initialized: now 1786556855716797 us; error 40 us; skew 500 ppm
Aug 12 17:47:35 dist-test-slave-tk9z krb5kdc[23802](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556855, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:47:35.720060 23820 init.cc:377] Logged in from keytab as kudu/127.17.255.62@KRBTEST.COM (short username kudu)
I20260812 17:47:35.721197 23820 webserver.cc:460] Webserver started at http://127.17.255.62:38383/ using document root <none> and password file <none>
I20260812 17:47:35.721845 23820 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:35.721946 23820 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:35.722198 23820 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:35.724517 23820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "35907996ca9340bab2b529ae8bf9b7d3"
format_stamp: "Formatted at 2026-08-12 17:47:35 on dist-test-slave-tk9z"
server_key: "926545ac3b6b6f91426de73f0a06e571"
server_key_iv: "69c4ae276b0e36fc706cbd76bb05f7ec"
server_key_version: "encryptionkey@0"
I20260812 17:47:35.725153 23820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "35907996ca9340bab2b529ae8bf9b7d3"
format_stamp: "Formatted at 2026-08-12 17:47:35 on dist-test-slave-tk9z"
server_key: "926545ac3b6b6f91426de73f0a06e571"
server_key_iv: "69c4ae276b0e36fc706cbd76bb05f7ec"
server_key_version: "encryptionkey@0"
I20260812 17:47:35.729583 23820 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260812 17:47:35.732493 23842 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:35.733853 23820 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260812 17:47:35.734007 23820 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "35907996ca9340bab2b529ae8bf9b7d3"
format_stamp: "Formatted at 2026-08-12 17:47:35 on dist-test-slave-tk9z"
server_key: "926545ac3b6b6f91426de73f0a06e571"
server_key_iv: "69c4ae276b0e36fc706cbd76bb05f7ec"
server_key_version: "encryptionkey@0"
I20260812 17:47:35.734143 23820 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:35.748518 23820 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:35.752601 23820 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:35.752830 23820 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:35.760915 23820 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:45627
I20260812 17:47:35.761029 23933 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:45627 every 8 connection(s)
I20260812 17:47:35.762027 23820 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:47:35.765273 23934 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:35.771142 23934 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35907996ca9340bab2b529ae8bf9b7d3: Bootstrap starting.
I20260812 17:47:35.771610 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 23820
I20260812 17:47:35.771775 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:47:35.772069 18428 external_mini_cluster.cc:1428] Setting key b84f6f86114145bb6847cd15202ccf5b
I20260812 17:47:35.774401 23934 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 35907996ca9340bab2b529ae8bf9b7d3: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:35.775254 23934 log.cc:824] T 00000000000000000000000000000000 P 35907996ca9340bab2b529ae8bf9b7d3: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:35.777455 23934 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35907996ca9340bab2b529ae8bf9b7d3: No bootstrap required, opened a new log
I20260812 17:47:35.781229 23934 raft_consensus.cc:348] T 00000000000000000000000000000000 P 35907996ca9340bab2b529ae8bf9b7d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35907996ca9340bab2b529ae8bf9b7d3" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45627 } }
I20260812 17:47:35.781533 23934 raft_consensus.cc:374] T 00000000000000000000000000000000 P 35907996ca9340bab2b529ae8bf9b7d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:47:35.781623 23934 raft_consensus.cc:729] T 00000000000000000000000000000000 P 35907996ca9340bab2b529ae8bf9b7d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35907996ca9340bab2b529ae8bf9b7d3, State: Initialized, Role: FOLLOWER
I20260812 17:47:35.782186 23934 consensus_queue.cc:260] T 00000000000000000000000000000000 P 35907996ca9340bab2b529ae8bf9b7d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35907996ca9340bab2b529ae8bf9b7d3" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45627 } }
I20260812 17:47:35.782361 23934 raft_consensus.cc:388] T 00000000000000000000000000000000 P 35907996ca9340bab2b529ae8bf9b7d3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:47:35.782467 23934 raft_consensus.cc:482] T 00000000000000000000000000000000 P 35907996ca9340bab2b529ae8bf9b7d3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:47:35.782584 23934 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 35907996ca9340bab2b529ae8bf9b7d3 [term 0 FOLLOWER]: Advancing to term 1
Aug 12 17:47:35 dist-test-slave-tk9z krb5kdc[23802](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556855, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:47:35.783890 23934 raft_consensus.cc:504] T 00000000000000000000000000000000 P 35907996ca9340bab2b529ae8bf9b7d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35907996ca9340bab2b529ae8bf9b7d3" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45627 } }
I20260812 17:47:35.784325 23934 leader_election.cc:302] T 00000000000000000000000000000000 P 35907996ca9340bab2b529ae8bf9b7d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 35907996ca9340bab2b529ae8bf9b7d3; no voters:
I20260812 17:47:35.784761 23934 leader_election.cc:288] T 00000000000000000000000000000000 P 35907996ca9340bab2b529ae8bf9b7d3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:47:35.784972 23943 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 35907996ca9340bab2b529ae8bf9b7d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:47:35.785240 23943 raft_consensus.cc:686] T 00000000000000000000000000000000 P 35907996ca9340bab2b529ae8bf9b7d3 [term 1 LEADER]: Becoming Leader. State: Replica: 35907996ca9340bab2b529ae8bf9b7d3, State: Running, Role: LEADER
I20260812 17:47:35.785640 23943 consensus_queue.cc:237] T 00000000000000000000000000000000 P 35907996ca9340bab2b529ae8bf9b7d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35907996ca9340bab2b529ae8bf9b7d3" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45627 } }
I20260812 17:47:35.786304 23934 sys_catalog.cc:564] T 00000000000000000000000000000000 P 35907996ca9340bab2b529ae8bf9b7d3 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:47:35.787701 23944 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35907996ca9340bab2b529ae8bf9b7d3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "35907996ca9340bab2b529ae8bf9b7d3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35907996ca9340bab2b529ae8bf9b7d3" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45627 } } }
I20260812 17:47:35.787845 23944 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35907996ca9340bab2b529ae8bf9b7d3 [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:35.788133 23945 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35907996ca9340bab2b529ae8bf9b7d3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 35907996ca9340bab2b529ae8bf9b7d3. Latest consensus state: current_term: 1 leader_uuid: "35907996ca9340bab2b529ae8bf9b7d3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35907996ca9340bab2b529ae8bf9b7d3" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45627 } } }
I20260812 17:47:35.788261 23945 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35907996ca9340bab2b529ae8bf9b7d3 [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:35.788654 23954 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:47:35.790289 23940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:35.773781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48061 (local address 127.17.255.62:45627)
0812 17:47:35.774290 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:35.774307 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:35.774347 (+ 40us) server_negotiation.cc:407] Connection header received
0812 17:47:35.775208 (+ 861us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:35.775228 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:35.775690 (+ 462us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:35.776080 (+ 390us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:35.777090 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:35.778311 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:35.779439 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:35.779985 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:35.780179 (+ 194us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:35.783460 (+ 3281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:35.783465 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:35.783481 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:35.783511 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:35.785866 (+ 2355us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:35.786590 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:35.786597 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:35.786603 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:35.786755 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:35.787212 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:35.787220 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:35.787224 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:35.787841 (+ 617us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:35.788087 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:35.788960 (+ 873us) server_negotiation.cc:299] Negotiation successful
0812 17:47:35.789210 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":158,"threads_started":1}
I20260812 17:47:35.792315 23954 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:47:35.793653 18428 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 17:47:35.799645 23954 catalog_manager.cc:1347] Generated new cluster ID: 0b04ff0cab15443fabdaf0ecc8a67521
I20260812 17:47:35.799713 23954 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:47:35.805680 23940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:35.795880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58641 (local address 127.17.255.62:45627)
0812 17:47:35.795997 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:35.796001 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:35.796269 (+ 268us) server_negotiation.cc:407] Connection header received
0812 17:47:35.796407 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:35.796411 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:35.796455 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:35.796550 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:35.797360 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:35.798152 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:35.799298 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:35.799670 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:35.799778 (+ 108us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:35.801739 (+ 1961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:35.801743 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:35.801746 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:35.801776 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:35.803578 (+ 1802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:35.804213 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:35.804219 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:35.804221 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:35.804319 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:35.804785 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:35.804788 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:35.804789 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:35.804961 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:35.805126 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:35.805414 (+ 288us) server_negotiation.cc:299] Negotiation successful
0812 17:47:35.805516 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 17:47:35.806202 23954 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:47:35.807482 23954 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:47:35.819865 23954 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 35907996ca9340bab2b529ae8bf9b7d3: Generated new TSK 0
I20260812 17:47:35.820653 23954 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 17:47:35.830905 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 23820
W20260812 17:47:35.845566 23797 connection.cc:535] client connection to 127.17.255.62:45627 recv error: Network error: failed to read from TLS socket (remote: 127.17.255.62:45627): Connection reset by peer (error 104)
2026-08-12T17:47:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1711 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:47:35 dist-test-slave-tk9z krb5kdc[23981](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:47:35 dist-test-slave-tk9z krb5kdc[23981](info): set up 2 sockets
Aug 12 17:47:35 dist-test-slave-tk9z krb5kdc[23981](info): commencing operation
krb5kdc: starting...
W20260812 17:47:37.140908 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.280s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:47:37 dist-test-slave-tk9z krb5kdc[23981](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556857, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:47:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:47:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.255.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
I20260812 17:47:37.274046 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:33837
--webserver_interface=127.17.255.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:39789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:33837
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:47:37.389484 24002 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:37.389839 24002 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:37.389936 24002 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:37.394045 24002 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:47:37.394156 24002 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:37.394196 24002 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:37.394234 24002 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:47:37.394268 24002 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:47:37.399756 24002 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:39789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:33837
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:33837
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24002
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:37.400928 24002 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:37.402029 24002 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:37.411059 24009 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:37.411068 24012 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:37.411059 24008 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:37.411350 24002 server_base.cc:1034] running on GCE node
I20260812 17:47:37.411962 24002 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:37.413139 24002 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:37.414332 24002 hybrid_clock.cc:648] HybridClock initialized: now 1786556857414284 us; error 55 us; skew 500 ppm
Aug 12 17:47:37 dist-test-slave-tk9z krb5kdc[23981](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556857, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:47:37.417201 24002 init.cc:377] Logged in from keytab as kudu/127.17.255.62@KRBTEST.COM (short username kudu)
I20260812 17:47:37.418094 24002 webserver.cc:460] Webserver started at http://127.17.255.62:42145/ using document root <none> and password file <none>
I20260812 17:47:37.418716 24002 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:37.418781 24002 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:37.418969 24002 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:37.421132 24002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "c3bb21ff36854ccba988f5abcb73d48b"
format_stamp: "Formatted at 2026-08-12 17:47:37 on dist-test-slave-tk9z"
server_key: "044d1a7e06966d8285a3f2c87c3fbda4"
server_key_iv: "4c0719237fd8165e7f73ac023f5ab36e"
server_key_version: "encryptionkey@0"
I20260812 17:47:37.421706 24002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "c3bb21ff36854ccba988f5abcb73d48b"
format_stamp: "Formatted at 2026-08-12 17:47:37 on dist-test-slave-tk9z"
server_key: "044d1a7e06966d8285a3f2c87c3fbda4"
server_key_iv: "4c0719237fd8165e7f73ac023f5ab36e"
server_key_version: "encryptionkey@0"
I20260812 17:47:37.425757 24002 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260812 17:47:37.428494 24024 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:37.429879 24002 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 17:47:37.430052 24002 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "c3bb21ff36854ccba988f5abcb73d48b"
format_stamp: "Formatted at 2026-08-12 17:47:37 on dist-test-slave-tk9z"
server_key: "044d1a7e06966d8285a3f2c87c3fbda4"
server_key_iv: "4c0719237fd8165e7f73ac023f5ab36e"
server_key_version: "encryptionkey@0"
I20260812 17:47:37.430187 24002 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:37.464823 24002 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:37.468442 24002 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:37.468675 24002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:37.476277 24002 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:33837
I20260812 17:47:37.476318 24110 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:33837 every 8 connection(s)
I20260812 17:47:37.477315 24002 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:47:37.480218 24111 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:37.481860 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 24002
I20260812 17:47:37.482038 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:47:37.482354 18428 external_mini_cluster.cc:1428] Setting key 2e6730542cbc47a8af89d8e25615978e
I20260812 17:47:37.486826 24111 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3bb21ff36854ccba988f5abcb73d48b: Bootstrap starting.
I20260812 17:47:37.489012 24111 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c3bb21ff36854ccba988f5abcb73d48b: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:37.489895 24111 log.cc:824] T 00000000000000000000000000000000 P c3bb21ff36854ccba988f5abcb73d48b: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:37.491657 24114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:37.483841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38289 (local address 127.17.255.62:33837)
0812 17:47:37.484386 (+ 545us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:37.484414 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:37.484452 (+ 38us) server_negotiation.cc:407] Connection header received
0812 17:47:37.485083 (+ 631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:37.485100 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:37.485443 (+ 343us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:37.485785 (+ 342us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:37.486197 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:37.487288 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:37.488211 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:37.488689 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:37.488864 (+ 175us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:37.489818 (+ 954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:37.489825 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:37.489841 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:47:37.490290 (+ 449us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:37.490357 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:47:37.490438 (+ 81us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:37.490588 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:37.490775 (+ 187us) server_negotiation.cc:299] Negotiation successful
0812 17:47:37.490927 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":128,"threads_started":1}
I20260812 17:47:37.492065 24111 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3bb21ff36854ccba988f5abcb73d48b: No bootstrap required, opened a new log
I20260812 17:47:37.494982 18428 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 17:47:37.496477 24111 raft_consensus.cc:348] T 00000000000000000000000000000000 P c3bb21ff36854ccba988f5abcb73d48b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3bb21ff36854ccba988f5abcb73d48b" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 33837 } }
I20260812 17:47:37.496767 24111 raft_consensus.cc:374] T 00000000000000000000000000000000 P c3bb21ff36854ccba988f5abcb73d48b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:47:37.496852 24111 raft_consensus.cc:729] T 00000000000000000000000000000000 P c3bb21ff36854ccba988f5abcb73d48b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3bb21ff36854ccba988f5abcb73d48b, State: Initialized, Role: FOLLOWER
I20260812 17:47:37.497390 24111 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3bb21ff36854ccba988f5abcb73d48b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3bb21ff36854ccba988f5abcb73d48b" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 33837 } }
I20260812 17:47:37.497638 24111 raft_consensus.cc:388] T 00000000000000000000000000000000 P c3bb21ff36854ccba988f5abcb73d48b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:47:37.497737 24111 raft_consensus.cc:482] T 00000000000000000000000000000000 P c3bb21ff36854ccba988f5abcb73d48b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:47:37.497859 24111 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c3bb21ff36854ccba988f5abcb73d48b [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:37.498994 24111 raft_consensus.cc:504] T 00000000000000000000000000000000 P c3bb21ff36854ccba988f5abcb73d48b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3bb21ff36854ccba988f5abcb73d48b" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 33837 } }
I20260812 17:47:37.499387 24111 leader_election.cc:302] T 00000000000000000000000000000000 P c3bb21ff36854ccba988f5abcb73d48b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3bb21ff36854ccba988f5abcb73d48b; no voters:
I20260812 17:47:37.499747 24111 leader_election.cc:288] T 00000000000000000000000000000000 P c3bb21ff36854ccba988f5abcb73d48b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:47:37.499878 24125 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c3bb21ff36854ccba988f5abcb73d48b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:47:37.500126 24125 raft_consensus.cc:686] T 00000000000000000000000000000000 P c3bb21ff36854ccba988f5abcb73d48b [term 1 LEADER]: Becoming Leader. State: Replica: c3bb21ff36854ccba988f5abcb73d48b, State: Running, Role: LEADER
I20260812 17:47:37.500507 24125 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3bb21ff36854ccba988f5abcb73d48b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3bb21ff36854ccba988f5abcb73d48b" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 33837 } }
I20260812 17:47:37.501103 24111 sys_catalog.cc:564] T 00000000000000000000000000000000 P c3bb21ff36854ccba988f5abcb73d48b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:47:37.502291 24114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:37.497381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40465 (local address 127.17.255.62:33837)
0812 17:47:37.497537 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:37.497542 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:37.497753 (+ 211us) server_negotiation.cc:407] Connection header received
0812 17:47:37.497889 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:37.497892 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:37.497967 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:37.498063 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:37.498459 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:37.498999 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:37.500117 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:37.500490 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:37.500609 (+ 119us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:37.501527 (+ 918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:37.501531 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:37.501533 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:47:37.501548 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:37.501577 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:47:37.501591 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:37.501716 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:37.502079 (+ 363us) server_negotiation.cc:299] Negotiation successful
0812 17:47:37.502120 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 17:47:37.502597 24130 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3bb21ff36854ccba988f5abcb73d48b [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3bb21ff36854ccba988f5abcb73d48b. Latest consensus state: current_term: 1 leader_uuid: "c3bb21ff36854ccba988f5abcb73d48b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3bb21ff36854ccba988f5abcb73d48b" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 33837 } } }
I20260812 17:47:37.502755 24130 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3bb21ff36854ccba988f5abcb73d48b [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:37.503346 24140 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:47:37.503600 24129 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3bb21ff36854ccba988f5abcb73d48b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c3bb21ff36854ccba988f5abcb73d48b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3bb21ff36854ccba988f5abcb73d48b" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 33837 } } }
I20260812 17:47:37.503831 24129 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3bb21ff36854ccba988f5abcb73d48b [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:37.507247 24140 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:47:37.513594 24140 catalog_manager.cc:1347] Generated new cluster ID: e154fd51939b407eb731f599e936de9f
I20260812 17:47:37.513697 24140 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:47:37.520944 24140 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:47:37.521925 24140 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:47:37.533646 24140 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c3bb21ff36854ccba988f5abcb73d48b: Generated new TSK 0
I20260812 17:47:37.534657 24140 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 17:47:37.538856 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 24002
W20260812 17:47:37.559496 23978 connection.cc:535] client connection to 127.17.255.62:33837 recv error: Network error: failed to read from TLS socket (remote: 127.17.255.62:33837): Connection reset by peer (error 104)
2026-08-12T17:47:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1713 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:47:37 dist-test-slave-tk9z krb5kdc[24155](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:47:37 dist-test-slave-tk9z krb5kdc[24155](info): set up 2 sockets
Aug 12 17:47:37 dist-test-slave-tk9z krb5kdc[24155](info): commencing operation
krb5kdc: starting...
W20260812 17:47:38.846547 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.272s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:47:38 dist-test-slave-tk9z krb5kdc[24155](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556858, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:47:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:47:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.255.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
I20260812 17:47:38.986112 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:44613
--webserver_interface=127.17.255.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:45701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:44613
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:47:39.106256 24175 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:39.106595 24175 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:39.106640 24175 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:39.110734 24175 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:47:39.110818 24175 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:39.110839 24175 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:39.110857 24175 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:47:39.110872 24175 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:47:39.116459 24175 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:45701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:44613
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:44613
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24175
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:39.117518 24175 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:39.118559 24175 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:39.127589 24187 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:39.127589 24184 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:39.127849 24175 server_base.cc:1034] running on GCE node
W20260812 17:47:39.127624 24192 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:39.128561 24175 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:39.129773 24175 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:39.130990 24175 hybrid_clock.cc:648] HybridClock initialized: now 1786556859130956 us; error 36 us; skew 500 ppm
Aug 12 17:47:39 dist-test-slave-tk9z krb5kdc[24155](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556859, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:47:39.138697 24175 init.cc:377] Logged in from keytab as kudu/127.17.255.62@KRBTEST.COM (short username kudu)
I20260812 17:47:39.139788 24175 webserver.cc:460] Webserver started at http://127.17.255.62:41771/ using document root <none> and password file <none>
I20260812 17:47:39.140450 24175 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:39.140551 24175 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:39.140811 24175 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:39.143093 24175 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "80ddd0b52e2346539fdd4b448e9e7ea9"
format_stamp: "Formatted at 2026-08-12 17:47:39 on dist-test-slave-tk9z"
server_key: "766a789e53645a8bec41a7657b1ec59b"
server_key_iv: "d0457761e604b0b1140501330dde6c79"
server_key_version: "encryptionkey@0"
I20260812 17:47:39.143707 24175 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "80ddd0b52e2346539fdd4b448e9e7ea9"
format_stamp: "Formatted at 2026-08-12 17:47:39 on dist-test-slave-tk9z"
server_key: "766a789e53645a8bec41a7657b1ec59b"
server_key_iv: "d0457761e604b0b1140501330dde6c79"
server_key_version: "encryptionkey@0"
I20260812 17:47:39.147855 24175 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 17:47:39.150695 24206 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:39.152070 24175 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:47:39.152227 24175 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "80ddd0b52e2346539fdd4b448e9e7ea9"
format_stamp: "Formatted at 2026-08-12 17:47:39 on dist-test-slave-tk9z"
server_key: "766a789e53645a8bec41a7657b1ec59b"
server_key_iv: "d0457761e604b0b1140501330dde6c79"
server_key_version: "encryptionkey@0"
I20260812 17:47:39.152355 24175 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:39.157193 24175 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:39.160303 24175 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:39.160502 24175 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:39.167948 24175 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:44613
I20260812 17:47:39.167977 24281 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:44613 every 8 connection(s)
I20260812 17:47:39.168908 24175 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:47:39.171913 24282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:39.173542 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 24175
I20260812 17:47:39.173694 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:47:39.174014 18428 external_mini_cluster.cc:1428] Setting key 5c4052b4794e70a1c66b8d4f5134efb1
I20260812 17:47:39.178639 24282 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80ddd0b52e2346539fdd4b448e9e7ea9: Bootstrap starting.
I20260812 17:47:39.179505 24287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:39.175551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53781 (local address 127.17.255.62:44613)
0812 17:47:39.176005 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:39.176021 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:39.176058 (+ 37us) server_negotiation.cc:407] Connection header received
0812 17:47:39.176713 (+ 655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:39.176734 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:39.177019 (+ 285us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:39.177358 (+ 339us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:39.178191 (+ 833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:39.178196 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:39.178208 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:47:39.178219 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:39.178277 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:47:39.178297 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:39.178501 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:39.178579 (+ 78us) server_negotiation.cc:299] Negotiation successful
0812 17:47:39.178762 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":306,"thread_start_us":140,"threads_started":1}
I20260812 17:47:39.181227 24282 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 80ddd0b52e2346539fdd4b448e9e7ea9: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:39.182181 24282 log.cc:824] T 00000000000000000000000000000000 P 80ddd0b52e2346539fdd4b448e9e7ea9: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:39.182688 18428 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 17:47:39.184432 24282 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80ddd0b52e2346539fdd4b448e9e7ea9: No bootstrap required, opened a new log
I20260812 17:47:39.186525 24287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:39.184888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44729 (local address 127.17.255.62:44613)
0812 17:47:39.185024 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:39.185029 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:39.185170 (+ 141us) server_negotiation.cc:407] Connection header received
0812 17:47:39.185281 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:39.185283 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:39.185319 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:39.185402 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:39.186130 (+ 728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:39.186134 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:39.186137 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:47:39.186149 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:39.186179 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:47:39.186193 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:39.186279 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:39.186346 (+ 67us) server_negotiation.cc:299] Negotiation successful
0812 17:47:39.186405 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 17:47:39.188928 24282 raft_consensus.cc:348] T 00000000000000000000000000000000 P 80ddd0b52e2346539fdd4b448e9e7ea9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80ddd0b52e2346539fdd4b448e9e7ea9" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 44613 } }
I20260812 17:47:39.189160 24282 raft_consensus.cc:374] T 00000000000000000000000000000000 P 80ddd0b52e2346539fdd4b448e9e7ea9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:47:39.189193 24282 raft_consensus.cc:729] T 00000000000000000000000000000000 P 80ddd0b52e2346539fdd4b448e9e7ea9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80ddd0b52e2346539fdd4b448e9e7ea9, State: Initialized, Role: FOLLOWER
I20260812 17:47:39.189620 24282 consensus_queue.cc:260] T 00000000000000000000000000000000 P 80ddd0b52e2346539fdd4b448e9e7ea9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80ddd0b52e2346539fdd4b448e9e7ea9" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 44613 } }
I20260812 17:47:39.189747 24282 raft_consensus.cc:388] T 00000000000000000000000000000000 P 80ddd0b52e2346539fdd4b448e9e7ea9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:47:39.189836 24282 raft_consensus.cc:482] T 00000000000000000000000000000000 P 80ddd0b52e2346539fdd4b448e9e7ea9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:47:39.189960 24282 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 80ddd0b52e2346539fdd4b448e9e7ea9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:39.191046 24282 raft_consensus.cc:504] T 00000000000000000000000000000000 P 80ddd0b52e2346539fdd4b448e9e7ea9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80ddd0b52e2346539fdd4b448e9e7ea9" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 44613 } }
I20260812 17:47:39.191399 24282 leader_election.cc:302] T 00000000000000000000000000000000 P 80ddd0b52e2346539fdd4b448e9e7ea9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 80ddd0b52e2346539fdd4b448e9e7ea9; no voters:
I20260812 17:47:39.191733 24282 leader_election.cc:288] T 00000000000000000000000000000000 P 80ddd0b52e2346539fdd4b448e9e7ea9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:47:39.191875 24297 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 80ddd0b52e2346539fdd4b448e9e7ea9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:47:39.192128 24297 raft_consensus.cc:686] T 00000000000000000000000000000000 P 80ddd0b52e2346539fdd4b448e9e7ea9 [term 1 LEADER]: Becoming Leader. State: Replica: 80ddd0b52e2346539fdd4b448e9e7ea9, State: Running, Role: LEADER
I20260812 17:47:39.192445 24297 consensus_queue.cc:237] T 00000000000000000000000000000000 P 80ddd0b52e2346539fdd4b448e9e7ea9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80ddd0b52e2346539fdd4b448e9e7ea9" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 44613 } }
I20260812 17:47:39.193004 24282 sys_catalog.cc:564] T 00000000000000000000000000000000 P 80ddd0b52e2346539fdd4b448e9e7ea9 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:47:39.194307 24300 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80ddd0b52e2346539fdd4b448e9e7ea9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 80ddd0b52e2346539fdd4b448e9e7ea9. Latest consensus state: current_term: 1 leader_uuid: "80ddd0b52e2346539fdd4b448e9e7ea9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80ddd0b52e2346539fdd4b448e9e7ea9" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 44613 } } }
I20260812 17:47:39.194463 24300 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80ddd0b52e2346539fdd4b448e9e7ea9 [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:39.194766 24299 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80ddd0b52e2346539fdd4b448e9e7ea9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "80ddd0b52e2346539fdd4b448e9e7ea9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80ddd0b52e2346539fdd4b448e9e7ea9" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 44613 } } }
I20260812 17:47:39.194859 24309 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:47:39.194972 24299 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80ddd0b52e2346539fdd4b448e9e7ea9 [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:39.197681 24309 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:47:39.202737 24309 catalog_manager.cc:1347] Generated new cluster ID: 1e8b2f8a5ec1436f857403ae5fd0fd1e
I20260812 17:47:39.202801 24309 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:47:39.216478 24309 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:47:39.216822 24309 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:47:39.225420 24309 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 80ddd0b52e2346539fdd4b448e9e7ea9: Generated new TSK 0
I20260812 17:47:39.226263 24309 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 17:47:39.237387 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 24175
2026-08-12T17:47:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1689 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:47:39 dist-test-slave-tk9z krb5kdc[24326](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:47:39 dist-test-slave-tk9z krb5kdc[24326](info): set up 2 sockets
Aug 12 17:47:39 dist-test-slave-tk9z krb5kdc[24326](info): commencing operation
krb5kdc: starting...
W20260812 17:47:40.531942 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.268s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:47:40 dist-test-slave-tk9z krb5kdc[24326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556860, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:47:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:47:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.255.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
I20260812 17:47:40.662070 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:45281
--webserver_interface=127.17.255.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:41581
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:45281
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:47:40.780812 24343 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:40.781095 24343 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:40.781137 24343 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:40.785108 24343 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:47:40.785174 24343 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:40.785195 24343 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:40.785212 24343 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:47:40.785228 24343 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:47:40.790979 24343 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:41581
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:45281
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:45281
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24343
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:40.792071 24343 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:40.793071 24343 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:40.802121 24351 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:40.802277 24343 server_base.cc:1034] running on GCE node
W20260812 17:47:40.802084 24354 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:40.802112 24358 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:40.803104 24343 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:40.804231 24343 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:40.805408 24343 hybrid_clock.cc:648] HybridClock initialized: now 1786556860805385 us; error 35 us; skew 500 ppm
Aug 12 17:47:40 dist-test-slave-tk9z krb5kdc[24326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556860, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:47:40.808310 24343 init.cc:377] Logged in from keytab as kudu/127.17.255.62@KRBTEST.COM (short username kudu)
I20260812 17:47:40.809290 24343 webserver.cc:460] Webserver started at http://127.17.255.62:37949/ using document root <none> and password file <none>
I20260812 17:47:40.809901 24343 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:40.809998 24343 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:40.810245 24343 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:40.812418 24343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "383dc807a0374b17b42630098a002578"
format_stamp: "Formatted at 2026-08-12 17:47:40 on dist-test-slave-tk9z"
server_key: "6500fa681d5146f6e72100233c485154"
server_key_iv: "fccffc0364a4bd0c82619f7ca2eb1777"
server_key_version: "encryptionkey@0"
I20260812 17:47:40.813007 24343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "383dc807a0374b17b42630098a002578"
format_stamp: "Formatted at 2026-08-12 17:47:40 on dist-test-slave-tk9z"
server_key: "6500fa681d5146f6e72100233c485154"
server_key_iv: "fccffc0364a4bd0c82619f7ca2eb1777"
server_key_version: "encryptionkey@0"
I20260812 17:47:40.816994 24343 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 17:47:40.819646 24370 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:40.820932 24343 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 17:47:40.821095 24343 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "383dc807a0374b17b42630098a002578"
format_stamp: "Formatted at 2026-08-12 17:47:40 on dist-test-slave-tk9z"
server_key: "6500fa681d5146f6e72100233c485154"
server_key_iv: "fccffc0364a4bd0c82619f7ca2eb1777"
server_key_version: "encryptionkey@0"
I20260812 17:47:40.821218 24343 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:40.853125 24343 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:40.856528 24343 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:40.856855 24343 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:40.865526 24343 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:45281
I20260812 17:47:40.865561 24445 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:45281 every 8 connection(s)
I20260812 17:47:40.866748 24343 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:47:40.869756 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 24343
I20260812 17:47:40.869843 24448 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:40.869921 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:47:40.870223 18428 external_mini_cluster.cc:1428] Setting key 4f2ad042377b6cdccd0b2a0916627b7e
I20260812 17:47:40.877815 24448 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 383dc807a0374b17b42630098a002578: Bootstrap starting.
Aug 12 17:47:40 dist-test-slave-tk9z krb5kdc[24326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556860, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:47:40.880712 24448 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 383dc807a0374b17b42630098a002578: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:40.881690 24448 log.cc:824] T 00000000000000000000000000000000 P 383dc807a0374b17b42630098a002578: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:40.884431 24448 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 383dc807a0374b17b42630098a002578: No bootstrap required, opened a new log
I20260812 17:47:40.887027 24452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:40.871812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46253 (local address 127.17.255.62:45281)
0812 17:47:40.872282 (+ 470us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:40.872304 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:40.872350 (+ 46us) server_negotiation.cc:407] Connection header received
0812 17:47:40.873061 (+ 711us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:40.873086 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:40.873559 (+ 473us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:40.873966 (+ 407us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:40.874719 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:40.876254 (+ 1535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:40.877324 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:40.878043 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:40.878261 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:40.881199 (+ 2938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:40.881207 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:40.881226 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:40.881263 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:40.883541 (+ 2278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:40.884060 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:40.884068 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:40.884074 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:40.884227 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:40.884534 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:40.884537 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:40.884539 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:40.885102 (+ 563us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:40.885292 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:40.885591 (+ 299us) server_negotiation.cc:299] Negotiation successful
0812 17:47:40.885908 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":129,"threads_started":1}
I20260812 17:47:40.889298 24448 raft_consensus.cc:348] T 00000000000000000000000000000000 P 383dc807a0374b17b42630098a002578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "383dc807a0374b17b42630098a002578" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45281 } }
I20260812 17:47:40.889593 24448 raft_consensus.cc:374] T 00000000000000000000000000000000 P 383dc807a0374b17b42630098a002578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:47:40.889665 24448 raft_consensus.cc:729] T 00000000000000000000000000000000 P 383dc807a0374b17b42630098a002578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 383dc807a0374b17b42630098a002578, State: Initialized, Role: FOLLOWER
I20260812 17:47:40.890247 18428 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 17:47:40.890213 24448 consensus_queue.cc:260] T 00000000000000000000000000000000 P 383dc807a0374b17b42630098a002578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "383dc807a0374b17b42630098a002578" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45281 } }
I20260812 17:47:40.890411 24448 raft_consensus.cc:388] T 00000000000000000000000000000000 P 383dc807a0374b17b42630098a002578 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:47:40.890488 24448 raft_consensus.cc:482] T 00000000000000000000000000000000 P 383dc807a0374b17b42630098a002578 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:47:40.890615 24448 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 383dc807a0374b17b42630098a002578 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:40.891645 24448 raft_consensus.cc:504] T 00000000000000000000000000000000 P 383dc807a0374b17b42630098a002578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "383dc807a0374b17b42630098a002578" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45281 } }
I20260812 17:47:40.892038 24448 leader_election.cc:302] T 00000000000000000000000000000000 P 383dc807a0374b17b42630098a002578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 383dc807a0374b17b42630098a002578; no voters:
I20260812 17:47:40.892405 24448 leader_election.cc:288] T 00000000000000000000000000000000 P 383dc807a0374b17b42630098a002578 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:47:40.892534 24459 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 383dc807a0374b17b42630098a002578 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:47:40.892751 24459 raft_consensus.cc:686] T 00000000000000000000000000000000 P 383dc807a0374b17b42630098a002578 [term 1 LEADER]: Becoming Leader. State: Replica: 383dc807a0374b17b42630098a002578, State: Running, Role: LEADER
I20260812 17:47:40.893082 24459 consensus_queue.cc:237] T 00000000000000000000000000000000 P 383dc807a0374b17b42630098a002578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "383dc807a0374b17b42630098a002578" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45281 } }
I20260812 17:47:40.893690 24448 sys_catalog.cc:564] T 00000000000000000000000000000000 P 383dc807a0374b17b42630098a002578 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:47:40.894212 24459 sys_catalog.cc:455] T 00000000000000000000000000000000 P 383dc807a0374b17b42630098a002578 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 383dc807a0374b17b42630098a002578. Latest consensus state: current_term: 1 leader_uuid: "383dc807a0374b17b42630098a002578" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "383dc807a0374b17b42630098a002578" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45281 } } }
I20260812 17:47:40.894335 24459 sys_catalog.cc:458] T 00000000000000000000000000000000 P 383dc807a0374b17b42630098a002578 [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:40.894804 24468 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:47:40.894805 24465 sys_catalog.cc:455] T 00000000000000000000000000000000 P 383dc807a0374b17b42630098a002578 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "383dc807a0374b17b42630098a002578" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "383dc807a0374b17b42630098a002578" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45281 } } }
I20260812 17:47:40.895035 24465 sys_catalog.cc:458] T 00000000000000000000000000000000 P 383dc807a0374b17b42630098a002578 [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:40.898244 24468 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:47:40.904263 24452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:40.892563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53023 (local address 127.17.255.62:45281)
0812 17:47:40.892685 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:40.892690 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:40.894781 (+ 2091us) server_negotiation.cc:407] Connection header received
0812 17:47:40.895018 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:40.895021 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:40.895073 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:40.895125 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:40.896174 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:40.896942 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:40.897996 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:40.898325 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:40.898532 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:40.900498 (+ 1966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:40.900503 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:40.900506 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:40.900534 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:40.902310 (+ 1776us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:40.902888 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:40.902892 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:40.902894 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:40.902989 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:40.903284 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:40.903287 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:40.903289 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:40.903484 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:40.903622 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:40.903933 (+ 311us) server_negotiation.cc:299] Negotiation successful
0812 17:47:40.904095 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 17:47:40.905545 24468 catalog_manager.cc:1347] Generated new cluster ID: 63b0d779bfbe494cb06dec11bdb0ac5e
I20260812 17:47:40.905663 24468 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:47:40.917863 24468 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:47:40.919255 24468 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:47:40.928617 24468 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 383dc807a0374b17b42630098a002578: Generated new TSK 0
I20260812 17:47:40.929479 24468 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 17:47:40.943233 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 24343
2026-08-12T17:47:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1716 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:47:41 dist-test-slave-tk9z krb5kdc[24497](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:47:41 dist-test-slave-tk9z krb5kdc[24497](info): set up 2 sockets
Aug 12 17:47:41 dist-test-slave-tk9z krb5kdc[24497](info): commencing operation
krb5kdc: starting...
W20260812 17:47:42.248672 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.268s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:47:42 dist-test-slave-tk9z krb5kdc[24497](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556862, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:47:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:47:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.255.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
I20260812 17:47:42.382325 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:45647
--webserver_interface=127.17.255.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:40525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:45647
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:47:42.503316 24517 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:42.503583 24517 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:42.503625 24517 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:42.507571 24517 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:47:42.507632 24517 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:42.507651 24517 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:42.507668 24517 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:47:42.507682 24517 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:47:42.512948 24517 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:40525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:45647
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:45647
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24517
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:42.513963 24517 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:42.515027 24517 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:42.524104 24527 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:42.524113 24529 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:42.524204 24517 server_base.cc:1034] running on GCE node
W20260812 17:47:42.524119 24526 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:42.525003 24517 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:42.526219 24517 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:42.527427 24517 hybrid_clock.cc:648] HybridClock initialized: now 1786556862527411 us; error 31 us; skew 500 ppm
Aug 12 17:47:42 dist-test-slave-tk9z krb5kdc[24497](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556862, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:47:42.530541 24517 init.cc:377] Logged in from keytab as kudu/127.17.255.62@KRBTEST.COM (short username kudu)
I20260812 17:47:42.531467 24517 webserver.cc:460] Webserver started at http://127.17.255.62:43185/ using document root <none> and password file <none>
I20260812 17:47:42.532028 24517 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:42.532088 24517 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:42.532261 24517 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:42.534466 24517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "b084dffb242f4c0786f495fa7fb25c61"
format_stamp: "Formatted at 2026-08-12 17:47:42 on dist-test-slave-tk9z"
server_key: "b0c686c1ff0cdc5d537d0ae6ef8afdf4"
server_key_iv: "4bfe9ba347519ad73bbd3a1cc0efae00"
server_key_version: "encryptionkey@0"
I20260812 17:47:42.535040 24517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "b084dffb242f4c0786f495fa7fb25c61"
format_stamp: "Formatted at 2026-08-12 17:47:42 on dist-test-slave-tk9z"
server_key: "b0c686c1ff0cdc5d537d0ae6ef8afdf4"
server_key_iv: "4bfe9ba347519ad73bbd3a1cc0efae00"
server_key_version: "encryptionkey@0"
I20260812 17:47:42.538872 24517 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260812 17:47:42.541476 24542 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:42.542892 24517 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:47:42.543066 24517 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "b084dffb242f4c0786f495fa7fb25c61"
format_stamp: "Formatted at 2026-08-12 17:47:42 on dist-test-slave-tk9z"
server_key: "b0c686c1ff0cdc5d537d0ae6ef8afdf4"
server_key_iv: "4bfe9ba347519ad73bbd3a1cc0efae00"
server_key_version: "encryptionkey@0"
I20260812 17:47:42.543166 24517 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:42.553846 24517 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:42.558018 24517 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:42.558275 24517 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:42.566816 24517 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:45647
I20260812 17:47:42.566890 24625 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:45647 every 8 connection(s)
I20260812 17:47:42.568037 24517 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:47:42.570421 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 24517
I20260812 17:47:42.570627 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:47:42.570983 18428 external_mini_cluster.cc:1428] Setting key 9aecacebd526f677795720ccc5a0d7de
I20260812 17:47:42.571395 24626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:42.578886 24626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b084dffb242f4c0786f495fa7fb25c61: Bootstrap starting.
I20260812 17:47:42.581876 24630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:42.572570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44661 (local address 127.17.255.62:45647)
0812 17:47:42.573056 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:42.573081 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:42.573124 (+ 43us) server_negotiation.cc:407] Connection header received
0812 17:47:42.573901 (+ 777us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:42.573927 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:42.574383 (+ 456us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:42.574801 (+ 418us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:42.575237 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:42.576718 (+ 1481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:42.577752 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:42.578479 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:42.578644 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:42.579562 (+ 918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:42.579569 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:42.579585 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:47:42.580152 (+ 567us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:42.580228 (+ 76us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:47:42.580262 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:42.580448 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:42.580546 (+ 98us) server_negotiation.cc:299] Negotiation successful
0812 17:47:42.580817 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":135,"threads_started":1}
I20260812 17:47:42.581948 24626 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b084dffb242f4c0786f495fa7fb25c61: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:42.582998 24626 log.cc:824] T 00000000000000000000000000000000 P b084dffb242f4c0786f495fa7fb25c61: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:42.585307 18428 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 17:47:42.585611 24626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b084dffb242f4c0786f495fa7fb25c61: No bootstrap required, opened a new log
I20260812 17:47:42.590039 24626 raft_consensus.cc:348] T 00000000000000000000000000000000 P b084dffb242f4c0786f495fa7fb25c61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b084dffb242f4c0786f495fa7fb25c61" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45647 } }
I20260812 17:47:42.590327 24626 raft_consensus.cc:374] T 00000000000000000000000000000000 P b084dffb242f4c0786f495fa7fb25c61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:47:42.590443 24626 raft_consensus.cc:729] T 00000000000000000000000000000000 P b084dffb242f4c0786f495fa7fb25c61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b084dffb242f4c0786f495fa7fb25c61, State: Initialized, Role: FOLLOWER
I20260812 17:47:42.590963 24626 consensus_queue.cc:260] T 00000000000000000000000000000000 P b084dffb242f4c0786f495fa7fb25c61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b084dffb242f4c0786f495fa7fb25c61" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45647 } }
I20260812 17:47:42.591161 24626 raft_consensus.cc:388] T 00000000000000000000000000000000 P b084dffb242f4c0786f495fa7fb25c61 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:47:42.591267 24626 raft_consensus.cc:482] T 00000000000000000000000000000000 P b084dffb242f4c0786f495fa7fb25c61 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:47:42.591418 24626 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b084dffb242f4c0786f495fa7fb25c61 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:42.591946 24630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:42.587501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49215 (local address 127.17.255.62:45647)
0812 17:47:42.587640 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:42.587647 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:42.587812 (+ 165us) server_negotiation.cc:407] Connection header received
0812 17:47:42.587945 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:42.587947 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:42.588002 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:42.588069 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:42.588429 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:42.588937 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:42.590053 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:42.590332 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:42.590459 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:42.591464 (+ 1005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:42.591472 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:42.591492 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:47:42.591511 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:42.591544 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:47:42.591564 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:42.591643 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:42.591746 (+ 103us) server_negotiation.cc:299] Negotiation successful
0812 17:47:42.591809 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 17:47:42.592666 24626 raft_consensus.cc:504] T 00000000000000000000000000000000 P b084dffb242f4c0786f495fa7fb25c61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b084dffb242f4c0786f495fa7fb25c61" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45647 } }
I20260812 17:47:42.593060 24626 leader_election.cc:302] T 00000000000000000000000000000000 P b084dffb242f4c0786f495fa7fb25c61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b084dffb242f4c0786f495fa7fb25c61; no voters:
I20260812 17:47:42.593394 24626 leader_election.cc:288] T 00000000000000000000000000000000 P b084dffb242f4c0786f495fa7fb25c61 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:47:42.593561 24641 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b084dffb242f4c0786f495fa7fb25c61 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:47:42.593812 24641 raft_consensus.cc:686] T 00000000000000000000000000000000 P b084dffb242f4c0786f495fa7fb25c61 [term 1 LEADER]: Becoming Leader. State: Replica: b084dffb242f4c0786f495fa7fb25c61, State: Running, Role: LEADER
I20260812 17:47:42.594132 24641 consensus_queue.cc:237] T 00000000000000000000000000000000 P b084dffb242f4c0786f495fa7fb25c61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b084dffb242f4c0786f495fa7fb25c61" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45647 } }
I20260812 17:47:42.594799 24626 sys_catalog.cc:564] T 00000000000000000000000000000000 P b084dffb242f4c0786f495fa7fb25c61 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:47:42.596067 24644 sys_catalog.cc:455] T 00000000000000000000000000000000 P b084dffb242f4c0786f495fa7fb25c61 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b084dffb242f4c0786f495fa7fb25c61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b084dffb242f4c0786f495fa7fb25c61" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45647 } } }
I20260812 17:47:42.596067 24647 sys_catalog.cc:455] T 00000000000000000000000000000000 P b084dffb242f4c0786f495fa7fb25c61 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b084dffb242f4c0786f495fa7fb25c61. Latest consensus state: current_term: 1 leader_uuid: "b084dffb242f4c0786f495fa7fb25c61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b084dffb242f4c0786f495fa7fb25c61" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45647 } } }
I20260812 17:47:42.596267 24644 sys_catalog.cc:458] T 00000000000000000000000000000000 P b084dffb242f4c0786f495fa7fb25c61 [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:42.596267 24647 sys_catalog.cc:458] T 00000000000000000000000000000000 P b084dffb242f4c0786f495fa7fb25c61 [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:42.596866 24659 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:47:42.600220 24659 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:47:42.605827 24659 catalog_manager.cc:1347] Generated new cluster ID: d9d01b4eda2f41cfafd33e3fe56b89f2
I20260812 17:47:42.605926 24659 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:47:42.631177 24659 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:47:42.632575 24659 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:47:42.638319 24659 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b084dffb242f4c0786f495fa7fb25c61: Generated new TSK 0
I20260812 17:47:42.639122 24659 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 17:47:42.651401 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 24517
2026-08-12T17:47:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1700 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:47:42 dist-test-slave-tk9z krb5kdc[24678](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:47:42 dist-test-slave-tk9z krb5kdc[24678](info): set up 2 sockets
Aug 12 17:47:42 dist-test-slave-tk9z krb5kdc[24678](info): commencing operation
krb5kdc: starting...
W20260812 17:47:43.969890 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.288s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:47:44 dist-test-slave-tk9z krb5kdc[24678](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556864, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:47:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:47:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.255.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
I20260812 17:47:44.103734 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:45659
--webserver_interface=127.17.255.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:44077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:45659
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:47:44.222079 24699 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:44.222352 24699 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:44.222469 24699 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:44.226462 24699 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:47:44.226526 24699 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:44.226547 24699 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:44.226562 24699 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:47:44.226578 24699 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:47:44.231935 24699 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:44077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:45659
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:45659
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24699
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:44.232986 24699 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:44.233968 24699 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:44.242799 24710 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:44.242807 24709 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:44.242818 24712 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:44.243158 24699 server_base.cc:1034] running on GCE node
I20260812 17:47:44.243865 24699 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:44.245025 24699 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:44.246188 24699 hybrid_clock.cc:648] HybridClock initialized: now 1786556864246158 us; error 48 us; skew 500 ppm
Aug 12 17:47:44 dist-test-slave-tk9z krb5kdc[24678](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556864, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:47:44.252183 24699 init.cc:377] Logged in from keytab as kudu/127.17.255.62@KRBTEST.COM (short username kudu)
I20260812 17:47:44.253182 24699 webserver.cc:460] Webserver started at http://127.17.255.62:39497/ using document root <none> and password file <none>
I20260812 17:47:44.253747 24699 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:44.253806 24699 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:44.253980 24699 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:44.256161 24699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "33d3c9e1105e4f7a9709351996a2dc61"
format_stamp: "Formatted at 2026-08-12 17:47:44 on dist-test-slave-tk9z"
server_key: "43ffabffcf0baab12e4d68b9d59fe1eb"
server_key_iv: "e860e48ee3910d3351dff6cac28f068c"
server_key_version: "encryptionkey@0"
I20260812 17:47:44.256695 24699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "33d3c9e1105e4f7a9709351996a2dc61"
format_stamp: "Formatted at 2026-08-12 17:47:44 on dist-test-slave-tk9z"
server_key: "43ffabffcf0baab12e4d68b9d59fe1eb"
server_key_iv: "e860e48ee3910d3351dff6cac28f068c"
server_key_version: "encryptionkey@0"
I20260812 17:47:44.260581 24699 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260812 17:47:44.263427 24723 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:44.264730 24699 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 17:47:44.264969 24699 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "33d3c9e1105e4f7a9709351996a2dc61"
format_stamp: "Formatted at 2026-08-12 17:47:44 on dist-test-slave-tk9z"
server_key: "43ffabffcf0baab12e4d68b9d59fe1eb"
server_key_iv: "e860e48ee3910d3351dff6cac28f068c"
server_key_version: "encryptionkey@0"
I20260812 17:47:44.265086 24699 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:44.269939 24699 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:44.273430 24699 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:44.273648 24699 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:44.281315 24796 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:45659 every 8 connection(s)
I20260812 17:47:44.281315 24699 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:45659
I20260812 17:47:44.282485 24699 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:47:44.285494 24798 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:44.291443 24798 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33d3c9e1105e4f7a9709351996a2dc61: Bootstrap starting.
I20260812 17:47:44.291913 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 24699
I20260812 17:47:44.292064 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:47:44.292346 18428 external_mini_cluster.cc:1428] Setting key 69d581d5e521809b04674293ffb5cbc1
I20260812 17:47:44.294247 24798 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 33d3c9e1105e4f7a9709351996a2dc61: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:44.295063 24798 log.cc:824] T 00000000000000000000000000000000 P 33d3c9e1105e4f7a9709351996a2dc61: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:44.297492 24798 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33d3c9e1105e4f7a9709351996a2dc61: No bootstrap required, opened a new log
I20260812 17:47:44.298101 24801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:44.293808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60269 (local address 127.17.255.62:45659)
0812 17:47:44.294255 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:44.294270 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:44.294308 (+ 38us) server_negotiation.cc:407] Connection header received
0812 17:47:44.295037 (+ 729us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:44.295056 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:44.295391 (+ 335us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:44.295684 (+ 293us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:44.296543 (+ 859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:44.296549 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:44.296564 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:47:44.296576 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:44.296644 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:47:44.296674 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:44.296788 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:44.296983 (+ 195us) server_negotiation.cc:299] Negotiation successful
0812 17:47:44.297146 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285,"thread_start_us":140,"threads_started":1}
I20260812 17:47:44.301240 18428 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 17:47:44.301863 24798 raft_consensus.cc:348] T 00000000000000000000000000000000 P 33d3c9e1105e4f7a9709351996a2dc61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33d3c9e1105e4f7a9709351996a2dc61" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45659 } }
I20260812 17:47:44.302091 24798 raft_consensus.cc:374] T 00000000000000000000000000000000 P 33d3c9e1105e4f7a9709351996a2dc61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 17:47:44.302162 24798 raft_consensus.cc:729] T 00000000000000000000000000000000 P 33d3c9e1105e4f7a9709351996a2dc61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33d3c9e1105e4f7a9709351996a2dc61, State: Initialized, Role: FOLLOWER
I20260812 17:47:44.302716 24798 consensus_queue.cc:260] T 00000000000000000000000000000000 P 33d3c9e1105e4f7a9709351996a2dc61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33d3c9e1105e4f7a9709351996a2dc61" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45659 } }
I20260812 17:47:44.302874 24798 raft_consensus.cc:388] T 00000000000000000000000000000000 P 33d3c9e1105e4f7a9709351996a2dc61 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 17:47:44.302974 24798 raft_consensus.cc:482] T 00000000000000000000000000000000 P 33d3c9e1105e4f7a9709351996a2dc61 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 17:47:44.303097 24798 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 33d3c9e1105e4f7a9709351996a2dc61 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:44.304354 24798 raft_consensus.cc:504] T 00000000000000000000000000000000 P 33d3c9e1105e4f7a9709351996a2dc61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33d3c9e1105e4f7a9709351996a2dc61" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45659 } }
I20260812 17:47:44.304737 24798 leader_election.cc:302] T 00000000000000000000000000000000 P 33d3c9e1105e4f7a9709351996a2dc61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 33d3c9e1105e4f7a9709351996a2dc61; no voters:
I20260812 17:47:44.305119 24798 leader_election.cc:288] T 00000000000000000000000000000000 P 33d3c9e1105e4f7a9709351996a2dc61 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 17:47:44.305339 24801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:44.303561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39991 (local address 127.17.255.62:45659)
0812 17:47:44.303684 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:44.303689 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:44.303849 (+ 160us) server_negotiation.cc:407] Connection header received
0812 17:47:44.303956 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:44.303958 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:44.304001 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:44.304082 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:44.304788 (+ 706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:44.304791 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:44.304794 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 17:47:44.304805 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:44.304835 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 17:47:44.304849 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:44.304933 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:44.305159 (+ 226us) server_negotiation.cc:299] Negotiation successful
0812 17:47:44.305205 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 17:47:44.305426 24814 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 33d3c9e1105e4f7a9709351996a2dc61 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:47:44.305649 24814 raft_consensus.cc:686] T 00000000000000000000000000000000 P 33d3c9e1105e4f7a9709351996a2dc61 [term 1 LEADER]: Becoming Leader. State: Replica: 33d3c9e1105e4f7a9709351996a2dc61, State: Running, Role: LEADER
I20260812 17:47:44.305966 24814 consensus_queue.cc:237] T 00000000000000000000000000000000 P 33d3c9e1105e4f7a9709351996a2dc61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33d3c9e1105e4f7a9709351996a2dc61" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45659 } }
I20260812 17:47:44.306440 24798 sys_catalog.cc:564] T 00000000000000000000000000000000 P 33d3c9e1105e4f7a9709351996a2dc61 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:47:44.307669 24816 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33d3c9e1105e4f7a9709351996a2dc61 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "33d3c9e1105e4f7a9709351996a2dc61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33d3c9e1105e4f7a9709351996a2dc61" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45659 } } }
I20260812 17:47:44.307816 24816 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33d3c9e1105e4f7a9709351996a2dc61 [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:44.308147 24817 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33d3c9e1105e4f7a9709351996a2dc61 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 33d3c9e1105e4f7a9709351996a2dc61. Latest consensus state: current_term: 1 leader_uuid: "33d3c9e1105e4f7a9709351996a2dc61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33d3c9e1105e4f7a9709351996a2dc61" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45659 } } }
I20260812 17:47:44.308246 24817 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33d3c9e1105e4f7a9709351996a2dc61 [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:44.308530 24831 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:47:44.311702 24831 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:47:44.317643 24831 catalog_manager.cc:1347] Generated new cluster ID: cc8ddaa4c1894ddf848cc8dd126224ea
I20260812 17:47:44.317720 24831 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:47:44.330081 24831 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:47:44.330475 24831 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:47:44.339840 24831 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 33d3c9e1105e4f7a9709351996a2dc61: Generated new TSK 0
I20260812 17:47:44.340590 24831 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 17:47:44.353607 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 24699
2026-08-12T17:47:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1701 ms)
[----------] 18 tests from AuthTokenIssuingTest (31062 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:47:44 dist-test-slave-tk9z krb5kdc[24843](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:47:44 dist-test-slave-tk9z krb5kdc[24843](info): set up 2 sockets
Aug 12 17:47:44 dist-test-slave-tk9z krb5kdc[24843](info): commencing operation
krb5kdc: starting...
W20260812 17:47:45.655519 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.272s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:47:45 dist-test-slave-tk9z krb5kdc[24843](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:47:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:47:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.255.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
I20260812 17:47:45.789157 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:45447
--webserver_interface=127.17.255.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:43757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:45447,127.17.255.61:34441,127.17.255.60:35285
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:47:45.908593 24858 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 17:47:45.908948 24858 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:45.909024 24858 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:45.909102 24858 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:45.913213 24858 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:47:45.913296 24858 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:45.913334 24858 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:45.913398 24858 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:47:45.913437 24858 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:47:45.918919 24858 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:43757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:45447,127.17.255.61:34441,127.17.255.60:35285
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:45447
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24858
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:45.920107 24858 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:45.921216 24858 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:45.930523 24864 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:45.930603 24871 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:45.930544 24865 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:45.930505 24858 server_base.cc:1034] running on GCE node
I20260812 17:47:45.931372 24858 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:45.932600 24858 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:45.933804 24858 hybrid_clock.cc:648] HybridClock initialized: now 1786556865933786 us; error 31 us; skew 500 ppm
Aug 12 17:47:45 dist-test-slave-tk9z krb5kdc[24843](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556865, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:47:45.936853 24858 init.cc:377] Logged in from keytab as kudu/127.17.255.62@KRBTEST.COM (short username kudu)
I20260812 17:47:45.937899 24858 webserver.cc:460] Webserver started at http://127.17.255.62:32901/ using document root <none> and password file <none>
I20260812 17:47:45.938573 24858 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:45.938669 24858 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:45.938920 24858 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:45.941087 24858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "c31c1a92603445dab36c3900e5aa68be"
format_stamp: "Formatted at 2026-08-12 17:47:45 on dist-test-slave-tk9z"
server_key: "da86f9385399ef31cb9b4268564a4a49"
server_key_iv: "99341beb20f9c888cb4c2864bda3cd3e"
server_key_version: "encryptionkey@0"
I20260812 17:47:45.941720 24858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "c31c1a92603445dab36c3900e5aa68be"
format_stamp: "Formatted at 2026-08-12 17:47:45 on dist-test-slave-tk9z"
server_key: "da86f9385399ef31cb9b4268564a4a49"
server_key_iv: "99341beb20f9c888cb4c2864bda3cd3e"
server_key_version: "encryptionkey@0"
I20260812 17:47:45.945824 24858 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260812 17:47:45.948567 24880 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:45.950148 24858 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 17:47:45.950495 24858 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "c31c1a92603445dab36c3900e5aa68be"
format_stamp: "Formatted at 2026-08-12 17:47:45 on dist-test-slave-tk9z"
server_key: "da86f9385399ef31cb9b4268564a4a49"
server_key_iv: "99341beb20f9c888cb4c2864bda3cd3e"
server_key_version: "encryptionkey@0"
I20260812 17:47:45.950644 24858 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:45.994515 24858 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:45.998708 24858 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:45.998971 24858 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:46.007055 24858 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:45447
I20260812 17:47:46.007429 24957 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:45447 every 8 connection(s)
I20260812 17:47:46.008179 24858 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:47:46.008795 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 24858
I20260812 17:47:46.008975 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:47:46.009294 18428 external_mini_cluster.cc:1428] Setting key f0acd31279b3c51be1b168427c606063
I20260812 17:47:46.011680 24958 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:46.017738 24958 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45447 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.17.255.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.61@KRBTEST.COM" created.
Aug 12 17:47:46 dist-test-slave-tk9z krb5kdc[24843](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556865, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:47:46.036990 24964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:46.020947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:45447 (local address 127.0.0.1:56652)
0812 17:47:46.021598 (+ 651us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:46.021651 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:46.022715 (+ 1064us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:46.023514 (+ 799us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:46.023524 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:46.024038 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:47:46.024473 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:46.024501 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.026350 (+ 1849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.026353 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:46.027247 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:46.027258 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.028255 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.028258 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:46.028435 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:46.029179 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:47:46.029198 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:47:46.031129 (+ 1931us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:47:46.033447 (+ 2318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:46.033456 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:46.033466 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:46.033718 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:46.034163 (+ 445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:46.034166 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:46.034167 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:46.034325 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:46.035294 (+ 969us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:47:46.035300 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:47:46.035528 (+ 228us) client_negotiation.cc:769] Sending connection context
0812 17:47:46.035690 (+ 162us) client_negotiation.cc:240] Negotiation successful
0812 17:47:46.036008 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":382,"mutex_wait_us":45,"spinlock_wait_cycles":55040,"thread_start_us":173,"threads_started":1}
I20260812 17:47:46.036994 24963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:46.020947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56652 (local address 127.17.255.62:45447)
0812 17:47:46.021543 (+ 596us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:46.021563 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:46.021803 (+ 240us) server_negotiation.cc:407] Connection header received
0812 17:47:46.023062 (+ 1259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:46.023066 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:46.023254 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:46.023429 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:46.024690 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.026169 (+ 1479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.027397 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.028076 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.028279 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:46.031319 (+ 3040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:46.031330 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:46.031347 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:46.031378 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:46.033309 (+ 1931us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:46.033904 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:46.033910 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:46.033911 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:46.034059 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:46.034557 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:46.034562 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:46.034563 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:46.035153 (+ 590us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:46.035324 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:46.035949 (+ 625us) server_negotiation.cc:299] Negotiation successful
0812 17:47:46.036174 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":77,"server-negotiator.queue_time_us":452,"thread_start_us":159,"threads_started":1}
I20260812 17:47:46.039754 24958 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.255.61" port: 34441 } has no permanent_uuid. Determining permanent_uuid...
I20260812 17:47:46.040568 24964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:46.040283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.61:34441 (local address 127.0.0.1:47166)
0812 17:47:46.040421 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:46.040503 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.61:34441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260812 17:47:46.040784 24886 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.255.61:34441: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.61.keytab.
Entry for principal kudu/127.17.255.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.61.keytab.
I20260812 17:47:46.041899 24964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:46.041574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.61:34441 (local address 127.0.0.1:47176)
0812 17:47:46.041743 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:46.041798 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.61:34441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
W20260812 17:47:46.042129 24958 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.255.61:34441: Network error: Client connection negotiation failed: client connection to 127.17.255.61:34441: connect: Connection refused (error 111)
I20260812 17:47:46.042914 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.61:34441
--webserver_interface=127.17.255.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.61.keytab
--principal=kudu/127.17.255.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:43757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:45447,127.17.255.61:34441,127.17.255.60:35285
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 17:47:46.091501 24958 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.255.61" port: 34441 } attempt: 1
I20260812 17:47:46.092577 24964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:46.092200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.61:34441 (local address 127.0.0.1:47184)
0812 17:47:46.092417 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:46.092490 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.61:34441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260812 17:47:46.093449 24964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:46.093185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.61:34441 (local address 127.0.0.1:47194)
0812 17:47:46.093329 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:46.093388 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.61:34441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260812 17:47:46.093602 24958 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.255.61:34441: Network error: Client connection negotiation failed: client connection to 127.17.255.61:34441: connect: Connection refused (error 111)
W20260812 17:47:46.161183 24969 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 17:47:46.161561 24969 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:46.161635 24969 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:46.161713 24969 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260812 17:47:46.161751 24958 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.255.61" port: 34441 } attempt: 2
I20260812 17:47:46.162679 24964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:46.162329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.61:34441 (local address 127.0.0.1:47204)
0812 17:47:46.162528 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:46.162601 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.61:34441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103}
I20260812 17:47:46.163393 24964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:46.163176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.61:34441 (local address 127.0.0.1:47216)
0812 17:47:46.163288 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:46.163341 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.61:34441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260812 17:47:46.163534 24958 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.255.61:34441: Network error: Client connection negotiation failed: client connection to 127.17.255.61:34441: connect: Connection refused (error 111)
W20260812 17:47:46.166198 24969 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:47:46.166278 24969 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:46.166322 24969 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:46.166361 24969 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:47:46.166412 24969 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:47:46.171818 24969 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:43757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:45447,127.17.255.61:34441,127.17.255.60:35285
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.61.keytab
--principal=kudu/127.17.255.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.61:34441
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.17.255.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24969
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:46.172940 24969 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:46.174021 24969 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:46.182732 24976 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:46.182905 24969 server_base.cc:1034] running on GCE node
W20260812 17:47:46.182773 24980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:46.182773 24975 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:46.183686 24969 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:46.184834 24969 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:46.185997 24969 hybrid_clock.cc:648] HybridClock initialized: now 1786556866185982 us; error 25 us; skew 500 ppm
Aug 12 17:47:46 dist-test-slave-tk9z krb5kdc[24843](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556866, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:47:46.188903 24969 init.cc:377] Logged in from keytab as kudu/127.17.255.61@KRBTEST.COM (short username kudu)
I20260812 17:47:46.189833 24969 webserver.cc:460] Webserver started at http://127.17.255.61:36607/ using document root <none> and password file <none>
I20260812 17:47:46.190500 24969 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:46.190716 24969 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:46.191004 24969 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:46.193200 24969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-1/data/instance:
uuid: "4b566dd0a987465fbcca3337d4692d06"
format_stamp: "Formatted at 2026-08-12 17:47:46 on dist-test-slave-tk9z"
server_key: "63ab6caac57ed0eb189b61a7ebb20051"
server_key_iv: "cea7186c3586b6e2d73923580f636f8c"
server_key_version: "encryptionkey@0"
I20260812 17:47:46.193856 24969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-1/wal/instance:
uuid: "4b566dd0a987465fbcca3337d4692d06"
format_stamp: "Formatted at 2026-08-12 17:47:46 on dist-test-slave-tk9z"
server_key: "63ab6caac57ed0eb189b61a7ebb20051"
server_key_iv: "cea7186c3586b6e2d73923580f636f8c"
server_key_version: "encryptionkey@0"
I20260812 17:47:46.197830 24969 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.001s
I20260812 17:47:46.200412 24992 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:46.201627 24969 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 17:47:46.201781 24969 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-1/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-1/wal
uuid: "4b566dd0a987465fbcca3337d4692d06"
format_stamp: "Formatted at 2026-08-12 17:47:46 on dist-test-slave-tk9z"
server_key: "63ab6caac57ed0eb189b61a7ebb20051"
server_key_iv: "cea7186c3586b6e2d73923580f636f8c"
server_key_version: "encryptionkey@0"
I20260812 17:47:46.201907 24969 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:46.232303 24969 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:46.235534 24969 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:46.235767 24969 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:46.243921 24969 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.61:34441
I20260812 17:47:46.244268 25072 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.61:34441 every 8 connection(s)
I20260812 17:47:46.245015 24969 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-1/data/info.pb
I20260812 17:47:46.248277 25073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:46.251073 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 24969
I20260812 17:47:46.251231 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-1/wal/instance
I20260812 17:47:46.251600 18428 external_mini_cluster.cc:1428] Setting key 49814680ef54fac132b14b8dc1982a7b
I20260812 17:47:46.253328 25073 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45447 } has no permanent_uuid. Determining permanent_uuid...
I20260812 17:47:46.254693 24958 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.255.61" port: 34441 } attempt: 3
WARNING: no policy specified for kudu/127.17.255.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.60@KRBTEST.COM" created.
Aug 12 17:47:46 dist-test-slave-tk9z krb5kdc[24843](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556865, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for kudu/127.17.255.61@KRBTEST.COM
Aug 12 17:47:46 dist-test-slave-tk9z krb5kdc[24843](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556866, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.61@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:47:46.271402 24964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:46.255246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.61:34441 (local address 127.0.0.1:47220)
0812 17:47:46.255519 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:46.255538 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:46.255642 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:46.258225 (+ 2583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:46.258231 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:46.258495 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:47:46.258674 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:46.258687 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.260686 (+ 1999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.260690 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:46.261411 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:46.261421 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.262166 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.262171 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:46.262299 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:46.262869 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:47:46.262882 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:47:46.266003 (+ 3121us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:47:46.268887 (+ 2884us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:46.268891 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:46.268893 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:46.269349 (+ 456us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:46.269794 (+ 445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:46.269800 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:46.269805 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:46.269919 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:46.270822 (+ 903us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:47:46.270825 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:47:46.270929 (+ 104us) client_negotiation.cc:769] Sending connection context
0812 17:47:46.271058 (+ 129us) client_negotiation.cc:240] Negotiation successful
0812 17:47:46.271220 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"mutex_wait_us":26}
I20260812 17:47:46.271723 24963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:46.255893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56662 (local address 127.17.255.62:45447)
0812 17:47:46.256054 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:46.256060 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:46.256782 (+ 722us) server_negotiation.cc:407] Connection header received
0812 17:47:46.257949 (+ 1167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:46.257952 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:46.258012 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:46.258100 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:46.259254 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.259792 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.261121 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.261616 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.261731 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:46.267006 (+ 5275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:46.267010 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:46.267012 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:46.267037 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:46.269416 (+ 2379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:46.269938 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:46.269941 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:46.269943 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:46.270041 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:46.270428 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:46.270432 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:46.270433 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:46.270645 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:46.270760 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:46.271333 (+ 573us) server_negotiation.cc:299] Negotiation successful
0812 17:47:46.271506 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":43,"server-negotiator.queue_time_us":74}
I20260812 17:47:46.272588 25083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:46.255967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:45447 (local address 127.0.0.1:56662)
0812 17:47:46.256640 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:46.256689 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:46.257692 (+ 1003us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:46.258160 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:46.258169 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:46.258613 (+ 444us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:47:46.259112 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:46.259122 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.259917 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.259922 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:46.260977 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:46.260988 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.261789 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.261793 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:46.261970 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:46.262720 (+ 750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:47:46.262747 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:47:46.266801 (+ 4054us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:47:46.269523 (+ 2722us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:46.269531 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:46.269539 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:46.269836 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:46.270156 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:46.270162 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:46.270167 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:46.270291 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:46.270781 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:47:46.270792 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:47:46.271009 (+ 217us) client_negotiation.cc:769] Sending connection context
0812 17:47:46.271948 (+ 939us) client_negotiation.cc:240] Negotiation successful
0812 17:47:46.272149 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":484,"mutex_wait_us":119,"spinlock_wait_cycles":59136,"thread_start_us":175,"threads_started":1}
I20260812 17:47:46.272601 25080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:46.255967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47220 (local address 127.17.255.61:34441)
0812 17:47:46.256512 (+ 545us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:46.256533 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:46.256577 (+ 44us) server_negotiation.cc:407] Connection header received
0812 17:47:46.257683 (+ 1106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:46.257712 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:46.257997 (+ 285us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:46.258896 (+ 899us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:46.259063 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.260543 (+ 1480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.261537 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.262015 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.262121 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:46.266205 (+ 4084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:46.266216 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:46.266238 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:46.266276 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:46.268734 (+ 2458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:46.269484 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:46.269492 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:46.269503 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:46.269672 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:46.270011 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:46.270014 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:46.270016 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:46.270680 (+ 664us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:46.270864 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:46.271169 (+ 305us) server_negotiation.cc:299] Negotiation successful
0812 17:47:46.271519 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":29,"server-negotiator.queue_time_us":372,"thread_start_us":175,"threads_started":1}
I20260812 17:47:46.274046 25073 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.255.61" port: 34441 } has no permanent_uuid. Determining permanent_uuid...
I20260812 17:47:46.274966 24958 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.255.60" port: 35285 } has no permanent_uuid. Determining permanent_uuid...
I20260812 17:47:46.275791 24964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:46.275461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:35285 (local address 127.0.0.1:39488)
0812 17:47:46.275659 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:46.275717 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.60:35285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
I20260812 17:47:46.276593 24964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:46.276296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:35285 (local address 127.0.0.1:39498)
0812 17:47:46.276463 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:46.276526 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.60:35285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
W20260812 17:47:46.276794 24958 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.255.60:35285: Network error: Client connection negotiation failed: client connection to 127.17.255.60:35285: connect: Connection refused (error 111)
Aug 12 17:47:46 dist-test-slave-tk9z krb5kdc[24843](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556866, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.61@KRBTEST.COM for kudu/127.17.255.61@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.60.keytab.
Entry for principal kudu/127.17.255.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.60.keytab.
I20260812 17:47:46.283273 25083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:46.274621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.61:34441 (local address 127.0.0.1:47224)
0812 17:47:46.274757 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:46.274770 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:46.274865 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:46.275404 (+ 539us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:46.275407 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:46.275584 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:47:46.275661 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:46.275666 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.276578 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.276583 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:46.277246 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:46.277255 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.277748 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.277750 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:46.277844 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:46.278308 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:47:46.278319 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:47:46.279798 (+ 1479us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:47:46.281632 (+ 1834us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:46.281637 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:46.281639 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:46.281911 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:46.282185 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:46.282189 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:46.282191 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:46.282282 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:46.282737 (+ 455us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:47:46.282740 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:47:46.282833 (+ 93us) client_negotiation.cc:769] Sending connection context
0812 17:47:46.282951 (+ 118us) client_negotiation.cc:240] Negotiation successful
0812 17:47:46.283094 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59,"mutex_wait_us":13}
I20260812 17:47:46.283273 25080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:46.275090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47224 (local address 127.17.255.61:34441)
0812 17:47:46.275189 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:46.275193 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:46.275205 (+ 12us) server_negotiation.cc:407] Connection header received
0812 17:47:46.275239 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:46.275242 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:46.275294 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:46.275392 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:46.275771 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.276449 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.277360 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.277659 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.277742 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:46.279948 (+ 2206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:46.279952 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:46.279955 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:46.279983 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:46.281506 (+ 1523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:46.282007 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:46.282010 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:46.282012 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:46.282092 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:46.282397 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:46.282400 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:46.282402 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:46.282607 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:46.282761 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:46.282998 (+ 237us) server_negotiation.cc:299] Negotiation successful
0812 17:47:46.283148 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":43,"server-negotiator.queue_time_us":42}
I20260812 17:47:46.283962 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.60:35285
--webserver_interface=127.17.255.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.60.keytab
--principal=kudu/127.17.255.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:43757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:45447,127.17.255.61:34441,127.17.255.60:35285
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 17:47:46.286173 25073 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.255.60" port: 35285 } has no permanent_uuid. Determining permanent_uuid...
I20260812 17:47:46.287075 25083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:46.286760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:35285 (local address 127.0.0.1:39500)
0812 17:47:46.286916 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:46.287015 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.60:35285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260812 17:47:46.287303 24993 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.255.60:35285: connect: Connection refused (error 111)
I20260812 17:47:46.288287 25083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:46.288088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:35285 (local address 127.0.0.1:39502)
0812 17:47:46.288189 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:46.288234 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.60:35285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260812 17:47:46.288458 25073 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.255.60:35285: Network error: Client connection negotiation failed: client connection to 127.17.255.60:35285: connect: Connection refused (error 111)
I20260812 17:47:46.307981 24958 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.255.60" port: 35285 } attempt: 1
I20260812 17:47:46.308892 24964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:46.308578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:35285 (local address 127.0.0.1:39518)
0812 17:47:46.308738 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:46.308814 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.60:35285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260812 17:47:46.309664 24964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:46.309444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:35285 (local address 127.0.0.1:39526)
0812 17:47:46.309557 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:46.309605 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.60:35285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260812 17:47:46.309871 24958 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.255.60:35285: Network error: Client connection negotiation failed: client connection to 127.17.255.60:35285: connect: Connection refused (error 111)
I20260812 17:47:46.337769 25073 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.255.60" port: 35285 } attempt: 1
I20260812 17:47:46.338835 25083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:46.338481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:35285 (local address 127.0.0.1:39540)
0812 17:47:46.338683 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:46.338750 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.60:35285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260812 17:47:46.339617 25083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:46.339372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:35285 (local address 127.0.0.1:39554)
0812 17:47:46.339492 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:46.339548 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.60:35285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260812 17:47:46.339749 25073 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.255.60:35285: Network error: Client connection negotiation failed: client connection to 127.17.255.60:35285: connect: Connection refused (error 111)
I20260812 17:47:46.385069 24958 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.255.60" port: 35285 } attempt: 2
I20260812 17:47:46.386089 24964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:46.385732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:35285 (local address 127.0.0.1:39566)
0812 17:47:46.385920 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:46.385998 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.60:35285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260812 17:47:46.386936 24964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:46.386701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:35285 (local address 127.0.0.1:39570)
0812 17:47:46.386822 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:46.386879 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.60:35285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260812 17:47:46.387096 24958 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.255.60:35285: Network error: Client connection negotiation failed: client connection to 127.17.255.60:35285: connect: Connection refused (error 111)
W20260812 17:47:46.405054 25088 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 17:47:46.405428 25088 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:46.405500 25088 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:46.405551 25088 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260812 17:47:46.407913 25073 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.255.60" port: 35285 } attempt: 2
I20260812 17:47:46.408841 25083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:46.408498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:35285 (local address 127.0.0.1:39576)
0812 17:47:46.408691 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:46.408760 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.60:35285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260812 17:47:46.409621 25083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:46.409411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:35285 (local address 127.0.0.1:39592)
0812 17:47:46.409512 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:46.409558 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.60:35285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260812 17:47:46.409770 25073 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.255.60:35285: Network error: Client connection negotiation failed: client connection to 127.17.255.60:35285: connect: Connection refused (error 111)
W20260812 17:47:46.410349 25088 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:47:46.410461 25088 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:46.410492 25088 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:46.410511 25088 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:47:46.410560 25088 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:47:46.416322 25088 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:43757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:45447,127.17.255.61:34441,127.17.255.60:35285
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.60.keytab
--principal=kudu/127.17.255.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.60:35285
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.17.255.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25088
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:46.417510 25088 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:46.418700 25088 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:46.427467 25098 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:46.427459 25101 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:46.427462 25097 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:46.427945 25088 server_base.cc:1034] running on GCE node
I20260812 17:47:46.428537 25088 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:46.429768 25088 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:46.430976 25088 hybrid_clock.cc:648] HybridClock initialized: now 1786556866430955 us; error 42 us; skew 500 ppm
Aug 12 17:47:46 dist-test-slave-tk9z krb5kdc[24843](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556866, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:47:46.434069 25088 init.cc:377] Logged in from keytab as kudu/127.17.255.60@KRBTEST.COM (short username kudu)
I20260812 17:47:46.435109 25088 webserver.cc:460] Webserver started at http://127.17.255.60:39243/ using document root <none> and password file <none>
I20260812 17:47:46.435753 25088 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:46.435858 25088 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:46.436110 25088 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:46.438464 25088 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-2/data/instance:
uuid: "566ce4966fb9480b81d8db93efc340de"
format_stamp: "Formatted at 2026-08-12 17:47:46 on dist-test-slave-tk9z"
server_key: "739446365bce68dfd02cdf9a90bdf6ba"
server_key_iv: "d7b21194002e24c7acd7e8a31a16e2ec"
server_key_version: "encryptionkey@0"
I20260812 17:47:46.439121 25088 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-2/wal/instance:
uuid: "566ce4966fb9480b81d8db93efc340de"
format_stamp: "Formatted at 2026-08-12 17:47:46 on dist-test-slave-tk9z"
server_key: "739446365bce68dfd02cdf9a90bdf6ba"
server_key_iv: "d7b21194002e24c7acd7e8a31a16e2ec"
server_key_version: "encryptionkey@0"
I20260812 17:47:46.443257 25088 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 17:47:46.445808 25108 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:46.447217 25088 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 17:47:46.447376 25088 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-2/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-2/wal
uuid: "566ce4966fb9480b81d8db93efc340de"
format_stamp: "Formatted at 2026-08-12 17:47:46 on dist-test-slave-tk9z"
server_key: "739446365bce68dfd02cdf9a90bdf6ba"
server_key_iv: "d7b21194002e24c7acd7e8a31a16e2ec"
server_key_version: "encryptionkey@0"
I20260812 17:47:46.447497 25088 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:46.473618 25088 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:46.477339 25088 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:46.477571 25088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:46.485188 25088 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.60:35285
I20260812 17:47:46.485514 25192 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.60:35285 every 8 connection(s)
I20260812 17:47:46.486279 25088 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-2/data/info.pb
I20260812 17:47:46.486281 24958 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.255.60" port: 35285 } attempt: 3
I20260812 17:47:46.489349 25193 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:46.492816 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 25088
I20260812 17:47:46.492971 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786556557564181-18428-0/minicluster-data/master-2/wal/instance
I20260812 17:47:46.493341 18428 external_mini_cluster.cc:1428] Setting key 59be6c1c71e442f5fa06f5b0ba97dc90
I20260812 17:47:46.495136 25193 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45447 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 17:47:46 dist-test-slave-tk9z krb5kdc[24843](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556865, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for kudu/127.17.255.60@KRBTEST.COM
I20260812 17:47:46.500950 25073 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.255.60" port: 35285 } attempt: 3
Aug 12 17:47:46 dist-test-slave-tk9z krb5kdc[24843](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.255.60@KRBTEST.COM
I20260812 17:47:46.501154 24964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:46.486899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:35285 (local address 127.0.0.1:39606)
0812 17:47:46.487050 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:46.487068 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:46.487173 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:46.489428 (+ 2255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:46.489431 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:46.489639 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:47:46.489775 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:46.489797 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.491819 (+ 2022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.491824 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:46.492642 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:46.492655 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.493787 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.493794 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:46.493911 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:46.494622 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:47:46.494641 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:47:46.496351 (+ 1710us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:47:46.499100 (+ 2749us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:46.499106 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:46.499110 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:46.499389 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:46.499779 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:46.499782 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:46.499784 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:46.499889 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:46.500564 (+ 675us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:47:46.500569 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:47:46.500720 (+ 151us) client_negotiation.cc:769] Sending connection context
0812 17:47:46.500814 (+ 94us) client_negotiation.cc:240] Negotiation successful
0812 17:47:46.500973 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260812 17:47:46.503549 25195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:46.487647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39606 (local address 127.17.255.60:35285)
0812 17:47:46.488056 (+ 409us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:46.488079 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:46.488127 (+ 48us) server_negotiation.cc:407] Connection header received
0812 17:47:46.488789 (+ 662us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:46.488805 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:46.489130 (+ 325us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:46.489437 (+ 307us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:46.489964 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.491663 (+ 1699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.492826 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.493631 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.493823 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:46.496564 (+ 2741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:46.496571 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:46.496586 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:46.496618 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:46.498966 (+ 2348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:46.499533 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:46.499538 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:46.499546 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:46.499666 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:46.499989 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:46.499993 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:46.499995 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:46.500403 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:46.501852 (+ 1449us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:46.502022 (+ 170us) server_negotiation.cc:299] Negotiation successful
0812 17:47:46.502335 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":265,"thread_start_us":136,"threads_started":1}
Aug 12 17:47:46 dist-test-slave-tk9z krb5kdc[24843](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556866, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.60@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
Aug 12 17:47:46 dist-test-slave-tk9z krb5kdc[24843](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556866, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.61@KRBTEST.COM for kudu/127.17.255.60@KRBTEST.COM
I20260812 17:47:46.509083 25196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:46.494044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39608 (local address 127.17.255.60:35285)
0812 17:47:46.494491 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:46.494505 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:46.494596 (+ 91us) server_negotiation.cc:407] Connection header received
0812 17:47:46.494761 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:46.494765 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:46.494829 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:46.494938 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:46.495888 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.496749 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.498079 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.498462 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.498577 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:46.501841 (+ 3264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:46.501845 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:46.501847 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:46.501874 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:46.503881 (+ 2007us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:46.504464 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:46.504471 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:46.504474 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:46.504619 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:46.506067 (+ 1448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:46.506070 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:46.506072 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:46.506304 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:46.506804 (+ 500us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:46.508693 (+ 1889us) server_negotiation.cc:299] Negotiation successful
0812 17:47:46.508835 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":128,"threads_started":1}
I20260812 17:47:46.509243 24958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c31c1a92603445dab36c3900e5aa68be: Bootstrap starting.
I20260812 17:47:46.511431 24963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:46.497365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56678 (local address 127.17.255.62:45447)
0812 17:47:46.497500 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:46.497505 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:46.498244 (+ 739us) server_negotiation.cc:407] Connection header received
0812 17:47:46.498477 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:46.498481 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:46.498564 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:46.498645 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:46.499562 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.500491 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.501785 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.502171 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.502261 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:46.506822 (+ 4561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:46.506826 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:46.506830 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:46.506867 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:46.509042 (+ 2175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:46.509689 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:46.509693 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:46.509695 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:46.509802 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:46.510166 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:46.510169 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:46.510171 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:46.510489 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:46.510576 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:46.511113 (+ 537us) server_negotiation.cc:299] Negotiation successful
0812 17:47:46.511247 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 17:47:46.512288 25200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:46.497296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:45447 (local address 127.0.0.1:56678)
0812 17:47:46.498073 (+ 777us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:46.498155 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:46.498320 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:46.498770 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:46.498779 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:46.499248 (+ 469us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:47:46.499417 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:46.499427 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.500625 (+ 1198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.500630 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:46.501633 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:46.501644 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.502498 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.502505 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:46.502645 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:46.504771 (+ 2126us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:47:46.504790 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:47:46.506655 (+ 1865us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:47:46.509172 (+ 2517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:46.509182 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:46.509188 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:46.509513 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:46.509935 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:46.509939 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:46.509941 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:46.510046 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:46.510673 (+ 627us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:47:46.510679 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:47:46.510834 (+ 155us) client_negotiation.cc:769] Sending connection context
0812 17:47:46.511903 (+ 1069us) client_negotiation.cc:240] Negotiation successful
0812 17:47:46.512109 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":96,"threads_started":1}
I20260812 17:47:46.512676 25083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:46.501414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:35285 (local address 127.0.0.1:39620)
0812 17:47:46.501682 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:46.501700 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:46.501803 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:46.503226 (+ 1423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:46.503229 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:46.503412 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:47:46.503520 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:46.503527 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.504609 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.504613 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:46.505371 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:46.505382 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.506066 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.506070 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:46.506172 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:46.506655 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:47:46.506670 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:47:46.508192 (+ 1522us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:47:46.510921 (+ 2729us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:46.510924 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:46.510927 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:46.511179 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:46.511515 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:46.511519 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:46.511523 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:46.511623 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:46.512119 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:47:46.512123 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:47:46.512243 (+ 120us) client_negotiation.cc:769] Sending connection context
0812 17:47:46.512335 (+ 92us) client_negotiation.cc:240] Negotiation successful
0812 17:47:46.512470 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183}
I20260812 17:47:46.513312 25201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:46.501962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39620 (local address 127.17.255.60:35285)
0812 17:47:46.502979 (+ 1017us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:46.502987 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:46.503001 (+ 14us) server_negotiation.cc:407] Connection header received
0812 17:47:46.503033 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:46.503036 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:46.503074 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:46.503648 (+ 574us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:46.503737 (+ 89us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.504469 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.505532 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.505920 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.506414 (+ 494us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:46.508363 (+ 1949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:46.508367 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:46.508369 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:46.508399 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:46.510781 (+ 2382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:46.511312 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:46.511315 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:46.511317 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:46.511404 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:46.511733 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:46.511736 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:46.511738 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:46.511990 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:46.512968 (+ 978us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:46.513043 (+ 75us) server_negotiation.cc:299] Negotiation successful
0812 17:47:46.513154 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":950,"thread_start_us":576,"threads_started":1}
I20260812 17:47:46.513422 25193 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.255.61" port: 34441 } has no permanent_uuid. Determining permanent_uuid...
I20260812 17:47:46.513695 24958 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c31c1a92603445dab36c3900e5aa68be: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:46.514798 24958 log.cc:824] T 00000000000000000000000000000000 P c31c1a92603445dab36c3900e5aa68be: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:46.516590 25073 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b566dd0a987465fbcca3337d4692d06: Bootstrap starting.
Aug 12 17:47:46 dist-test-slave-tk9z krb5kdc[24843](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:47:46.518647 24958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c31c1a92603445dab36c3900e5aa68be: No bootstrap required, opened a new log
I20260812 17:47:46.519778 25073 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4b566dd0a987465fbcca3337d4692d06: Neither blocks nor log segments found. Creating new log.
Aug 12 17:47:46 dist-test-slave-tk9z krb5kdc[24843](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556866, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.60@KRBTEST.COM for kudu/127.17.255.61@KRBTEST.COM
I20260812 17:47:46.520768 25073 log.cc:824] T 00000000000000000000000000000000 P 4b566dd0a987465fbcca3337d4692d06: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:46.523221 25073 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b566dd0a987465fbcca3337d4692d06: No bootstrap required, opened a new log
I20260812 17:47:46.523682 24963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:46.511232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56680 (local address 127.17.255.62:45447)
0812 17:47:46.511616 (+ 384us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:46.511621 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:46.511635 (+ 14us) server_negotiation.cc:407] Connection header received
0812 17:47:46.511674 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:46.511677 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:46.511719 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:46.511818 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:46.513000 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.513704 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.515031 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.515356 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.515467 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:46.518972 (+ 3505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:46.518976 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:46.518978 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:46.519004 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:46.520732 (+ 1728us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:46.521548 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:46.521552 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:46.521554 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:46.521912 (+ 358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:46.522232 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:46.522236 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:46.522238 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:46.522499 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:46.522678 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:46.523400 (+ 722us) server_negotiation.cc:299] Negotiation successful
0812 17:47:46.523522 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":127,"threads_started":1}
I20260812 17:47:46.524734 24958 raft_consensus.cc:348] T 00000000000000000000000000000000 P c31c1a92603445dab36c3900e5aa68be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c31c1a92603445dab36c3900e5aa68be" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45447 } } peers { permanent_uuid: "4b566dd0a987465fbcca3337d4692d06" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 34441 } } peers { permanent_uuid: "566ce4966fb9480b81d8db93efc340de" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 35285 } }
I20260812 17:47:46.524955 25080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:46.514215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47240 (local address 127.17.255.61:34441)
0812 17:47:46.514331 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:46.514336 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:46.514522 (+ 186us) server_negotiation.cc:407] Connection header received
0812 17:47:46.514722 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:46.514725 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:46.514785 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:46.514879 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:46.515536 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.516450 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.517673 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.518024 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.518110 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:46.520687 (+ 2577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:46.520691 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:46.520694 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:46.520723 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:46.522565 (+ 1842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:46.523123 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:46.523127 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:46.523129 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:46.523224 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:46.523633 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:46.523637 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:46.523639 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:46.523928 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:46.524009 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:46.524667 (+ 658us) server_negotiation.cc:299] Negotiation successful
0812 17:47:46.524811 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 17:47:46.525013 24958 raft_consensus.cc:729] T 00000000000000000000000000000000 P c31c1a92603445dab36c3900e5aa68be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c31c1a92603445dab36c3900e5aa68be, State: Initialized, Role: FOLLOWER
I20260812 17:47:46.525447 24958 consensus_queue.cc:260] T 00000000000000000000000000000000 P c31c1a92603445dab36c3900e5aa68be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c31c1a92603445dab36c3900e5aa68be" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45447 } } peers { permanent_uuid: "4b566dd0a987465fbcca3337d4692d06" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 34441 } } peers { permanent_uuid: "566ce4966fb9480b81d8db93efc340de" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 35285 } }
I20260812 17:47:46.526294 25200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:46.513969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.61:34441 (local address 127.0.0.1:47240)
0812 17:47:46.514449 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:46.514465 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:46.514597 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:46.515057 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:46.515060 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:46.515263 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:47:46.515375 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:46.515383 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.516618 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.516622 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:46.517520 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:46.517532 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.518276 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.518280 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:46.518406 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:46.518868 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:47:46.518884 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:47:46.520517 (+ 1633us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:47:46.522702 (+ 2185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:46.522705 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:46.522708 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:46.522994 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:46.523407 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:46.523410 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:46.523412 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:46.523511 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:46.524328 (+ 817us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:47:46.524335 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:47:46.524454 (+ 119us) client_negotiation.cc:769] Sending connection context
0812 17:47:46.525975 (+ 1521us) client_negotiation.cc:240] Negotiation successful
0812 17:47:46.526134 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":383}
I20260812 17:47:46.527375 24958 sys_catalog.cc:564] T 00000000000000000000000000000000 P c31c1a92603445dab36c3900e5aa68be [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:47:46.527282 25073 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4b566dd0a987465fbcca3337d4692d06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c31c1a92603445dab36c3900e5aa68be" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45447 } } peers { permanent_uuid: "4b566dd0a987465fbcca3337d4692d06" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 34441 } } peers { permanent_uuid: "566ce4966fb9480b81d8db93efc340de" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 35285 } }
I20260812 17:47:46.527432 25193 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.255.60" port: 35285 } has no permanent_uuid. Determining permanent_uuid...
I20260812 17:47:46.527511 25073 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4b566dd0a987465fbcca3337d4692d06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b566dd0a987465fbcca3337d4692d06, State: Initialized, Role: FOLLOWER
I20260812 17:47:46.527838 25073 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4b566dd0a987465fbcca3337d4692d06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c31c1a92603445dab36c3900e5aa68be" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45447 } } peers { permanent_uuid: "4b566dd0a987465fbcca3337d4692d06" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 34441 } } peers { permanent_uuid: "566ce4966fb9480b81d8db93efc340de" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 35285 } }
I20260812 17:47:46.529292 25073 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4b566dd0a987465fbcca3337d4692d06 [sys.catalog]: configured and running, proceeding with master startup.
Aug 12 17:47:46 dist-test-slave-tk9z krb5kdc[24843](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.255.61@KRBTEST.COM
Aug 12 17:47:46 dist-test-slave-tk9z krb5kdc[24843](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556866, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.60@KRBTEST.COM for kudu/127.17.255.60@KRBTEST.COM
W20260812 17:47:46.534106 25223 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c31c1a92603445dab36c3900e5aa68be: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 17:47:46.534202 25223 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 17:47:46.533561 24858 master_runner.cc:186] Error getting master registration for 127.17.255.61:34441: OK, instance_id { permanent_uuid: "4b566dd0a987465fbcca3337d4692d06" instance_seqno: 1786556866241656 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 17:47:46.537684 24858 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 17:47:46.530095 25206 sys_catalog.cc:455] T 00000000000000000000000000000000 P c31c1a92603445dab36c3900e5aa68be [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c31c1a92603445dab36c3900e5aa68be" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45447 } } peers { permanent_uuid: "4b566dd0a987465fbcca3337d4692d06" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 34441 } } peers { permanent_uuid: "566ce4966fb9480b81d8db93efc340de" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 35285 } } }
I20260812 17:47:46.537760 25206 sys_catalog.cc:458] T 00000000000000000000000000000000 P c31c1a92603445dab36c3900e5aa68be [sys.catalog]: This master's current role is: FOLLOWER
I20260812 17:47:46.538874 25201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:46.528260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39634 (local address 127.17.255.60:35285)
0812 17:47:46.528377 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:46.528382 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:46.528479 (+ 97us) server_negotiation.cc:407] Connection header received
0812 17:47:46.528655 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:46.528660 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:46.528712 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:46.528762 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:46.529365 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.530218 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.531518 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.531890 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.531976 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:46.534790 (+ 2814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:46.534797 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:46.534802 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:46.534831 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:46.536656 (+ 1825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:46.537186 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:46.537189 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:46.537191 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:46.537270 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:46.537570 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:46.537574 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:46.537575 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:46.537825 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:46.537908 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:46.538533 (+ 625us) server_negotiation.cc:299] Negotiation successful
0812 17:47:46.538682 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 17:47:46.539633 25200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:46.527943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:35285 (local address 127.0.0.1:39634)
0812 17:47:46.528399 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:46.528418 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:46.528549 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:46.528919 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:46.528922 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:46.529108 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:47:46.529216 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:46.529228 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.530516 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.530521 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:46.531379 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:46.531393 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.532200 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.532204 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:46.532288 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:46.532828 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:47:46.532844 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:47:46.534622 (+ 1778us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:47:46.536803 (+ 2181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:46.536806 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:46.536809 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:46.537075 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:46.537379 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:46.537381 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:46.537383 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:46.537470 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:46.538191 (+ 721us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:47:46.538194 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:47:46.538307 (+ 113us) client_negotiation.cc:769] Sending connection context
0812 17:47:46.539314 (+ 1007us) client_negotiation.cc:240] Negotiation successful
0812 17:47:46.539474 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":371}
I20260812 17:47:46.539037 25080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:46.525306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47256 (local address 127.17.255.61:34441)
0812 17:47:46.525561 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:46.525565 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:46.525579 (+ 14us) server_negotiation.cc:407] Connection header received
0812 17:47:46.525619 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:46.525622 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:46.525665 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:46.525763 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:46.526570 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.527310 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.528575 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.528879 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.528958 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:46.532156 (+ 3198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:46.532160 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:46.532163 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:46.532192 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:46.534774 (+ 2582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:46.535908 (+ 1134us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:46.535912 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:46.535914 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:46.536010 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:46.536355 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:46.536359 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:46.536360 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:46.538048 (+ 1688us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:46.538255 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:46.538752 (+ 497us) server_negotiation.cc:299] Negotiation successful
0812 17:47:46.538889 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1442,"server-negotiator.queue_time_us":184}
W20260812 17:47:46.543542 25245 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4b566dd0a987465fbcca3337d4692d06: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260812 17:47:46.543591 25193 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 566ce4966fb9480b81d8db93efc340de: Bootstrap starting.
W20260812 17:47:46.543630 25245 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 17:47:46.543998 25207 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b566dd0a987465fbcca3337d4692d06 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c31c1a92603445dab36c3900e5aa68be" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45447 } } peers { permanent_uuid: "4b566dd0a987465fbcca3337d4692d06" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 34441 } } peers { permanent_uuid: "566ce4966fb9480b81d8db93efc340de" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 35285 } } }
I20260812 17:47:46.544126 25207 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b566dd0a987465fbcca3337d4692d06 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 17:47:46.546739 25193 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 566ce4966fb9480b81d8db93efc340de: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:46.547276 18428 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 17:47:46.547734 25193 log.cc:824] T 00000000000000000000000000000000 P 566ce4966fb9480b81d8db93efc340de: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:46.550604 25193 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 566ce4966fb9480b81d8db93efc340de: No bootstrap required, opened a new log
I20260812 17:47:46.548507 24969 master_runner.cc:186] Error getting master registration for 127.17.255.60:35285: OK, instance_id { permanent_uuid: "566ce4966fb9480b81d8db93efc340de" instance_seqno: 1786556866483071 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 17:47:46.552101 24969 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 17:47:46.552703 24919 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "c31c1a92603445dab36c3900e5aa68be"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56680
I20260812 17:47:46.553082 24919 raft_consensus.cc:482] T 00000000000000000000000000000000 P c31c1a92603445dab36c3900e5aa68be [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 17:47:46.553224 24919 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c31c1a92603445dab36c3900e5aa68be [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:46.554767 24919 raft_consensus.cc:504] T 00000000000000000000000000000000 P c31c1a92603445dab36c3900e5aa68be [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c31c1a92603445dab36c3900e5aa68be" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45447 } } peers { permanent_uuid: "4b566dd0a987465fbcca3337d4692d06" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 34441 } } peers { permanent_uuid: "566ce4966fb9480b81d8db93efc340de" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 35285 } }
I20260812 17:47:46.556708 25193 raft_consensus.cc:348] T 00000000000000000000000000000000 P 566ce4966fb9480b81d8db93efc340de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c31c1a92603445dab36c3900e5aa68be" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45447 } } peers { permanent_uuid: "4b566dd0a987465fbcca3337d4692d06" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 34441 } } peers { permanent_uuid: "566ce4966fb9480b81d8db93efc340de" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 35285 } }
I20260812 17:47:46.556816 25028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c31c1a92603445dab36c3900e5aa68be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "4b566dd0a987465fbcca3337d4692d06"
I20260812 17:47:46.557080 25193 raft_consensus.cc:729] T 00000000000000000000000000000000 P 566ce4966fb9480b81d8db93efc340de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 566ce4966fb9480b81d8db93efc340de, State: Initialized, Role: FOLLOWER
I20260812 17:47:46.557112 25028 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4b566dd0a987465fbcca3337d4692d06 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:46.557565 25193 consensus_queue.cc:260] T 00000000000000000000000000000000 P 566ce4966fb9480b81d8db93efc340de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c31c1a92603445dab36c3900e5aa68be" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45447 } } peers { permanent_uuid: "4b566dd0a987465fbcca3337d4692d06" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 34441 } } peers { permanent_uuid: "566ce4966fb9480b81d8db93efc340de" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 35285 } }
I20260812 17:47:46.558563 25028 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4b566dd0a987465fbcca3337d4692d06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c31c1a92603445dab36c3900e5aa68be in term 1.
I20260812 17:47:46.559121 24886 leader_election.cc:302] T 00000000000000000000000000000000 P c31c1a92603445dab36c3900e5aa68be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b566dd0a987465fbcca3337d4692d06, c31c1a92603445dab36c3900e5aa68be; no voters:
I20260812 17:47:46.559422 25206 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c31c1a92603445dab36c3900e5aa68be [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:47:46.559446 25193 sys_catalog.cc:564] T 00000000000000000000000000000000 P 566ce4966fb9480b81d8db93efc340de [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:47:46.559707 25206 raft_consensus.cc:686] T 00000000000000000000000000000000 P c31c1a92603445dab36c3900e5aa68be [term 1 LEADER]: Becoming Leader. State: Replica: c31c1a92603445dab36c3900e5aa68be, State: Running, Role: LEADER
I20260812 17:47:46.559902 24919 leader_election.cc:288] T 00000000000000000000000000000000 P c31c1a92603445dab36c3900e5aa68be [CANDIDATE]: Term 1 election: Requested vote from peers 4b566dd0a987465fbcca3337d4692d06 (127.17.255.61:34441), 566ce4966fb9480b81d8db93efc340de (127.17.255.60:35285)
I20260812 17:47:46.560089 25206 consensus_queue.cc:237] T 00000000000000000000000000000000 P c31c1a92603445dab36c3900e5aa68be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c31c1a92603445dab36c3900e5aa68be" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45447 } } peers { permanent_uuid: "4b566dd0a987465fbcca3337d4692d06" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 34441 } } peers { permanent_uuid: "566ce4966fb9480b81d8db93efc340de" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 35285 } }
I20260812 17:47:46.560099 25154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c31c1a92603445dab36c3900e5aa68be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "566ce4966fb9480b81d8db93efc340de"
I20260812 17:47:46.560322 25154 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 566ce4966fb9480b81d8db93efc340de [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:46.561697 25154 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 566ce4966fb9480b81d8db93efc340de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c31c1a92603445dab36c3900e5aa68be in term 1.
I20260812 17:47:46.562093 25206 sys_catalog.cc:455] T 00000000000000000000000000000000 P c31c1a92603445dab36c3900e5aa68be [sys.catalog]: SysCatalogTable state changed. Reason: New leader c31c1a92603445dab36c3900e5aa68be. Latest consensus state: current_term: 1 leader_uuid: "c31c1a92603445dab36c3900e5aa68be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c31c1a92603445dab36c3900e5aa68be" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45447 } } peers { permanent_uuid: "4b566dd0a987465fbcca3337d4692d06" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 34441 } } peers { permanent_uuid: "566ce4966fb9480b81d8db93efc340de" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 35285 } } }
I20260812 17:47:46.562227 25206 sys_catalog.cc:458] T 00000000000000000000000000000000 P c31c1a92603445dab36c3900e5aa68be [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:46.562633 25259 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:47:46.563670 25259 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:47:46.564692 25249 sys_catalog.cc:455] T 00000000000000000000000000000000 P 566ce4966fb9480b81d8db93efc340de [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c31c1a92603445dab36c3900e5aa68be" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45447 } } peers { permanent_uuid: "4b566dd0a987465fbcca3337d4692d06" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 34441 } } peers { permanent_uuid: "566ce4966fb9480b81d8db93efc340de" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 35285 } } }
I20260812 17:47:46.566629 25249 sys_catalog.cc:458] T 00000000000000000000000000000000 P 566ce4966fb9480b81d8db93efc340de [sys.catalog]: This master's current role is: FOLLOWER
W20260812 17:47:46.568635 25274 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 566ce4966fb9480b81d8db93efc340de: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 17:47:46.570415 25274 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 17:47:46.593189 24963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:46.572778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56690 (local address 127.17.255.62:45447)
0812 17:47:46.572884 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:46.572889 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:46.574305 (+ 1416us) server_negotiation.cc:407] Connection header received
0812 17:47:46.574535 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:46.574539 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:46.574589 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:46.574640 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:46.577075 (+ 2435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.577869 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.580993 (+ 3124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.581337 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.581412 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:46.585621 (+ 4209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:46.585625 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:46.585628 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:46.585684 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:46.587481 (+ 1797us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:46.590686 (+ 3205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:46.590690 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:46.590692 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:46.590785 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:46.591340 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:46.591343 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:46.591345 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:46.591576 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:46.591705 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:46.592867 (+ 1162us) server_negotiation.cc:299] Negotiation successful
0812 17:47:46.593014 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 17:47:46.594996 25154 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 566ce4966fb9480b81d8db93efc340de [term 1 FOLLOWER]: Refusing update from remote peer c31c1a92603445dab36c3900e5aa68be: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:47:46.595096 25080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:46.572367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47264 (local address 127.17.255.61:34441)
0812 17:47:46.572501 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:46.572508 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:46.575835 (+ 3327us) server_negotiation.cc:407] Connection header received
0812 17:47:46.576018 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:46.576021 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:46.576067 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:46.576117 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:46.579130 (+ 3013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.579839 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.582148 (+ 2309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.582527 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.582608 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:46.588366 (+ 5758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:46.588371 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:46.588374 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:46.588406 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:46.590088 (+ 1682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:46.591118 (+ 1030us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:46.591122 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:46.591124 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:46.591215 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:46.592204 (+ 989us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:46.592208 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:46.592210 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:46.592427 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:46.592533 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:46.594789 (+ 2256us) server_negotiation.cc:299] Negotiation successful
0812 17:47:46.594924 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 17:47:46.596093 25250 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c31c1a92603445dab36c3900e5aa68be [LEADER]: Connected to new peer: Peer: permanent_uuid: "566ce4966fb9480b81d8db93efc340de" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:47:46.601368 25249 sys_catalog.cc:455] T 00000000000000000000000000000000 P 566ce4966fb9480b81d8db93efc340de [sys.catalog]: SysCatalogTable state changed. Reason: New leader c31c1a92603445dab36c3900e5aa68be. Latest consensus state: current_term: 1 leader_uuid: "c31c1a92603445dab36c3900e5aa68be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c31c1a92603445dab36c3900e5aa68be" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45447 } } peers { permanent_uuid: "4b566dd0a987465fbcca3337d4692d06" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 34441 } } peers { permanent_uuid: "566ce4966fb9480b81d8db93efc340de" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 35285 } } }
I20260812 17:47:46.601509 25249 sys_catalog.cc:458] T 00000000000000000000000000000000 P 566ce4966fb9480b81d8db93efc340de [sys.catalog]: This master's current role is: FOLLOWER
I20260812 17:47:46.602684 25028 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4b566dd0a987465fbcca3337d4692d06 [term 1 FOLLOWER]: Refusing update from remote peer c31c1a92603445dab36c3900e5aa68be: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:47:46.603372 25250 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c31c1a92603445dab36c3900e5aa68be [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b566dd0a987465fbcca3337d4692d06" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 34441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:47:46.607970 25207 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b566dd0a987465fbcca3337d4692d06 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c31c1a92603445dab36c3900e5aa68be. Latest consensus state: current_term: 1 leader_uuid: "c31c1a92603445dab36c3900e5aa68be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c31c1a92603445dab36c3900e5aa68be" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45447 } } peers { permanent_uuid: "4b566dd0a987465fbcca3337d4692d06" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 34441 } } peers { permanent_uuid: "566ce4966fb9480b81d8db93efc340de" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 35285 } } }
I20260812 17:47:46.608103 25207 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b566dd0a987465fbcca3337d4692d06 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 17:47:46.614706 25201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:46.573532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39636 (local address 127.17.255.60:35285)
0812 17:47:46.573659 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:46.573664 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:46.587835 (+ 14171us) server_negotiation.cc:407] Connection header received
0812 17:47:46.587928 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:46.587932 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:46.587993 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:46.588095 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:46.591044 (+ 2949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.591954 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.596963 (+ 5009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:46.597355 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:46.597469 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:46.610490 (+ 13021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:46.610495 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:46.610499 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:46.610538 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:46.612617 (+ 2079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:46.613170 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:46.613175 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:46.613177 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:46.613268 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:46.613613 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:46.613616 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:46.613618 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:46.613859 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:46.613991 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:46.614357 (+ 366us) server_negotiation.cc:299] Negotiation successful
0812 17:47:46.614538 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 17:47:46.627044 25206 sys_catalog.cc:455] T 00000000000000000000000000000000 P c31c1a92603445dab36c3900e5aa68be [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c31c1a92603445dab36c3900e5aa68be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c31c1a92603445dab36c3900e5aa68be" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45447 } } peers { permanent_uuid: "4b566dd0a987465fbcca3337d4692d06" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 34441 } } peers { permanent_uuid: "566ce4966fb9480b81d8db93efc340de" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 35285 } } }
I20260812 17:47:46.627188 25206 sys_catalog.cc:458] T 00000000000000000000000000000000 P c31c1a92603445dab36c3900e5aa68be [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:46.627297 25276 mvcc.cc:205] Tried to move back new op lower bound from 7317736925548584960 to 7317736925434007552. Current Snapshot: MvccSnapshot[applied={T|T < 7317736925548584960}]
I20260812 17:47:46.627463 25207 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b566dd0a987465fbcca3337d4692d06 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c31c1a92603445dab36c3900e5aa68be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c31c1a92603445dab36c3900e5aa68be" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45447 } } peers { permanent_uuid: "4b566dd0a987465fbcca3337d4692d06" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 34441 } } peers { permanent_uuid: "566ce4966fb9480b81d8db93efc340de" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 35285 } } }
I20260812 17:47:46.627586 25207 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b566dd0a987465fbcca3337d4692d06 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 17:47:46.628962 25206 sys_catalog.cc:455] T 00000000000000000000000000000000 P c31c1a92603445dab36c3900e5aa68be [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c31c1a92603445dab36c3900e5aa68be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c31c1a92603445dab36c3900e5aa68be" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45447 } } peers { permanent_uuid: "4b566dd0a987465fbcca3337d4692d06" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 34441 } } peers { permanent_uuid: "566ce4966fb9480b81d8db93efc340de" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 35285 } } }
I20260812 17:47:46.629076 25206 sys_catalog.cc:458] T 00000000000000000000000000000000 P c31c1a92603445dab36c3900e5aa68be [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:46.632748 25249 sys_catalog.cc:455] T 00000000000000000000000000000000 P 566ce4966fb9480b81d8db93efc340de [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c31c1a92603445dab36c3900e5aa68be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c31c1a92603445dab36c3900e5aa68be" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 45447 } } peers { permanent_uuid: "4b566dd0a987465fbcca3337d4692d06" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 34441 } } peers { permanent_uuid: "566ce4966fb9480b81d8db93efc340de" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 35285 } } }
I20260812 17:47:46.632866 25249 sys_catalog.cc:458] T 00000000000000000000000000000000 P 566ce4966fb9480b81d8db93efc340de [sys.catalog]: This master's current role is: FOLLOWER
I20260812 17:47:46.633522 25285 mvcc.cc:205] Tried to move back new op lower bound from 7317736925548584960 to 7317736925434007552. Current Snapshot: MvccSnapshot[applied={T|T < 7317736925548584960}]
I20260812 17:47:46.633746 25283 mvcc.cc:205] Tried to move back new op lower bound from 7317736925548584960 to 7317736925434007552. Current Snapshot: MvccSnapshot[applied={T|T < 7317736925548584960}]
I20260812 17:47:46.635181 25259 catalog_manager.cc:1347] Generated new cluster ID: 6dc53f5e7e49482eb3adad78fa628e99
I20260812 17:47:46.635244 25259 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:47:46.649327 25259 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:47:46.650835 25259 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:47:46.665606 25259 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c31c1a92603445dab36c3900e5aa68be: Generated new TSK 0
I20260812 17:47:46.666652 25259 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 17:47:46.700526 25080 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:47:46.698404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47266 (local address 127.17.255.61:34441)
0812 17:47:46.698552 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:46.698557 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:46.699303 (+ 746us) server_negotiation.cc:407] Connection header received
0812 17:47:46.699554 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:46.699558 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:46.699611 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:46.699670 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:46.700375 (+ 705us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47266: BlockingRecv error: recv got EOF from 127.0.0.1:47266 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260812 17:47:46.703346 24963 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:47:46.701482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56696 (local address 127.17.255.62:45447)
0812 17:47:46.701602 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:46.701607 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:46.702321 (+ 714us) server_negotiation.cc:407] Connection header received
0812 17:47:46.702547 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:46.702550 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:46.702609 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:46.702673 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:46.703214 (+ 541us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56696: BlockingRecv error: recv got EOF from 127.0.0.1:56696 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260812 17:47:46.705194 25201 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:47:46.702043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39638 (local address 127.17.255.60:35285)
0812 17:47:46.702158 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:46.702162 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:46.704169 (+ 2007us) server_negotiation.cc:407] Connection header received
0812 17:47:46.704354 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:46.704358 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:46.704423 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:46.704479 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:46.705066 (+ 587us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39638: BlockingRecv error: recv got EOF from 127.0.0.1:39638 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260812 17:47:46.710501 25080 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:47:46.708741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47278 (local address 127.17.255.61:34441)
0812 17:47:46.708853 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:46.708857 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:46.709390 (+ 533us) server_negotiation.cc:407] Connection header received
0812 17:47:46.709648 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:46.709651 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:46.709735 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:46.709795 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:46.710391 (+ 596us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47278: BlockingRecv error: recv got EOF from 127.0.0.1:47278 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260812 17:47:46.715718 25080 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:47:46.714027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47288 (local address 127.17.255.61:34441)
0812 17:47:46.714130 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:46.714134 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:46.714758 (+ 624us) server_negotiation.cc:407] Connection header received
0812 17:47:46.714957 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:46.714960 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:46.715012 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:46.715066 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:46.715610 (+ 544us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47288: BlockingRecv error: recv got EOF from 127.0.0.1:47288 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260812 17:47:46.721850 25080 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:47:46.720031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47298 (local address 127.17.255.61:34441)
0812 17:47:46.720152 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:46.720156 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:46.720777 (+ 621us) server_negotiation.cc:407] Connection header received
0812 17:47:46.721007 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:46.721011 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:46.721069 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:46.721128 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:46.721734 (+ 606us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47298: BlockingRecv error: recv got EOF from 127.0.0.1:47298 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260812 17:47:46.730953 25080 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:47:46.728194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47302 (local address 127.17.255.61:34441)
0812 17:47:46.728338 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:46.728343 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:46.728959 (+ 616us) server_negotiation.cc:407] Connection header received
0812 17:47:46.730093 (+ 1134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:46.730096 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:46.730152 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:46.730205 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:46.730831 (+ 626us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47302: BlockingRecv error: recv got EOF from 127.0.0.1:47302 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
W20260812 17:47:46.743618 25080 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:47:46.741630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47308 (local address 127.17.255.61:34441)
0812 17:47:46.741793 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:46.741801 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:46.742551 (+ 750us) server_negotiation.cc:407] Connection header received
0812 17:47:46.742786 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:46.742790 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:46.742849 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:46.742911 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:46.743493 (+ 582us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47308: BlockingRecv error: recv got EOF from 127.0.0.1:47308 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260812 17:47:46.763689 25080 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:47:46.762273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47316 (local address 127.17.255.61:34441)
0812 17:47:46.762498 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:46.762504 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:46.762657 (+ 153us) server_negotiation.cc:407] Connection header received
0812 17:47:46.762883 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:46.762888 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:46.762949 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:46.763070 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:46.763563 (+ 493us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47316: BlockingRecv error: recv got EOF from 127.0.0.1:47316 (error 108)
Metrics: {"server-negotiator.queue_time_us":122}
W20260812 17:47:46.799600 25080 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:47:46.798288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47330 (local address 127.17.255.61:34441)
0812 17:47:46.798503 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:46.798508 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:46.798744 (+ 236us) server_negotiation.cc:407] Connection header received
0812 17:47:46.798871 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:46.798873 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:46.798927 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:46.799023 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:46.799480 (+ 457us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47330: BlockingRecv error: recv got EOF from 127.0.0.1:47330 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260812 17:47:46.867286 25080 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:47:46.865860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47344 (local address 127.17.255.61:34441)
0812 17:47:46.866053 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:46.866058 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:46.866202 (+ 144us) server_negotiation.cc:407] Connection header received
0812 17:47:46.866460 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:46.866463 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:46.866522 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:46.866627 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:46.867177 (+ 550us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47344: BlockingRecv error: recv got EOF from 127.0.0.1:47344 (error 108)
Metrics: {"server-negotiator.queue_time_us":104}
W20260812 17:47:46.998845 25080 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:47:46.997662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47358 (local address 127.17.255.61:34441)
0812 17:47:46.997826 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:46.997830 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:46.997941 (+ 111us) server_negotiation.cc:407] Connection header received
0812 17:47:46.998073 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:46.998076 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:46.998126 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:46.998214 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:46.998698 (+ 484us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47358: BlockingRecv error: recv got EOF from 127.0.0.1:47358 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
W20260812 17:47:47.258663 25080 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:47:47.257372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47368 (local address 127.17.255.61:34441)
0812 17:47:47.257554 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:47.257559 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:47.257726 (+ 167us) server_negotiation.cc:407] Connection header received
0812 17:47:47.257806 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:47.257809 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:47.257864 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:47.257953 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:47.258547 (+ 594us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47368: BlockingRecv error: recv got EOF from 127.0.0.1:47368 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 17:47:47.545140 25245 catalog_manager.cc:1259] Loaded cluster ID: 6dc53f5e7e49482eb3adad78fa628e99
I20260812 17:47:47.545241 25245 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4b566dd0a987465fbcca3337d4692d06: loading cluster ID for follower catalog manager: success
I20260812 17:47:47.547197 25245 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4b566dd0a987465fbcca3337d4692d06: acquiring CA information for follower catalog manager: success
I20260812 17:47:47.548480 25245 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4b566dd0a987465fbcca3337d4692d06: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 17:47:47.571882 25274 catalog_manager.cc:1259] Loaded cluster ID: 6dc53f5e7e49482eb3adad78fa628e99
I20260812 17:47:47.571988 25274 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 566ce4966fb9480b81d8db93efc340de: loading cluster ID for follower catalog manager: success
I20260812 17:47:47.573769 25274 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 566ce4966fb9480b81d8db93efc340de: acquiring CA information for follower catalog manager: success
I20260812 17:47:47.575028 25274 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 566ce4966fb9480b81d8db93efc340de: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 17:47:47.777473 25388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:47.773086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47384 (local address 127.17.255.61:34441)
0812 17:47:47.773385 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:47.773392 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:47.773520 (+ 128us) server_negotiation.cc:407] Connection header received
0812 17:47:47.773735 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:47.773739 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:47.773913 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:47.774048 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:47:47.774345 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:47.774915 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:47.775844 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:47.776084 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:47.776200 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:47.776557 (+ 357us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:47:47.777027 (+ 470us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:47:47.777172 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:47.777237 (+ 65us) server_negotiation.cc:299] Negotiation successful
0812 17:47:47.777301 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":210,"thread_start_us":81,"threads_started":1}
I20260812 17:47:47.784992 25395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:47.781038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39640 (local address 127.17.255.60:35285)
0812 17:47:47.781311 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:47.781315 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:47.781330 (+ 15us) server_negotiation.cc:407] Connection header received
0812 17:47:47.781583 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:47.781586 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:47.781712 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:47.781845 (+ 133us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:47:47.782090 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:47.782625 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:47.783491 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:47.783722 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:47.783836 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:47.784151 (+ 315us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:47:47.784582 (+ 431us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:47:47.784723 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:47.784765 (+ 42us) server_negotiation.cc:299] Negotiation successful
0812 17:47:47.784819 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":70,"threads_started":1}
I20260812 17:47:47.792564 25388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:47.788397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47388 (local address 127.17.255.61:34441)
0812 17:47:47.788549 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:47.788576 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:47.788849 (+ 273us) server_negotiation.cc:407] Connection header received
0812 17:47:47.789041 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:47.789044 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:47.789099 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:47.789186 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:47:47.789449 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:47.790137 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:47.791243 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:47.791517 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:47.791650 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:47.792045 (+ 395us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:47:47.792141 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:47:47.792220 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:47.792342 (+ 122us) server_negotiation.cc:299] Negotiation successful
0812 17:47:47.792402 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 17:47:47.793375 25395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:47.788774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39652 (local address 127.17.255.60:35285)
0812 17:47:47.788916 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:47.788922 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:47.789245 (+ 323us) server_negotiation.cc:407] Connection header received
0812 17:47:47.789433 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:47.789439 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:47.789499 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:47.789571 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:47:47.789953 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:47.790611 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:47.792080 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:47.792466 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:47.792587 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:47.792873 (+ 286us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:47:47.792954 (+ 81us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:47:47.793013 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:47.793170 (+ 157us) server_negotiation.cc:299] Negotiation successful
0812 17:47:47.793223 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 17:47:47.794479 25407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:47.788451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56698 (local address 127.17.255.62:45447)
0812 17:47:47.788731 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:47.788736 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:47.788999 (+ 263us) server_negotiation.cc:407] Connection header received
0812 17:47:47.789110 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:47.789114 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:47.789325 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:47.789498 (+ 173us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:47:47.789682 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:47.790568 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:47.792681 (+ 2113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:47.793059 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:47.793167 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:47.793647 (+ 480us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:47:47.793997 (+ 350us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:47:47.794123 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:47.794216 (+ 93us) server_negotiation.cc:299] Negotiation successful
0812 17:47:47.794280 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":95,"threads_started":1}
I20260812 17:47:47.797969 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 24858
I20260812 17:47:47.821532 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 24969
I20260812 17:47:47.837095 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 25088
2026-08-12T17:47:47Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3484 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 17:47:47 dist-test-slave-tk9z krb5kdc[25414](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 17:47:47 dist-test-slave-tk9z krb5kdc[25414](info): set up 2 sockets
Aug 12 17:47:47 dist-test-slave-tk9z krb5kdc[25414](info): commencing operation
krb5kdc: starting...
W20260812 17:47:49.150492 18428 mini_kdc.cc:121] Time spent starting KDC: real 1.283s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/krb5kdc/test-user.keytab.
Aug 12 17:47:49 dist-test-slave-tk9z krb5kdc[25414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556869, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T17:47:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T17:47:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.255.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
Entry for principal kudu/127.17.255.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab.
I20260812 17:47:49.289863 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:36563
--webserver_interface=127.17.255.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:40807
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:36563,127.17.255.61:46095,127.17.255.60:46675
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 17:47:49.407620 25435 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 17:47:49.407935 25435 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:49.407959 25435 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:49.408006 25435 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:49.412029 25435 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:47:49.412094 25435 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:49.412113 25435 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:49.412130 25435 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:47:49.412145 25435 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:47:49.417630 25435 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:40807
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:36563,127.17.255.61:46095,127.17.255.60:46675
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.62.keytab
--principal=kudu/127.17.255.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.62:36563
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.255.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25435
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:49.418872 25435 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:49.419961 25435 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:49.429795 25446 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:49.429795 25444 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:49.429939 25435 server_base.cc:1034] running on GCE node
W20260812 17:47:49.429795 25443 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:49.430835 25435 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:49.432081 25435 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:49.433259 25435 hybrid_clock.cc:648] HybridClock initialized: now 1786556869433226 us; error 46 us; skew 500 ppm
Aug 12 17:47:49 dist-test-slave-tk9z krb5kdc[25414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556869, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:47:49.440313 25435 init.cc:377] Logged in from keytab as kudu/127.17.255.62@KRBTEST.COM (short username kudu)
I20260812 17:47:49.441529 25435 webserver.cc:460] Webserver started at http://127.17.255.62:46681/ using document root <none> and password file <none>
I20260812 17:47:49.442229 25435 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:49.442312 25435 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:49.442639 25435 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:49.445127 25435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-0/data/instance:
uuid: "a0ceb8cf60b048649bd8f8a12077314b"
format_stamp: "Formatted at 2026-08-12 17:47:49 on dist-test-slave-tk9z"
server_key: "a1ebdadd2c07cfa7a226beffd1457822"
server_key_iv: "09be426b5ad852b28b6e2ff7f65a8ae0"
server_key_version: "encryptionkey@0"
I20260812 17:47:49.445842 25435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-0/wal/instance:
uuid: "a0ceb8cf60b048649bd8f8a12077314b"
format_stamp: "Formatted at 2026-08-12 17:47:49 on dist-test-slave-tk9z"
server_key: "a1ebdadd2c07cfa7a226beffd1457822"
server_key_iv: "09be426b5ad852b28b6e2ff7f65a8ae0"
server_key_version: "encryptionkey@0"
I20260812 17:47:49.450628 25435 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.001s
I20260812 17:47:49.454190 25455 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:49.456512 25435 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 17:47:49.456722 25435 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-0/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-0/wal
uuid: "a0ceb8cf60b048649bd8f8a12077314b"
format_stamp: "Formatted at 2026-08-12 17:47:49 on dist-test-slave-tk9z"
server_key: "a1ebdadd2c07cfa7a226beffd1457822"
server_key_iv: "09be426b5ad852b28b6e2ff7f65a8ae0"
server_key_version: "encryptionkey@0"
I20260812 17:47:49.456907 25435 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:49.476284 25435 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:49.479508 25435 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:49.479728 25435 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:49.487227 25435 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.62:36563
I20260812 17:47:49.487620 25537 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.62:36563 every 8 connection(s)
I20260812 17:47:49.488332 25435 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-0/data/info.pb
I20260812 17:47:49.491608 25539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:49.495882 25539 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.255.62" port: 36563 } has no permanent_uuid. Determining permanent_uuid...
I20260812 17:47:49.497771 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 25435
I20260812 17:47:49.497925 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-0/wal/instance
I20260812 17:47:49.498284 18428 external_mini_cluster.cc:1428] Setting key 8bc1f0f7062de58d880c94d5fb6f5208
Aug 12 17:47:49 dist-test-slave-tk9z krb5kdc[25414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556869, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.255.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.61@KRBTEST.COM" created.
I20260812 17:47:49.514658 25544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:49.498526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47720 (local address 127.17.255.62:36563)
0812 17:47:49.499162 (+ 636us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:49.499178 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:49.499263 (+ 85us) server_negotiation.cc:407] Connection header received
0812 17:47:49.500510 (+ 1247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:49.500515 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:49.500726 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:49.500906 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:49.502205 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:49.503293 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:49.505161 (+ 1868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:49.505570 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:49.505719 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:49.508933 (+ 3214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:49.508940 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:49.508953 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:49.508977 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:49.510817 (+ 1840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:49.511425 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:49.511435 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:49.511437 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:49.511546 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:49.512087 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:49.512093 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:49.512098 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:49.512593 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:49.512756 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:49.513140 (+ 384us) server_negotiation.cc:299] Negotiation successful
0812 17:47:49.513415 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":484,"thread_start_us":184,"threads_started":1}
I20260812 17:47:49.514658 25543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:49.498526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:36563 (local address 127.0.0.1:47720)
0812 17:47:49.499094 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:49.499153 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:49.500122 (+ 969us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:49.500975 (+ 853us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:49.500984 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:49.501551 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:47:49.502009 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:49.502035 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:49.503465 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:49.503472 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:49.504992 (+ 1520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:49.505009 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:49.505784 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:49.505794 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:49.505980 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:49.506753 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:47:49.506789 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:47:49.508726 (+ 1937us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:47:49.510950 (+ 2224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:49.510996 (+ 46us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:49.511015 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:49.511279 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:49.511744 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:49.511748 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:49.511753 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:49.511948 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:49.512721 (+ 773us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:47:49.512728 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:47:49.512880 (+ 152us) client_negotiation.cc:769] Sending connection context
0812 17:47:49.513061 (+ 181us) client_negotiation.cc:240] Negotiation successful
0812 17:47:49.513500 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"mutex_wait_us":115,"thread_start_us":122,"threads_started":1}
I20260812 17:47:49.518028 25539 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.255.61" port: 46095 } has no permanent_uuid. Determining permanent_uuid...
I20260812 17:47:49.519079 25543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:49.518659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.61:46095 (local address 127.0.0.1:38448)
0812 17:47:49.518846 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:49.518959 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.61:46095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260812 17:47:49.519325 25459 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.255.61:46095: connect: Connection refused (error 111)
I20260812 17:47:49.520325 25543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:49.520010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.61:46095 (local address 127.0.0.1:38454)
0812 17:47:49.520156 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:49.520227 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.61:46095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260812 17:47:49.520484 25539 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.255.61:46095: Network error: Client connection negotiation failed: client connection to 127.17.255.61:46095: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.61.keytab.
Entry for principal kudu/127.17.255.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.61.keytab.
I20260812 17:47:49.531503 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.61:46095
--webserver_interface=127.17.255.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.61.keytab
--principal=kudu/127.17.255.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:40807
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:36563,127.17.255.61:46095,127.17.255.60:46675
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 17:47:49.569802 25539 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.255.61" port: 46095 } attempt: 1
I20260812 17:47:49.570904 25543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:49.570532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.61:46095 (local address 127.0.0.1:38462)
0812 17:47:49.570711 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:49.570792 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.61:46095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260812 17:47:49.571736 25543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:49.571501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.61:46095 (local address 127.0.0.1:38474)
0812 17:47:49.571615 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:49.571669 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.61:46095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260812 17:47:49.571954 25539 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.255.61:46095: Network error: Client connection negotiation failed: client connection to 127.17.255.61:46095: connect: Connection refused (error 111)
I20260812 17:47:49.640167 25539 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.255.61" port: 46095 } attempt: 2
I20260812 17:47:49.641217 25543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:49.640839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.61:46095 (local address 127.0.0.1:38490)
0812 17:47:49.641033 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:49.641117 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.61:46095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260812 17:47:49.642131 25543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:49.641872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.61:46095 (local address 127.0.0.1:38492)
0812 17:47:49.641998 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:49.642061 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.61:46095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260812 17:47:49.642321 25539 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.255.61:46095: Network error: Client connection negotiation failed: client connection to 127.17.255.61:46095: connect: Connection refused (error 111)
W20260812 17:47:49.654721 25548 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 17:47:49.655025 25548 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:49.655076 25548 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:49.655172 25548 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:49.659322 25548 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:47:49.659379 25548 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:49.659397 25548 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:49.659415 25548 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:47:49.659467 25548 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:47:49.665006 25548 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:40807
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:36563,127.17.255.61:46095,127.17.255.60:46675
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.61.keytab
--principal=kudu/127.17.255.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.61:46095
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.17.255.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25548
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:49.666193 25548 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:49.667368 25548 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:49.677160 25553 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:49.677222 25556 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:49.677160 25554 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:49.677438 25548 server_base.cc:1034] running on GCE node
I20260812 17:47:49.678176 25548 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:49.679473 25548 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:49.680660 25548 hybrid_clock.cc:648] HybridClock initialized: now 1786556869680643 us; error 32 us; skew 500 ppm
Aug 12 17:47:49 dist-test-slave-tk9z krb5kdc[25414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556869, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:47:49.683723 25548 init.cc:377] Logged in from keytab as kudu/127.17.255.61@KRBTEST.COM (short username kudu)
I20260812 17:47:49.684643 25548 webserver.cc:460] Webserver started at http://127.17.255.61:34779/ using document root <none> and password file <none>
I20260812 17:47:49.685214 25548 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:49.685277 25548 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:49.685463 25548 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:49.687644 25548 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-1/data/instance:
uuid: "b35d2da37dfa4479b3e2cd365e6b580e"
format_stamp: "Formatted at 2026-08-12 17:47:49 on dist-test-slave-tk9z"
server_key: "217d5a83b235d79193af6742659bac2d"
server_key_iv: "410a9cd4c64ccecd46a8ef46e0402b6c"
server_key_version: "encryptionkey@0"
I20260812 17:47:49.688174 25548 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-1/wal/instance:
uuid: "b35d2da37dfa4479b3e2cd365e6b580e"
format_stamp: "Formatted at 2026-08-12 17:47:49 on dist-test-slave-tk9z"
server_key: "217d5a83b235d79193af6742659bac2d"
server_key_iv: "410a9cd4c64ccecd46a8ef46e0402b6c"
server_key_version: "encryptionkey@0"
I20260812 17:47:49.692001 25548 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 17:47:49.694561 25569 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:49.695904 25548 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 17:47:49.696048 25548 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-1/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-1/wal
uuid: "b35d2da37dfa4479b3e2cd365e6b580e"
format_stamp: "Formatted at 2026-08-12 17:47:49 on dist-test-slave-tk9z"
server_key: "217d5a83b235d79193af6742659bac2d"
server_key_iv: "410a9cd4c64ccecd46a8ef46e0402b6c"
server_key_version: "encryptionkey@0"
I20260812 17:47:49.696167 25548 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:49.724282 25548 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:49.727792 25548 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:49.728034 25548 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:49.733516 25539 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.255.61" port: 46095 } attempt: 3
I20260812 17:47:49.734537 25543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:49.734133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.61:46095 (local address 127.0.0.1:38494)
0812 17:47:49.734289 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:49.734422 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.61:46095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260812 17:47:49.735457 25543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:49.735220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.61:46095 (local address 127.0.0.1:38504)
0812 17:47:49.735338 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:49.735392 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.61:46095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260812 17:47:49.735693 25539 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.255.61:46095: Network error: Client connection negotiation failed: client connection to 127.17.255.61:46095: connect: Connection refused (error 111)
I20260812 17:47:49.736414 25548 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.61:46095
I20260812 17:47:49.736738 25656 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.61:46095 every 8 connection(s)
I20260812 17:47:49.737521 25548 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-1/data/info.pb
I20260812 17:47:49.739953 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 25548
I20260812 17:47:49.740114 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-1/wal/instance
I20260812 17:47:49.740422 18428 external_mini_cluster.cc:1428] Setting key 0b5770a9981ffdbbb9854d684fb18607
I20260812 17:47:49.740944 25657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:49.745198 25657 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.255.62" port: 36563 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.17.255.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.255.60@KRBTEST.COM" created.
Aug 12 17:47:49 dist-test-slave-tk9z krb5kdc[25414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556869, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.61@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:47:49.760445 25544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:49.747428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47728 (local address 127.17.255.62:36563)
0812 17:47:49.747724 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:49.747728 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:49.748909 (+ 1181us) server_negotiation.cc:407] Connection header received
0812 17:47:49.749931 (+ 1022us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:49.749935 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:49.750001 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:49.750107 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:49.751505 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:49.752043 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:49.753262 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:49.753509 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:49.753628 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:49.756594 (+ 2966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:49.756600 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:49.756607 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:49.756634 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:49.758176 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:49.758776 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:49.758780 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:49.758782 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:49.758867 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:49.759260 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:49.759263 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:49.759264 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:49.759450 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:49.759562 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:49.760123 (+ 561us) server_negotiation.cc:299] Negotiation successful
0812 17:47:49.760259 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194}
I20260812 17:47:49.761278 25660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:49.748018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:36563 (local address 127.0.0.1:47728)
0812 17:47:49.748727 (+ 709us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:49.748773 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:49.749709 (+ 936us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:49.750310 (+ 601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:49.750318 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:49.750843 (+ 525us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:47:49.751342 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:49.751356 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:49.752177 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:49.752180 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:49.753130 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:49.753140 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:49.753673 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:49.753677 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:49.753905 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:49.754708 (+ 803us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:47:49.754734 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:47:49.756420 (+ 1686us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:47:49.758306 (+ 1886us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:49.758313 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:49.758328 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:49.758665 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:49.758973 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:49.758976 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:49.758979 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:49.759137 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:49.759562 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:47:49.759570 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:47:49.759850 (+ 280us) client_negotiation.cc:769] Sending connection context
0812 17:47:49.760046 (+ 196us) client_negotiation.cc:240] Negotiation successful
0812 17:47:49.760404 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":328,"threads_started":1}
I20260812 17:47:49.763199 25657 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.255.61" port: 46095 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 17:47:49 dist-test-slave-tk9z krb5kdc[25414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556869, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.61@KRBTEST.COM for kudu/127.17.255.61@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.255.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.60.keytab.
Entry for principal kudu/127.17.255.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.60.keytab.
I20260812 17:47:49.770550 18428 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
/tmp/dist-test-taskHxSJQV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.60:46675
--webserver_interface=127.17.255.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.60.keytab
--principal=kudu/127.17.255.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.255.20:40807
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.255.62:36563,127.17.255.61:46095,127.17.255.60:46675
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 17:47:49.773201 25660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:49.763971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.61:46095 (local address 127.0.0.1:38512)
0812 17:47:49.764107 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:49.764119 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:49.764192 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:49.764735 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:49.764738 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:49.764933 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:47:49.765012 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:49.765017 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:49.765986 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:49.765990 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:49.766640 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:49.766649 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:49.767263 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:49.767266 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:49.767357 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:49.767875 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:47:49.767892 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:47:49.769183 (+ 1291us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:47:49.771367 (+ 2184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:49.771374 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:49.771379 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:49.771669 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:49.771989 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:49.771995 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:49.772000 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:49.772107 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:49.772762 (+ 655us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:47:49.772765 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:47:49.772853 (+ 88us) client_negotiation.cc:769] Sending connection context
0812 17:47:49.772940 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 17:47:49.773067 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260812 17:47:49.773577 25662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:49.764030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38512 (local address 127.17.255.61:46095)
0812 17:47:49.764393 (+ 363us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:49.764403 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:49.764421 (+ 18us) server_negotiation.cc:407] Connection header received
0812 17:47:49.764455 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:49.764460 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:49.764616 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:49.764761 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:49.765121 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:49.765854 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:49.766763 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:49.767144 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:49.767263 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:49.769325 (+ 2062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:49.769340 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:49.769355 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:49.769377 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:49.771245 (+ 1868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:49.771798 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:49.771803 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:49.771804 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:49.771899 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:49.772226 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:49.772231 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:49.772233 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:49.772643 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:49.772800 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:49.773081 (+ 281us) server_negotiation.cc:299] Negotiation successful
0812 17:47:49.773272 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":154,"threads_started":1}
I20260812 17:47:49.775671 25657 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.255.60" port: 46675 } has no permanent_uuid. Determining permanent_uuid...
I20260812 17:47:49.776492 25660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:49.776233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:46675 (local address 127.0.0.1:42914)
0812 17:47:49.776356 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:49.776427 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.60:46675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260812 17:47:49.776697 25574 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.255.60:46675: connect: Connection refused (error 111)
I20260812 17:47:49.777649 25660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:49.777429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:46675 (local address 127.0.0.1:42918)
0812 17:47:49.777545 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:49.777592 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.60:46675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260812 17:47:49.777812 25657 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.255.60:46675: Network error: Client connection negotiation failed: client connection to 127.17.255.60:46675: connect: Connection refused (error 111)
I20260812 17:47:49.827052 25657 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.255.60" port: 46675 } attempt: 1
I20260812 17:47:49.828037 25660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:49.827705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:46675 (local address 127.0.0.1:42928)
0812 17:47:49.827883 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:49.827950 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.60:46675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260812 17:47:49.828904 25660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:49.828640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:46675 (local address 127.0.0.1:42940)
0812 17:47:49.828780 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:49.828846 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.60:46675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260812 17:47:49.829042 25657 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.255.60:46675: Network error: Client connection negotiation failed: client connection to 127.17.255.60:46675: connect: Connection refused (error 111)
I20260812 17:47:49.878870 25539 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.255.61" port: 46095 } attempt: 4
Aug 12 17:47:49 dist-test-slave-tk9z krb5kdc[25414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556869, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for kudu/127.17.255.61@KRBTEST.COM
I20260812 17:47:49.888576 25543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:49.879492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.61:46095 (local address 127.0.0.1:38522)
0812 17:47:49.879713 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:49.879731 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:49.879867 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:49.880158 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:49.880161 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:49.880362 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:47:49.880479 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:49.880484 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:49.881638 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:49.881644 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:49.882719 (+ 1075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:49.882730 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:49.883233 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:49.883236 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:49.883348 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:49.883904 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:47:49.883918 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:47:49.885200 (+ 1282us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:47:49.887149 (+ 1949us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:49.887151 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:49.887153 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:49.887352 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:49.887643 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:49.887646 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:49.887647 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:49.887723 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:49.888135 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:47:49.888138 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:47:49.888227 (+ 89us) client_negotiation.cc:769] Sending connection context
0812 17:47:49.888312 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 17:47:49.888418 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118}
I20260812 17:47:49.888931 25662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:49.879605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38522 (local address 127.17.255.61:46095)
0812 17:47:49.879738 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:49.879744 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:49.879816 (+ 72us) server_negotiation.cc:407] Connection header received
0812 17:47:49.879990 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:49.879993 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:49.880039 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:49.880131 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:49.880613 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:49.881514 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:49.882851 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:49.883107 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:49.883243 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:49.885402 (+ 2159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:49.885406 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:49.885409 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:49.885440 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:49.887035 (+ 1595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:49.887450 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:49.887454 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:49.887456 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:49.887551 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:49.887811 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:49.887814 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:49.887816 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:49.888041 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:49.888135 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:49.888426 (+ 291us) server_negotiation.cc:299] Negotiation successful
0812 17:47:49.888574 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 17:47:49.889662 25539 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.255.60" port: 46675 } has no permanent_uuid. Determining permanent_uuid...
I20260812 17:47:49.890453 25543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:49.890152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:46675 (local address 127.0.0.1:42956)
0812 17:47:49.890286 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:49.890338 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.60:46675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260812 17:47:49.891419 25543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:49.891241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:46675 (local address 127.0.0.1:42962)
0812 17:47:49.891331 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:49.891375 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.60:46675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260812 17:47:49.891642 25539 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.255.60:46675: Network error: Client connection negotiation failed: client connection to 127.17.255.60:46675: connect: Connection refused (error 111)
W20260812 17:47:49.892277 25664 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 17:47:49.892594 25664 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 17:47:49.892644 25664 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 17:47:49.892714 25664 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 17:47:49.896826 25664 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 17:47:49.896888 25664 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 17:47:49.896908 25664 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 17:47:49.896925 25664 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 17:47:49.896970 25664 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 17:47:49.897210 25657 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.255.60" port: 46675 } attempt: 2
I20260812 17:47:49.897935 25660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:49.897680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:46675 (local address 127.0.0.1:42968)
0812 17:47:49.897809 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:49.897871 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.60:46675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260812 17:47:49.898763 25660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:49.898534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:46675 (local address 127.0.0.1:42970)
0812 17:47:49.898639 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:49.898685 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.60:46675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260812 17:47:49.898887 25657 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.255.60:46675: Network error: Client connection negotiation failed: client connection to 127.17.255.60:46675: connect: Connection refused (error 111)
I20260812 17:47:49.902868 25664 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.255.20:40807
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.17.255.62:36563,127.17.255.61:46095,127.17.255.60:46675
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/krb5kdc/kudu_127.17.255.60.keytab
--principal=kudu/127.17.255.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.255.60:46675
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.17.255.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25664
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 16:58:54 UTC on ccycloud.quasar-ctecla.root.comops.site
build id 4583009
I20260812 17:47:49.904404 25664 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 17:47:49.905961 25664 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 17:47:49.915069 25671 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 17:47:49.915082 25675 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:49.915280 25664 server_base.cc:1034] running on GCE node
W20260812 17:47:49.915057 25673 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 17:47:49.915968 25664 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 17:47:49.917120 25664 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 17:47:49.918316 25664 hybrid_clock.cc:648] HybridClock initialized: now 1786556869918301 us; error 30 us; skew 500 ppm
Aug 12 17:47:49 dist-test-slave-tk9z krb5kdc[25414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556869, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 17:47:49.921088 25664 init.cc:377] Logged in from keytab as kudu/127.17.255.60@KRBTEST.COM (short username kudu)
I20260812 17:47:49.922070 25664 webserver.cc:460] Webserver started at http://127.17.255.60:44951/ using document root <none> and password file <none>
I20260812 17:47:49.922726 25664 fs_manager.cc:359] Metadata directory not provided
I20260812 17:47:49.922819 25664 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 17:47:49.923062 25664 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 17:47:49.925153 25664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-2/data/instance:
uuid: "8e50a0e72a3b437da440d01405224bb1"
format_stamp: "Formatted at 2026-08-12 17:47:49 on dist-test-slave-tk9z"
server_key: "8174351e641983b9cb9f4eb2e73a068e"
server_key_iv: "220d4078f6ae9f5f21969008c8767b58"
server_key_version: "encryptionkey@0"
I20260812 17:47:49.925740 25664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-2/wal/instance:
uuid: "8e50a0e72a3b437da440d01405224bb1"
format_stamp: "Formatted at 2026-08-12 17:47:49 on dist-test-slave-tk9z"
server_key: "8174351e641983b9cb9f4eb2e73a068e"
server_key_iv: "220d4078f6ae9f5f21969008c8767b58"
server_key_version: "encryptionkey@0"
I20260812 17:47:49.929512 25664 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260812 17:47:49.931979 25684 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 17:47:49.933331 25664 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 17:47:49.933499 25664 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-2/data,/tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-2/wal
uuid: "8e50a0e72a3b437da440d01405224bb1"
format_stamp: "Formatted at 2026-08-12 17:47:49 on dist-test-slave-tk9z"
server_key: "8174351e641983b9cb9f4eb2e73a068e"
server_key_iv: "220d4078f6ae9f5f21969008c8767b58"
server_key_version: "encryptionkey@0"
I20260812 17:47:49.933626 25664 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 17:47:49.946256 25664 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 17:47:49.949754 25664 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 17:47:49.949980 25664 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 17:47:49.950846 25539 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.255.60" port: 46675 } attempt: 1
I20260812 17:47:49.951663 25543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:49.951373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:46675 (local address 127.0.0.1:42974)
0812 17:47:49.951516 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:49.951583 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.60:46675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260812 17:47:49.952375 25543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:49.952152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:46675 (local address 127.0.0.1:42976)
0812 17:47:49.952260 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:49.952312 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.255.60:46675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260812 17:47:49.952500 25539 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.255.60:46675: Network error: Client connection negotiation failed: client connection to 127.17.255.60:46675: connect: Connection refused (error 111)
I20260812 17:47:49.957820 25664 rpc_server.cc:307] RPC server started. Bound to: 127.17.255.60:46675
I20260812 17:47:49.958127 25762 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.255.60:46675 every 8 connection(s)
I20260812 17:47:49.959093 25664 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-2/data/info.pb
I20260812 17:47:49.962007 25763 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 17:47:49.966203 25763 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.255.62" port: 36563 } has no permanent_uuid. Determining permanent_uuid...
I20260812 17:47:49.969475 18428 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu as pid 25664
I20260812 17:47:49.969609 18428 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHxSJQV/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786556557564181-18428-0/minicluster-data/master-2/wal/instance
I20260812 17:47:49.969939 18428 external_mini_cluster.cc:1428] Setting key ab5e1f344e33a993e1b56498cd102ca4
Aug 12 17:47:49 dist-test-slave-tk9z krb5kdc[25414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556869, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.60@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
Aug 12 17:47:49 dist-test-slave-tk9z krb5kdc[25414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556869, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.255.60@KRBTEST.COM
I20260812 17:47:49.981575 25544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:49.968302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47744 (local address 127.17.255.62:36563)
0812 17:47:49.968449 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:49.968453 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:49.969419 (+ 966us) server_negotiation.cc:407] Connection header received
0812 17:47:49.970756 (+ 1337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:49.970759 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:49.970819 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:49.970906 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:49.972577 (+ 1671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:49.973077 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:49.974285 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:49.974593 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:49.974673 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:49.977443 (+ 2770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:49.977447 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:49.977449 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:49.977474 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:49.979164 (+ 1690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:49.979830 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:49.979833 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:49.979834 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:49.979919 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:49.980245 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:49.980251 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:49.980256 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:49.980512 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:49.980616 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:49.981243 (+ 627us) server_negotiation.cc:299] Negotiation successful
0812 17:47:49.981375 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 17:47:49.982622 25768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:49.970721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42984 (local address 127.17.255.60:46675)
0812 17:47:49.971007 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:49.971019 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:49.971226 (+ 207us) server_negotiation.cc:407] Connection header received
0812 17:47:49.971301 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:49.971306 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:49.971498 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:49.971684 (+ 186us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:49.972380 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:49.973476 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:49.974462 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:49.974942 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:49.975046 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:49.977854 (+ 2808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:49.977859 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:49.977870 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:49.977891 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:49.979737 (+ 1846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:49.980337 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:49.980342 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:49.980343 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:49.980415 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:49.980716 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:49.980719 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:49.980721 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:49.981030 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:49.981380 (+ 350us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:49.981484 (+ 104us) server_negotiation.cc:299] Negotiation successful
0812 17:47:49.981606 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":48,"server-negotiator.queue_time_us":191,"spinlock_wait_cycles":1280,"thread_start_us":103,"threads_started":1}
I20260812 17:47:49.982630 25765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:49.968673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.62:36563 (local address 127.0.0.1:47744)
0812 17:47:49.969247 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:49.969313 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:49.970526 (+ 1213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:49.971224 (+ 698us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:49.971233 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:49.971750 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:47:49.972423 (+ 673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:49.972437 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:49.973191 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:49.973195 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:49.974163 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:49.974173 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:49.974730 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:49.974734 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:49.974893 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:49.975583 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:47:49.975601 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:47:49.977241 (+ 1640us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:47:49.979276 (+ 2035us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:49.979285 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:49.979295 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:49.979737 (+ 442us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:49.980003 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:49.980005 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:49.980006 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:49.980139 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:49.980653 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:47:49.980688 (+ 35us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:47:49.981010 (+ 322us) client_negotiation.cc:769] Sending connection context
0812 17:47:49.981182 (+ 172us) client_negotiation.cc:240] Negotiation successful
0812 17:47:49.981537 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"mutex_wait_us":36,"spinlock_wait_cycles":2688,"thread_start_us":127,"threads_started":1}
I20260812 17:47:49.984056 25763 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.255.61" port: 46095 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 17:47:49 dist-test-slave-tk9z krb5kdc[25414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556869, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.60@KRBTEST.COM for kudu/127.17.255.61@KRBTEST.COM
I20260812 17:47:49.990047 25657 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.255.60" port: 46675 } attempt: 3
Aug 12 17:47:49 dist-test-slave-tk9z krb5kdc[25414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556869, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.255.62@KRBTEST.COM
I20260812 17:47:49.994912 25662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:49.984933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38538 (local address 127.17.255.61:46095)
0812 17:47:49.985086 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:49.985090 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:49.985104 (+ 14us) server_negotiation.cc:407] Connection header received
0812 17:47:49.985151 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:49.985155 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:49.985202 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:49.985286 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:49.985778 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:49.986565 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:49.987414 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:49.987738 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:49.987855 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:49.990325 (+ 2470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:49.990328 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:49.990331 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:49.990357 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:49.992551 (+ 2194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:49.993101 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:49.993105 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:49.993107 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:49.993199 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:49.993541 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:49.993545 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:49.993547 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:49.993787 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:49.993867 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:49.994280 (+ 413us) server_negotiation.cc:299] Negotiation successful
0812 17:47:49.994723 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 17:47:49.995047 25544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:49.985213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47756 (local address 127.17.255.62:36563)
0812 17:47:49.985354 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:49.985361 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:49.985375 (+ 14us) server_negotiation.cc:407] Connection header received
0812 17:47:49.985421 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:49.985423 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:49.985469 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:49.985553 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:49.986250 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:49.986910 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:49.987858 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:49.988199 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:49.988313 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:49.991279 (+ 2966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:49.991286 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:49.991291 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:49.991322 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:49.992958 (+ 1636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:49.993452 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:49.993459 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:49.993463 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:49.993557 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:49.993886 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:49.993889 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:49.993891 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:49.994098 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:49.994351 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:49.994585 (+ 234us) server_negotiation.cc:299] Negotiation successful
0812 17:47:49.994722 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 17:47:49.995456 25765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:49.984784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.61:46095 (local address 127.0.0.1:38538)
0812 17:47:49.984898 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:49.984914 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:49.985000 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:49.985327 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:49.985329 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:49.985512 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:47:49.985642 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:49.985649 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:49.986670 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:49.986674 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:49.987297 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:49.987305 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:49.987874 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:49.987878 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:49.987989 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:49.988498 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:47:49.988518 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:47:49.990122 (+ 1604us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:47:49.992678 (+ 2556us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:49.992683 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:49.992686 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:49.992962 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:49.993297 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:49.993300 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:49.993302 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:49.993419 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:49.993959 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:47:49.993962 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:47:49.994058 (+ 96us) client_negotiation.cc:769] Sending connection context
0812 17:47:49.995122 (+ 1064us) client_negotiation.cc:240] Negotiation successful
0812 17:47:49.995280 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
Aug 12 17:47:49 dist-test-slave-tk9z krb5kdc[25414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556869, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.61@KRBTEST.COM for kudu/127.17.255.60@KRBTEST.COM
I20260812 17:47:49.996469 25763 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.255.60" port: 46675 } has no permanent_uuid. Determining permanent_uuid...
I20260812 17:47:50.000483 25660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:49.990668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:46675 (local address 127.0.0.1:42986)
0812 17:47:49.990811 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:49.990831 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:49.990919 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:49.991475 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:49.991479 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:49.991654 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:47:49.991738 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:49.991743 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:49.992782 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:49.992786 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:49.993515 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:49.993524 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:49.994005 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:49.994009 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:49.994111 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:49.994646 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:47:49.994667 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:47:49.996307 (+ 1640us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:47:49.998780 (+ 2473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:49.998784 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:49.998787 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:49.999016 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:49.999313 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:49.999319 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:49.999321 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:49.999461 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:49.999924 (+ 463us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:47:49.999928 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:47:50.000039 (+ 111us) client_negotiation.cc:769] Sending connection context
0812 17:47:50.000125 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 17:47:50.000269 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260812 17:47:50.001103 25768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:49.990745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42986 (local address 127.17.255.60:46675)
0812 17:47:49.990892 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:49.990897 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:49.990914 (+ 17us) server_negotiation.cc:407] Connection header received
0812 17:47:49.991305 (+ 391us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:49.991309 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:49.991354 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:49.991452 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:49.991858 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:49.992668 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:49.993628 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:49.993887 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:49.994000 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:49.996817 (+ 2817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:49.996824 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:49.996829 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:49.996864 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:49.998672 (+ 1808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:49.999124 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:49.999128 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:49.999130 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:49.999216 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:49.999544 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:49.999547 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:49.999549 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:49.999760 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:50.000708 (+ 948us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:50.000795 (+ 87us) server_negotiation.cc:299] Negotiation successful
0812 17:47:50.000924 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
Aug 12 17:47:49 dist-test-slave-tk9z krb5kdc[25414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556869, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.255.61@KRBTEST.COM
I20260812 17:47:50.005362 25657 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b35d2da37dfa4479b3e2cd365e6b580e: Bootstrap starting.
I20260812 17:47:50.006054 25662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:49.996305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38550 (local address 127.17.255.61:46095)
0812 17:47:49.996460 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:49.996465 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:49.996478 (+ 13us) server_negotiation.cc:407] Connection header received
0812 17:47:49.996568 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:49.996571 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:49.996611 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:49.996711 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:49.997533 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:49.998335 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:49.999603 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:49.999938 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:50.000418 (+ 480us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:50.003081 (+ 2663us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:50.003084 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:50.003086 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:50.003108 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:50.004401 (+ 1293us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:50.004874 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:50.004876 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:50.004877 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:50.004947 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:50.005231 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:50.005233 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:50.005234 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:50.005396 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:50.005629 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:50.005775 (+ 146us) server_negotiation.cc:299] Negotiation successful
0812 17:47:50.005900 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
Aug 12 17:47:50 dist-test-slave-tk9z krb5kdc[25414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556869, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.60@KRBTEST.COM for kudu/127.17.255.60@KRBTEST.COM
I20260812 17:47:50.008490 25657 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b35d2da37dfa4479b3e2cd365e6b580e: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:50.009514 25657 log.cc:824] T 00000000000000000000000000000000 P b35d2da37dfa4479b3e2cd365e6b580e: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:50.010033 18428 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 17:47:50.011988 25765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:49.996972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:46675 (local address 127.0.0.1:42996)
0812 17:47:49.997151 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:49.997164 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:49.997235 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:49.998083 (+ 848us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:49.998086 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:49.998258 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:47:49.998323 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:49.998328 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:49.999826 (+ 1498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:49.999832 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:50.000353 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:50.000385 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:50.001348 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:50.001351 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:50.001429 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:50.001881 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:47:50.001904 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:47:50.007118 (+ 5214us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:47:50.009252 (+ 2134us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:50.009255 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:50.009257 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:50.009514 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:50.009870 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:50.009876 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:50.009880 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:50.011002 (+ 1122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:50.011443 (+ 441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:47:50.011446 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:47:50.011543 (+ 97us) client_negotiation.cc:769] Sending connection context
0812 17:47:50.011646 (+ 103us) client_negotiation.cc:240] Negotiation successful
0812 17:47:50.011810 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114}
I20260812 17:47:50.012005 25769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:49.997045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42996 (local address 127.17.255.60:46675)
0812 17:47:49.997836 (+ 791us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:49.997847 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:49.997861 (+ 14us) server_negotiation.cc:407] Connection header received
0812 17:47:49.997900 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:49.997906 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:49.997954 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:49.998074 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:49.998484 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:49.999725 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:50.000508 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:50.001109 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:50.001237 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:50.007287 (+ 6050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:50.007291 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:50.007294 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:50.007320 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:50.009135 (+ 1815us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:50.009670 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:50.009674 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:50.009675 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:50.009761 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:50.011105 (+ 1344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:50.011108 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:50.011110 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:50.011339 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:50.011454 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:50.011709 (+ 255us) server_negotiation.cc:299] Negotiation successful
0812 17:47:50.011862 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":39,"server-negotiator.queue_time_us":709,"thread_start_us":225,"threads_started":1}
I20260812 17:47:50.011302 25497 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "a0ceb8cf60b048649bd8f8a12077314b"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47756
I20260812 17:47:50.013381 25657 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b35d2da37dfa4479b3e2cd365e6b580e: No bootstrap required, opened a new log
I20260812 17:47:50.015386 25763 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e50a0e72a3b437da440d01405224bb1: Bootstrap starting.
I20260812 17:47:50.016589 25657 raft_consensus.cc:348] T 00000000000000000000000000000000 P b35d2da37dfa4479b3e2cd365e6b580e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0ceb8cf60b048649bd8f8a12077314b" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 36563 } } peers { permanent_uuid: "b35d2da37dfa4479b3e2cd365e6b580e" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 46095 } } peers { permanent_uuid: "8e50a0e72a3b437da440d01405224bb1" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 46675 } }
I20260812 17:47:50.016779 25657 raft_consensus.cc:729] T 00000000000000000000000000000000 P b35d2da37dfa4479b3e2cd365e6b580e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b35d2da37dfa4479b3e2cd365e6b580e, State: Initialized, Role: FOLLOWER
I20260812 17:47:50.017122 25657 consensus_queue.cc:260] T 00000000000000000000000000000000 P b35d2da37dfa4479b3e2cd365e6b580e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0ceb8cf60b048649bd8f8a12077314b" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 36563 } } peers { permanent_uuid: "b35d2da37dfa4479b3e2cd365e6b580e" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 46095 } } peers { permanent_uuid: "8e50a0e72a3b437da440d01405224bb1" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 46675 } }
I20260812 17:47:50.017625 25772 sys_catalog.cc:455] T 00000000000000000000000000000000 P b35d2da37dfa4479b3e2cd365e6b580e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0ceb8cf60b048649bd8f8a12077314b" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 36563 } } peers { permanent_uuid: "b35d2da37dfa4479b3e2cd365e6b580e" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 46095 } } peers { permanent_uuid: "8e50a0e72a3b437da440d01405224bb1" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 46675 } } }
I20260812 17:47:50.017760 25772 sys_catalog.cc:458] T 00000000000000000000000000000000 P b35d2da37dfa4479b3e2cd365e6b580e [sys.catalog]: This master's current role is: FOLLOWER
I20260812 17:47:50.018265 25763 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8e50a0e72a3b437da440d01405224bb1: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:50.018523 25657 sys_catalog.cc:564] T 00000000000000000000000000000000 P b35d2da37dfa4479b3e2cd365e6b580e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:47:50.019189 25763 log.cc:824] T 00000000000000000000000000000000 P 8e50a0e72a3b437da440d01405224bb1: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:50.019655 25539 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.255.60" port: 46675 } attempt: 2
I20260812 17:47:50.022789 25763 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e50a0e72a3b437da440d01405224bb1: No bootstrap required, opened a new log
W20260812 17:47:50.023903 25789 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b35d2da37dfa4479b3e2cd365e6b580e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 17:47:50.023983 25789 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Aug 12 17:47:50 dist-test-slave-tk9z krb5kdc[25414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786556869, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.255.62@KRBTEST.COM for kudu/127.17.255.60@KRBTEST.COM
I20260812 17:47:50.022840 25548 master_runner.cc:186] Error getting master registration for 127.17.255.62:36563: OK, instance_id { permanent_uuid: "a0ceb8cf60b048649bd8f8a12077314b" instance_seqno: 1786556869485168 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 17:47:50.027169 25763 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8e50a0e72a3b437da440d01405224bb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0ceb8cf60b048649bd8f8a12077314b" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 36563 } } peers { permanent_uuid: "b35d2da37dfa4479b3e2cd365e6b580e" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 46095 } } peers { permanent_uuid: "8e50a0e72a3b437da440d01405224bb1" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 46675 } }
I20260812 17:47:50.027452 25763 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8e50a0e72a3b437da440d01405224bb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e50a0e72a3b437da440d01405224bb1, State: Initialized, Role: FOLLOWER
I20260812 17:47:50.027763 25548 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 17:47:50.027838 25763 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8e50a0e72a3b437da440d01405224bb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0ceb8cf60b048649bd8f8a12077314b" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 36563 } } peers { permanent_uuid: "b35d2da37dfa4479b3e2cd365e6b580e" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 46095 } } peers { permanent_uuid: "8e50a0e72a3b437da440d01405224bb1" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 46675 } }
I20260812 17:47:50.028563 25792 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e50a0e72a3b437da440d01405224bb1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0ceb8cf60b048649bd8f8a12077314b" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 36563 } } peers { permanent_uuid: "b35d2da37dfa4479b3e2cd365e6b580e" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 46095 } } peers { permanent_uuid: "8e50a0e72a3b437da440d01405224bb1" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 46675 } } }
I20260812 17:47:50.028836 25792 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e50a0e72a3b437da440d01405224bb1 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 17:47:50.029428 25763 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8e50a0e72a3b437da440d01405224bb1 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:47:50.030948 25769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:50.020265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43000 (local address 127.17.255.60:46675)
0812 17:47:50.020378 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:50.020385 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:50.020402 (+ 17us) server_negotiation.cc:407] Connection header received
0812 17:47:50.020574 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:50.020577 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:50.020626 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:50.020700 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:50.021300 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:50.022048 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:50.023192 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:50.023563 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:50.023665 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:50.026460 (+ 2795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:50.026464 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:50.026467 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:50.026498 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:50.028342 (+ 1844us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:50.029103 (+ 761us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:50.029107 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:50.029109 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:50.029217 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:50.029522 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:50.029527 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:50.029528 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:50.029828 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:50.029927 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:50.030325 (+ 398us) server_negotiation.cc:299] Negotiation successful
0812 17:47:50.030571 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 17:47:50.033430 25543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:50.020185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.255.60:46675 (local address 127.0.0.1:43000)
0812 17:47:50.020329 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0812 17:47:50.020346 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 17:47:50.020452 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 17:47:50.020804 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 17:47:50.020807 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 17:47:50.021032 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0812 17:47:50.021158 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:50.021165 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:50.022202 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:50.022205 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:50.022995 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 17:47:50.023007 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 17:47:50.023806 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 17:47:50.023810 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 17:47:50.023896 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:50.024489 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 17:47:50.024507 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 17:47:50.026219 (+ 1712us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 17:47:50.028580 (+ 2361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:50.028585 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:50.028589 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:50.028993 (+ 404us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:50.029312 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 17:47:50.029315 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 17:47:50.029317 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 17:47:50.029427 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 17:47:50.029926 (+ 499us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 17:47:50.029929 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 17:47:50.030079 (+ 150us) client_negotiation.cc:769] Sending connection context
0812 17:47:50.030198 (+ 119us) client_negotiation.cc:240] Negotiation successful
0812 17:47:50.033238 (+ 3040us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260812 17:47:50.037021 25539 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0ceb8cf60b048649bd8f8a12077314b: Bootstrap starting.
W20260812 17:47:50.037899 25813 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8e50a0e72a3b437da440d01405224bb1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 17:47:50.038158 25813 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 17:47:50.040127 25539 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a0ceb8cf60b048649bd8f8a12077314b: Neither blocks nor log segments found. Creating new log.
I20260812 17:47:50.041074 25539 log.cc:824] T 00000000000000000000000000000000 P a0ceb8cf60b048649bd8f8a12077314b: Log is configured to *not* fsync() on all Append() calls
I20260812 17:47:50.043406 25539 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0ceb8cf60b048649bd8f8a12077314b: No bootstrap required, opened a new log
I20260812 17:47:50.039968 25664 master_runner.cc:186] Error getting master registration for 127.17.255.62:36563: OK, instance_id { permanent_uuid: "a0ceb8cf60b048649bd8f8a12077314b" instance_seqno: 1786556869485168 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 17:47:50.043618 25664 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 17:47:50.046726 25539 raft_consensus.cc:348] T 00000000000000000000000000000000 P a0ceb8cf60b048649bd8f8a12077314b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0ceb8cf60b048649bd8f8a12077314b" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 36563 } } peers { permanent_uuid: "b35d2da37dfa4479b3e2cd365e6b580e" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 46095 } } peers { permanent_uuid: "8e50a0e72a3b437da440d01405224bb1" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 46675 } }
I20260812 17:47:50.047010 25539 raft_consensus.cc:729] T 00000000000000000000000000000000 P a0ceb8cf60b048649bd8f8a12077314b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0ceb8cf60b048649bd8f8a12077314b, State: Initialized, Role: FOLLOWER
I20260812 17:47:50.047384 25539 consensus_queue.cc:260] T 00000000000000000000000000000000 P a0ceb8cf60b048649bd8f8a12077314b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0ceb8cf60b048649bd8f8a12077314b" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 36563 } } peers { permanent_uuid: "b35d2da37dfa4479b3e2cd365e6b580e" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 46095 } } peers { permanent_uuid: "8e50a0e72a3b437da440d01405224bb1" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 46675 } }
I20260812 17:47:50.047997 25816 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0ceb8cf60b048649bd8f8a12077314b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0ceb8cf60b048649bd8f8a12077314b" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 36563 } } peers { permanent_uuid: "b35d2da37dfa4479b3e2cd365e6b580e" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 46095 } } peers { permanent_uuid: "8e50a0e72a3b437da440d01405224bb1" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 46675 } } }
I20260812 17:47:50.048283 25816 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0ceb8cf60b048649bd8f8a12077314b [sys.catalog]: This master's current role is: FOLLOWER
I20260812 17:47:50.048977 25539 sys_catalog.cc:564] T 00000000000000000000000000000000 P a0ceb8cf60b048649bd8f8a12077314b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 17:47:50.049072 25497 raft_consensus.cc:482] T 00000000000000000000000000000000 P a0ceb8cf60b048649bd8f8a12077314b [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 17:47:50.049167 25497 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a0ceb8cf60b048649bd8f8a12077314b [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:50.050702 25497 raft_consensus.cc:504] T 00000000000000000000000000000000 P a0ceb8cf60b048649bd8f8a12077314b [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0ceb8cf60b048649bd8f8a12077314b" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 36563 } } peers { permanent_uuid: "b35d2da37dfa4479b3e2cd365e6b580e" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 46095 } } peers { permanent_uuid: "8e50a0e72a3b437da440d01405224bb1" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 46675 } }
I20260812 17:47:50.051762 25497 leader_election.cc:288] T 00000000000000000000000000000000 P a0ceb8cf60b048649bd8f8a12077314b [CANDIDATE]: Term 1 election: Requested vote from peers b35d2da37dfa4479b3e2cd365e6b580e (127.17.255.61:46095), 8e50a0e72a3b437da440d01405224bb1 (127.17.255.60:46675)
I20260812 17:47:50.052865 25611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a0ceb8cf60b048649bd8f8a12077314b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b35d2da37dfa4479b3e2cd365e6b580e"
I20260812 17:47:50.053165 25611 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b35d2da37dfa4479b3e2cd365e6b580e [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:50.053644 25723 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a0ceb8cf60b048649bd8f8a12077314b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "8e50a0e72a3b437da440d01405224bb1"
I20260812 17:47:50.053881 25723 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8e50a0e72a3b437da440d01405224bb1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 17:47:50.054778 25611 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b35d2da37dfa4479b3e2cd365e6b580e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0ceb8cf60b048649bd8f8a12077314b in term 1.
I20260812 17:47:50.055346 25723 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8e50a0e72a3b437da440d01405224bb1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0ceb8cf60b048649bd8f8a12077314b in term 1.
I20260812 17:47:50.056111 25460 leader_election.cc:302] T 00000000000000000000000000000000 P a0ceb8cf60b048649bd8f8a12077314b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e50a0e72a3b437da440d01405224bb1, a0ceb8cf60b048649bd8f8a12077314b; no voters:
I20260812 17:47:50.056741 25816 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a0ceb8cf60b048649bd8f8a12077314b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 17:47:50.057386 25816 raft_consensus.cc:686] T 00000000000000000000000000000000 P a0ceb8cf60b048649bd8f8a12077314b [term 1 LEADER]: Becoming Leader. State: Replica: a0ceb8cf60b048649bd8f8a12077314b, State: Running, Role: LEADER
I20260812 17:47:50.057819 25816 consensus_queue.cc:237] T 00000000000000000000000000000000 P a0ceb8cf60b048649bd8f8a12077314b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0ceb8cf60b048649bd8f8a12077314b" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 36563 } } peers { permanent_uuid: "b35d2da37dfa4479b3e2cd365e6b580e" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 46095 } } peers { permanent_uuid: "8e50a0e72a3b437da440d01405224bb1" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 46675 } }
I20260812 17:47:50.059947 25816 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0ceb8cf60b048649bd8f8a12077314b [sys.catalog]: SysCatalogTable state changed. Reason: New leader a0ceb8cf60b048649bd8f8a12077314b. Latest consensus state: current_term: 1 leader_uuid: "a0ceb8cf60b048649bd8f8a12077314b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0ceb8cf60b048649bd8f8a12077314b" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 36563 } } peers { permanent_uuid: "b35d2da37dfa4479b3e2cd365e6b580e" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 46095 } } peers { permanent_uuid: "8e50a0e72a3b437da440d01405224bb1" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 46675 } } }
I20260812 17:47:50.060123 25816 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0ceb8cf60b048649bd8f8a12077314b [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:50.062532 25435 master_runner.cc:263] No leader master found from master a0ceb8cf60b048649bd8f8a12077314b
I20260812 17:47:50.062634 25435 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 17:47:50.063925 25834 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a0ceb8cf60b048649bd8f8a12077314b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 17:47:50.064011 25834 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 17:47:50.075289 25544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:50.064727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47760 (local address 127.17.255.62:36563)
0812 17:47:50.064855 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:50.064863 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:50.065130 (+ 267us) server_negotiation.cc:407] Connection header received
0812 17:47:50.065362 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:50.065365 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:50.065419 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:50.065473 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:50.066587 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:50.067361 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:50.068517 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:50.068842 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:50.068928 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:50.071025 (+ 2097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:50.071031 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:50.071034 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:50.071061 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:50.072970 (+ 1909us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:50.073549 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:50.073552 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:50.073554 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:50.073649 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:50.074163 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:50.074167 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:50.074169 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:50.074480 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:50.074598 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:50.074955 (+ 357us) server_negotiation.cc:299] Negotiation successful
0812 17:47:50.075077 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 17:47:50.083899 25662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:50.065253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38566 (local address 127.17.255.61:46095)
0812 17:47:50.065376 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:50.065380 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:50.071044 (+ 5664us) server_negotiation.cc:407] Connection header received
0812 17:47:50.073282 (+ 2238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:50.073286 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:50.073350 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:50.073411 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:50.076136 (+ 2725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:50.076833 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:50.077652 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:50.077953 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:50.078061 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:50.079945 (+ 1884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:50.079949 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:50.079952 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:50.079983 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:50.081808 (+ 1825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:50.082344 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:50.082348 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:50.082350 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:50.082476 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:50.082803 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:50.082807 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:50.082809 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:50.083045 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:50.083180 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:50.083565 (+ 385us) server_negotiation.cc:299] Negotiation successful
0812 17:47:50.083718 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 17:47:50.088332 25769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:50.070082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43012 (local address 127.17.255.60:46675)
0812 17:47:50.070235 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:50.070240 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:50.071281 (+ 1041us) server_negotiation.cc:407] Connection header received
0812 17:47:50.071945 (+ 664us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:50.071951 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:50.072304 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:50.072373 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:50.074316 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:50.075067 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:50.079149 (+ 4082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:50.079592 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:50.079678 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:50.084199 (+ 4521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 17:47:50.084204 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 17:47:50.084207 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 17:47:50.084238 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 17:47:50.086181 (+ 1943us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:50.086829 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:50.086833 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:50.086834 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:50.086933 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 17:47:50.087260 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 17:47:50.087263 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 17:47:50.087265 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 17:47:50.087513 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 17:47:50.087644 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:50.088014 (+ 370us) server_negotiation.cc:299] Negotiation successful
0812 17:47:50.088145 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 17:47:50.089413 25844 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 17:47:50.090624 25844 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 17:47:50.096429 25611 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b35d2da37dfa4479b3e2cd365e6b580e [term 1 FOLLOWER]: Refusing update from remote peer a0ceb8cf60b048649bd8f8a12077314b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:47:50.096913 25723 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8e50a0e72a3b437da440d01405224bb1 [term 1 FOLLOWER]: Refusing update from remote peer a0ceb8cf60b048649bd8f8a12077314b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 17:47:50.097975 25816 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a0ceb8cf60b048649bd8f8a12077314b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b35d2da37dfa4479b3e2cd365e6b580e" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:47:50.098875 25816 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a0ceb8cf60b048649bd8f8a12077314b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e50a0e72a3b437da440d01405224bb1" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 46675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 17:47:50.102707 25792 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e50a0e72a3b437da440d01405224bb1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a0ceb8cf60b048649bd8f8a12077314b. Latest consensus state: current_term: 1 leader_uuid: "a0ceb8cf60b048649bd8f8a12077314b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0ceb8cf60b048649bd8f8a12077314b" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 36563 } } peers { permanent_uuid: "b35d2da37dfa4479b3e2cd365e6b580e" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 46095 } } peers { permanent_uuid: "8e50a0e72a3b437da440d01405224bb1" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 46675 } } }
I20260812 17:47:50.102859 25792 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e50a0e72a3b437da440d01405224bb1 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 17:47:50.103205 25772 sys_catalog.cc:455] T 00000000000000000000000000000000 P b35d2da37dfa4479b3e2cd365e6b580e [sys.catalog]: SysCatalogTable state changed. Reason: New leader a0ceb8cf60b048649bd8f8a12077314b. Latest consensus state: current_term: 1 leader_uuid: "a0ceb8cf60b048649bd8f8a12077314b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0ceb8cf60b048649bd8f8a12077314b" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 36563 } } peers { permanent_uuid: "b35d2da37dfa4479b3e2cd365e6b580e" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 46095 } } peers { permanent_uuid: "8e50a0e72a3b437da440d01405224bb1" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 46675 } } }
I20260812 17:47:50.103345 25772 sys_catalog.cc:458] T 00000000000000000000000000000000 P b35d2da37dfa4479b3e2cd365e6b580e [sys.catalog]: This master's current role is: FOLLOWER
I20260812 17:47:50.113171 25841 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0ceb8cf60b048649bd8f8a12077314b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a0ceb8cf60b048649bd8f8a12077314b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0ceb8cf60b048649bd8f8a12077314b" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 36563 } } peers { permanent_uuid: "b35d2da37dfa4479b3e2cd365e6b580e" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 46095 } } peers { permanent_uuid: "8e50a0e72a3b437da440d01405224bb1" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 46675 } } }
I20260812 17:47:50.113341 25841 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0ceb8cf60b048649bd8f8a12077314b [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:50.115499 25772 sys_catalog.cc:455] T 00000000000000000000000000000000 P b35d2da37dfa4479b3e2cd365e6b580e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a0ceb8cf60b048649bd8f8a12077314b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0ceb8cf60b048649bd8f8a12077314b" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 36563 } } peers { permanent_uuid: "b35d2da37dfa4479b3e2cd365e6b580e" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 46095 } } peers { permanent_uuid: "8e50a0e72a3b437da440d01405224bb1" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 46675 } } }
I20260812 17:47:50.115626 25772 sys_catalog.cc:458] T 00000000000000000000000000000000 P b35d2da37dfa4479b3e2cd365e6b580e [sys.catalog]: This master's current role is: FOLLOWER
I20260812 17:47:50.115942 25854 mvcc.cc:205] Tried to move back new op lower bound from 7317736939905937408 to 7317736939761356800. Current Snapshot: MvccSnapshot[applied={T|T < 7317736939905937408}]
I20260812 17:47:50.116636 25841 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0ceb8cf60b048649bd8f8a12077314b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a0ceb8cf60b048649bd8f8a12077314b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0ceb8cf60b048649bd8f8a12077314b" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 36563 } } peers { permanent_uuid: "b35d2da37dfa4479b3e2cd365e6b580e" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 46095 } } peers { permanent_uuid: "8e50a0e72a3b437da440d01405224bb1" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 46675 } } }
I20260812 17:47:50.116756 25841 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0ceb8cf60b048649bd8f8a12077314b [sys.catalog]: This master's current role is: LEADER
I20260812 17:47:50.117825 25792 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e50a0e72a3b437da440d01405224bb1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a0ceb8cf60b048649bd8f8a12077314b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0ceb8cf60b048649bd8f8a12077314b" member_type: VOTER last_known_addr { host: "127.17.255.62" port: 36563 } } peers { permanent_uuid: "b35d2da37dfa4479b3e2cd365e6b580e" member_type: VOTER last_known_addr { host: "127.17.255.61" port: 46095 } } peers { permanent_uuid: "8e50a0e72a3b437da440d01405224bb1" member_type: VOTER last_known_addr { host: "127.17.255.60" port: 46675 } } }
I20260812 17:47:50.117950 25792 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e50a0e72a3b437da440d01405224bb1 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 17:47:50.118709 25855 mvcc.cc:205] Tried to move back new op lower bound from 7317736939905937408 to 7317736939761356800. Current Snapshot: MvccSnapshot[applied={T|T < 7317736939905937408}]
I20260812 17:47:50.118891 25857 mvcc.cc:205] Tried to move back new op lower bound from 7317736939905937408 to 7317736939761356800. Current Snapshot: MvccSnapshot[applied={T|T < 7317736939905937408}]
I20260812 17:47:50.127492 25844 catalog_manager.cc:1347] Generated new cluster ID: 4ea14b34c75d46678085d0a0e88b34aa
I20260812 17:47:50.127597 25844 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 17:47:50.180714 25844 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 17:47:50.185493 25844 catalog_manager.cc:1504] Loading token signing keys...
I20260812 17:47:50.206308 25844 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a0ceb8cf60b048649bd8f8a12077314b: Generated new TSK 0
I20260812 17:47:50.207409 25844 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 17:47:50.244891 25769 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:47:50.241864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43024 (local address 127.17.255.60:46675)
0812 17:47:50.242026 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:50.242031 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:50.243824 (+ 1793us) server_negotiation.cc:407] Connection header received
0812 17:47:50.244027 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:50.244031 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:50.244084 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:50.244136 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:50.244751 (+ 615us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43024: BlockingRecv error: recv got EOF from 127.0.0.1:43024 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260812 17:47:50.246487 25544 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:47:50.242606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47776 (local address 127.17.255.62:36563)
0812 17:47:50.242718 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:50.242722 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:50.245272 (+ 2550us) server_negotiation.cc:407] Connection header received
0812 17:47:50.245648 (+ 376us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:50.245652 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:50.245706 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:50.245759 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:50.246291 (+ 532us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47776: BlockingRecv error: recv got EOF from 127.0.0.1:47776 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260812 17:47:50.247843 25662 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:47:50.243236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38572 (local address 127.17.255.61:46095)
0812 17:47:50.243352 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:50.243357 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:50.246862 (+ 3505us) server_negotiation.cc:407] Connection header received
0812 17:47:50.247098 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:50.247101 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:50.247153 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:50.247204 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:50.247726 (+ 522us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38572: BlockingRecv error: recv got EOF from 127.0.0.1:38572 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260812 17:47:50.252671 25662 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:47:50.251123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38584 (local address 127.17.255.61:46095)
0812 17:47:50.251225 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:50.251229 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:50.251675 (+ 446us) server_negotiation.cc:407] Connection header received
0812 17:47:50.251888 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:50.251891 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:50.251983 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:50.252041 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:50.252560 (+ 519us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38584: BlockingRecv error: recv got EOF from 127.0.0.1:38584 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260812 17:47:50.257530 25662 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:47:50.256596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38596 (local address 127.17.255.61:46095)
0812 17:47:50.256716 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:50.256719 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:50.256731 (+ 12us) server_negotiation.cc:407] Connection header received
0812 17:47:50.256775 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:50.256777 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:50.256817 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:50.256885 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:50.257393 (+ 508us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38596: BlockingRecv error: recv got EOF from 127.0.0.1:38596 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260812 17:47:50.262312 25662 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:47:50.261205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38600 (local address 127.17.255.61:46095)
0812 17:47:50.261324 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:50.261327 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:50.261461 (+ 134us) server_negotiation.cc:407] Connection header received
0812 17:47:50.261592 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:50.261594 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:50.261637 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:50.261747 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:50.262210 (+ 463us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38600: BlockingRecv error: recv got EOF from 127.0.0.1:38600 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260812 17:47:50.269348 25662 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:47:50.268181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38602 (local address 127.17.255.61:46095)
0812 17:47:50.268345 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:50.268348 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:50.268459 (+ 111us) server_negotiation.cc:407] Connection header received
0812 17:47:50.268603 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:50.268605 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:50.268648 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:50.268716 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:50.269224 (+ 508us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38602: BlockingRecv error: recv got EOF from 127.0.0.1:38602 (error 108)
Metrics: {"server-negotiator.queue_time_us":100}
W20260812 17:47:50.280685 25662 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:47:50.279650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38612 (local address 127.17.255.61:46095)
0812 17:47:50.279791 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:50.279796 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:50.279934 (+ 138us) server_negotiation.cc:407] Connection header received
0812 17:47:50.280034 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:50.280037 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:50.280090 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:50.280183 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:50.280572 (+ 389us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38612: BlockingRecv error: recv got EOF from 127.0.0.1:38612 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260812 17:47:50.300590 25662 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:47:50.299370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38618 (local address 127.17.255.61:46095)
0812 17:47:50.299515 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:50.299519 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:50.299659 (+ 140us) server_negotiation.cc:407] Connection header received
0812 17:47:50.299806 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:50.299808 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:50.299876 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:50.299971 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:50.300442 (+ 471us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38618: BlockingRecv error: recv got EOF from 127.0.0.1:38618 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260812 17:47:50.336127 25662 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:47:50.335003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38622 (local address 127.17.255.61:46095)
0812 17:47:50.335159 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:50.335167 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:50.335291 (+ 124us) server_negotiation.cc:407] Connection header received
0812 17:47:50.335420 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:50.335423 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:50.335475 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:50.335551 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:50.335997 (+ 446us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38622: BlockingRecv error: recv got EOF from 127.0.0.1:38622 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260812 17:47:50.403721 25662 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:47:50.402415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38630 (local address 127.17.255.61:46095)
0812 17:47:50.402587 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:50.402593 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:50.402730 (+ 137us) server_negotiation.cc:407] Connection header received
0812 17:47:50.402924 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:50.402927 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:50.402989 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:50.403085 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:50.403576 (+ 491us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38630: BlockingRecv error: recv got EOF from 127.0.0.1:38630 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260812 17:47:50.535725 25662 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:47:50.534441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38636 (local address 127.17.255.61:46095)
0812 17:47:50.534630 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:50.534635 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:50.534687 (+ 52us) server_negotiation.cc:407] Connection header received
0812 17:47:50.534866 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:50.534873 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:50.534945 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:50.535039 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:50.535598 (+ 559us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38636: BlockingRecv error: recv got EOF from 127.0.0.1:38636 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
W20260812 17:47:50.795322 25662 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 17:47:50.794230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38644 (local address 127.17.255.61:46095)
0812 17:47:50.794390 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:50.794394 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:50.794429 (+ 35us) server_negotiation.cc:407] Connection header received
0812 17:47:50.794617 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:50.794620 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:50.794674 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:50.794757 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 17:47:50.795215 (+ 458us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38644: BlockingRecv error: recv got EOF from 127.0.0.1:38644 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 17:47:51.025401 25789 catalog_manager.cc:1259] Loaded cluster ID: 4ea14b34c75d46678085d0a0e88b34aa
I20260812 17:47:51.025494 25789 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b35d2da37dfa4479b3e2cd365e6b580e: loading cluster ID for follower catalog manager: success
I20260812 17:47:51.027266 25789 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b35d2da37dfa4479b3e2cd365e6b580e: acquiring CA information for follower catalog manager: success
I20260812 17:47:51.028501 25789 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b35d2da37dfa4479b3e2cd365e6b580e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 17:47:51.039626 25813 catalog_manager.cc:1259] Loaded cluster ID: 4ea14b34c75d46678085d0a0e88b34aa
I20260812 17:47:51.039710 25813 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8e50a0e72a3b437da440d01405224bb1: loading cluster ID for follower catalog manager: success
I20260812 17:47:51.041466 25813 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8e50a0e72a3b437da440d01405224bb1: acquiring CA information for follower catalog manager: success
I20260812 17:47:51.042711 25813 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8e50a0e72a3b437da440d01405224bb1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 17:47:51.313637 25956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:51.309701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38652 (local address 127.17.255.61:46095)
0812 17:47:51.309944 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:51.309948 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:51.309965 (+ 17us) server_negotiation.cc:407] Connection header received
0812 17:47:51.310067 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:51.310070 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:51.310207 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:51.310367 (+ 160us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:47:51.310746 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:51.311284 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:51.312161 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:51.312414 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:51.312500 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:51.312794 (+ 294us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:47:51.313261 (+ 467us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:47:51.313388 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:51.313454 (+ 66us) server_negotiation.cc:299] Negotiation successful
0812 17:47:51.313506 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":100,"threads_started":1}
I20260812 17:47:51.321487 25965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:51.317202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43036 (local address 127.17.255.60:46675)
0812 17:47:51.317432 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:51.317435 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:51.317450 (+ 15us) server_negotiation.cc:407] Connection header received
0812 17:47:51.317618 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:51.317621 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:51.317749 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:51.317857 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:47:51.318162 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:51.318777 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:51.319895 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:51.320154 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:51.320240 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:51.320624 (+ 384us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:47:51.321102 (+ 478us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:47:51.321202 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:51.321267 (+ 65us) server_negotiation.cc:299] Negotiation successful
0812 17:47:51.321323 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":74,"threads_started":1}
I20260812 17:47:51.329207 25956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:51.325527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38662 (local address 127.17.255.61:46095)
0812 17:47:51.325652 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:51.325656 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:51.325668 (+ 12us) server_negotiation.cc:407] Connection header received
0812 17:47:51.325911 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:51.325915 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:51.325985 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:51.326065 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:47:51.326480 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:51.327098 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:51.328037 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:51.328279 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:51.328395 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:51.328679 (+ 284us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:47:51.328780 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:47:51.328864 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:51.328982 (+ 118us) server_negotiation.cc:299] Negotiation successful
0812 17:47:51.329049 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 17:47:51.329849 25965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:51.325024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43042 (local address 127.17.255.60:46675)
0812 17:47:51.325170 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:51.325175 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:51.325559 (+ 384us) server_negotiation.cc:407] Connection header received
0812 17:47:51.325762 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:51.325766 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:51.325833 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:51.325906 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:47:51.326132 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:51.326956 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:51.328504 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:51.328797 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:51.328914 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:51.329267 (+ 353us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:47:51.329398 (+ 131us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:47:51.329448 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:51.329635 (+ 187us) server_negotiation.cc:299] Negotiation successful
0812 17:47:51.329691 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 17:47:51.330530 25975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 17:47:51.325036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47788 (local address 127.17.255.62:36563)
0812 17:47:51.325329 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0812 17:47:51.325336 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 17:47:51.325355 (+ 19us) server_negotiation.cc:407] Connection header received
0812 17:47:51.325478 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 17:47:51.325483 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 17:47:51.325701 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 17:47:51.325868 (+ 167us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 17:47:51.326301 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:51.327136 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:51.328510 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 17:47:51.328911 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 17:47:51.329012 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 17:47:51.329524 (+ 512us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 17:47:51.329942 (+ 418us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 17:47:51.330049 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 17:47:51.330233 (+ 184us) server_negotiation.cc:299] Negotiation successful
0812 17:47:51.330322 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":89,"threads_started":1}
I20260812 17:47:51.334218 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 25435
I20260812 17:47:51.353374 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 25548
I20260812 17:47:51.373183 18428 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHxSJQV/build/debug/bin/kudu with pid 25664
2026-08-12T17:47:51Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3533 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (7017 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (313582 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST